SECTION 05 / 8

Why the optimizing scalar becomes a function T(x)

1 min read
Figure 38. A scalar-valued function T.
Figure 38. A scalar-valued function T.
Open image ↗
Illustration: Why the optimizing scalar becomes a function T(x)

In f-divergence the density ratio p(x)q(x)\frac{p(x)}{q(x)} depends on the location x. Therefore the optimizing scalar t can also depend on x. Write t=T(x)t=T(x), where T maps the data space X to the real numbers. T(x1)T(x_1), T(x2)T(x_2), and T(x3)T(x_3) may be different, but they need not be.

The optimization variable is now an entire function T, not one fixed number. A function class T\mathcal{T} is a collection of candidate functions. Restricting this class may make optimization more practical, but the supremum over a restricted class cannot exceed that over the full admissible class.

Figure 40. Function class.
Figure 40. Function class.
Open image ↗
Illustration: Why the optimizing scalar becomes a function T(x)
Figure 39. Pointwise and function optimization.
Figure 39. Pointwise and function optimization.
Open image ↗
Illustration: Why the optimizing scalar becomes a function T(x)
YOUR STUDY PROGRESS

Finished this section? Save your progress.

Back to top ↑