Constructing PDFs for Max Likelihood Density Estimation Problem

In summary, the constrained optimization problem corresponding to the maximum likelihood density estimation is to maximize ##L(f)## subject to ##f\in H## and where ##n## is a fixed positive integer. The function ##f_n## graphically represented in the figure below has all but one of the properties you want, provided you choose the family of betas with peak heights at the even integers.
  • #1
AEW
9
2
TL;DR Summary
Construct some probability density functions for the maximum likelihood density estimation problem.
I have the following constrained optimization problem corresponding to the maximum likelihood density estimation:
$$
\begin{aligned}
&\text{maximize} && L(f) \\
&\text{subject to} && f \in H \\
&&& \int_a^b f(x) \mathop{}\!\mathrm{d} x = 1 \\
&&& f(x) \geq 0 \text{ for all } x \in [a,b].
\end{aligned}
$$
where ##x## is a random variable with probability density function (PDF) ##f## on an interval ##[a,b] \subset \textrm{IR}##, and ##H## is a subspace of ##L^1 [a,b]## (i.e., Lebesgue integrable on ##[a,b]##).

I need to construct some PDFs ##f_n## to prove the existence of a solution to the above optimization problem, which should have the following properties:
- Continuous and positive on the interval ##(-1,1)##,
- Integrates to one on the interval ##[-1,1]##,
- Vanishes at ##(-1)## and ##1##,
- Equal to ##n## at ##x=0## (e.g., ##f_2=2## at ##x=0##).

These functions ##f_n## are graphically represented in the figure below. My question is how to mathematically represent the functions ##f_n##.

Thanks.

fn.png
 
Last edited:
Physics news on Phys.org
  • #2
The PDFs of the beta distribution have all but one of the properties you want, on the interval [0,1], provided you choose ##\alpha = \beta##. That leaves one free parameter you can use to set the summit of each curve at the level you want.
If you select a family of betas with peak heights at the even integers, you can then just transpose them to the interval [-1,1] and halve their height to get what you need.
 
  • Like
  • Informative
Likes AEW and FactChecker
  • #3
andrewkirk said:
The PDFs of the beta distribution have all but one of the properties you want, on the interval [0,1], provided you choose ##\alpha = \beta##. That leaves one free parameter you can use to set the summit of each curve at the level you want.
If you select a family of betas with peak heights at the even integers, you can then just transpose them to the interval [-1,1] and halve their height to get what you need.
Thank you, @andrewkirk, for your answer. That was helpful.
 
  • Like
Likes berkeman

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
16
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
8
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
961
  • Set Theory, Logic, Probability, Statistics
Replies
12
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
759
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
2K
Back
Top