How are the Normal importance-sampling proposal parameters chosen from the retained samples?
The parameters of the Normal proposal distribution are chosen using maximum likelihood estimation. The mean is set to the sample mean of the retained samples, and the standard deviation is set to the square root of the sample second central moment of those samples.
Conditions
- The proposal family is restricted to Normal distributions.
- The data used for fitting are the retained samples satisfying .
Reasoning, step by step
- Compute the sample mean of the retained samples to estimate .
- Compute the sample root second central moment of the retained samples to estimate .
Example
The code computes `mu = np.mean(Xs)` and `sigma = np.sqrt(np.mean((Xs-mu)**2))`, and the narrator describes this as finding maximum likelihood estimates for and given the samples.
Common misconceptions
- Assuming the parameters are chosen randomly.
- Thinking the standard deviation is calculated using an unbiased sample variance (dividing by ) rather than the sample second central moment (dividing by ).
Watch the explanation
Explore next
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.