Why does the lecturer say the observed data are constant when discussing likelihood?
Conditions
- The data have already been observed.
- The discussion is in the inference stage rather than the sampling stage.
Reasoning, step by step
- Identify the sampling stage where are random variables.
- Recognize the transition to the inference stage after data collection.
- Understand that the realized values are now fixed constants.
- Shift the focus to finding a good value of the unknown parameter given these fixed data.
- Define the likelihood function based on this fixed-data viewpoint.
Example
The speaker says, "now we've collected our data, we need to think of that data as constant. There's no more variability anymore. Now we're in math stat world where our data are collected and they're constant."
Common misconceptions
- Confusing observed data with still-random quantities after they have been collected.
- Thinking that randomness belongs to the likelihood evaluation stage rather than the sampling stage.
Watch the explanation
Connected concepts
Explore next
Related questions
The parameters of the Normal proposal distribution are chosen using maximum likelihood estimation. The mean is set to the sample mean of the retained samples, and the standard deviation is set to the square root of the sample second central moment of those samples.
Conditions: The proposal family is restricted to Normal distributions.; The data used for fitting are the retained samples satisfying .
The likelihood function is . It represents the probability of observing 7 heads and 3 tails as a function of the unknown parameter , the probability of heads.
Conditions: The number of tosses .; The observed number of heads .; is the probability of heads on a single toss.
To compute the likelihood for an independent sample, first write the joint pmf/pdf of all observations conditional on the parameter, then use independence to factor it into a product of the individual pmf/pdf terms.
Conditions: The sample is independent.; Each observation has the same functional form .; The data values are plugged in while remains symbolic.
Probability fixes the parameter and varies the data, resulting in a normalized distribution where the probabilities sum to 1. Likelihood fixes the data and varies the parameter, resulting in a non-normalized curve whose integral does not equal 1.
Conditions: Both views are based on the same conditional expression .; Probability view: parameter is fixed, data varies.; Likelihood view: data is fixed, parameter varies.
The elite samples are weighted by likelihood ratios because they are drawn from the current proposal distribution, not the original target distribution. The likelihood ratio corrects for this discrepancy, ensuring that the updated proposal parameters accurately reflect the maximum likelihood estimates under the original distribution.
Conditions: Elite samples are those with values above the iteration threshold .; The likelihood ratios are computed as the original density divided by the proposal density.
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.