Home
MIT 18.650
Fundamentals of Statistics
§
Section 1: Random Variables
Lectures 1–3: Random Variables and Convergence
§
Preliminaries
§
Convergence Definitions
§
LLN and CLT
§
Convergence Properties
§
The Delta Method
§
Applying Convergence Theorems
§
Convergence in Probability is Hard
Lecture 4: The Normal Distribution
Lecture 5: Multivariate Random Vectors
Lecture 6: The Multivariate Gaussian
§
Multivariate PDFs
§
Multivariate Gaussian
§
Multivariate Gaussian Properties and Theorems
§
Computational Examples
§
Section 2: Estimators
Lecture 7: Models and Estimators
§
Models
§
Estimators
Lecture 8: Confidence Intervals
§
Asymptotic Normality
§
Confidence Intervals
Lecture 9: Introducing the MLE
§
Types of Parameters, Identifiability
§
Defining the Maximum Likelihood Estimator (MLE)
Lecture 10: Consistency of the MLE
§
Kullback-Leibler (KL) Divergence
§
MLE Consistency
Lecture 11: MLE Asymptotic Normality
§
Defining Score
§
Defining Fisher Information
§
MLE Asymptotic Normality
§
The Cramér-Rao Lower Bound
Lecture 12: The EM Algorithm
§
Computing the MLE
§
Mixture Models
§
The EM Algorithm
Lecture 13: Method of Moments and Bootstrap
§
Method of Moments Estimator
§
Motivating Bootstrapping
§
Bootstrapping
§
Example: Bootstrapping the Median
Lecture 14: Bootstrap Properties and Constructing CIs
§
Bootstrap Properties
§
Constructing CIs
§
Example: Bootstrapping a Median CI
§
Section 3: Hypothesis Testing
Lecture 15: Introduction to Hypothesis Testing
§
Hypothesis Testing
§
Error Types
Lecture 16: The Wald Test
Lecture 17:
p
p
p
-Values
Lecture 18: Goodness of Fit and T Tests
§
The Chi-Squared Distribution
§
Goodness of Fit Tests
§
The T-Test
Lecture 19: Non-parametric Tests
§
The Kolmogorov-Smirnov Test
§
The Kolmogorov-Lilliefors Test
§
The Two-Sample Test
Lecture 20: Permutation Test and Multiple Hypothesis Testing
§
The Permutation Test
§
Multiple Hypothesis Testing
§
The Bonferroni Correction
§
The Benjamini-Hochberg Method
§
Section 4: Bayesian Inference
Lecture 21: Bayesian Inference I
§
Review: Likelihood and Multivariate Distributions
§
Priors and Posteriors
§
Conjugate Priors
§
Bayes Estimator and Max A Posteriori
Lecture 22: Bayesian Inference II
§
Computing the Bayes Estimator and MAP
§
Gaussian Conjugate Priors
§
Section 5: Linear Regression
Lecture 23: Linear Regression I
§
Linear Regression MLE
§
Least Squares Loss
§
Interpreting the LS Solution
Lecture 24: Linear Regression II
§
Variance of the LS Solution
§
Linear Regression Confidence Intervals
§
Affine Linear Regression
§
1D Linear Regression and Correlation
Lecture 25: Logistic Regression
§
MLE for Logistic Regression
§
Multiclass Classification