μ MemoLearning Probability and Statistics

Understanding uncertainty, data analysis, and statistical inference

← Back to Mathematics

Curriculum Overview

12
Total Units
~150
Key Concepts
8
Core Units
4
Advanced Units
1

Foundations of Probability

Learn the basic concepts and axioms of probability theory.

  • Sample spaces and events
  • Probability axioms
  • Conditional probability
  • Independence
  • Law of total probability
  • Bayes' theorem
  • Counting principles
  • Permutations and combinations
2

Random Variables

Study discrete and continuous random variables and their distributions.

  • Random variable definition
  • Discrete random variables
  • Probability mass functions
  • Continuous random variables
  • Probability density functions
  • Cumulative distribution functions
  • Expectation and variance
  • Moment generating functions
3

Common Probability Distributions

Master the most important discrete and continuous probability distributions.

  • Bernoulli and binomial distributions
  • Geometric and negative binomial
  • Poisson distribution
  • Uniform distribution
  • Normal (Gaussian) distribution
  • Exponential distribution
  • Chi-square, t, and F distributions
  • Beta and gamma distributions
4

Joint Distributions and Independence

Study multiple random variables and their relationships.

  • Joint probability distributions
  • Marginal distributions
  • Conditional distributions
  • Independence of random variables
  • Covariance and correlation
  • Bivariate normal distribution
  • Transformations of random variables
  • Order statistics
5

Limit Theorems

Learn the fundamental limit theorems that justify statistical methods.

  • Convergence concepts
  • Law of large numbers (weak and strong)
  • Central limit theorem
  • Delta method
  • Continuity theorem
  • Applications to sampling
  • Berry-Esseen theorem
  • Large deviation theory
6

Descriptive Statistics

Learn to summarize and visualize data effectively.

  • Measures of central tendency
  • Measures of variability
  • Percentiles and quartiles
  • Box plots and histograms
  • Scatter plots and correlation
  • Data cleaning and outliers
  • Exploratory data analysis
  • Graphical methods
7

Sampling and Sampling Distributions

Understand how sample statistics relate to population parameters.

  • Sampling methods
  • Sample statistics
  • Sampling distribution of the mean
  • Sampling distribution of proportions
  • Student's t-distribution
  • Chi-square distribution applications
  • F-distribution
  • Bootstrap methods
8

Statistical Estimation

Learn methods for estimating population parameters from sample data.

  • Point estimation
  • Method of moments
  • Maximum likelihood estimation
  • Properties of estimators
  • Confidence intervals
  • Interval estimation for means
  • Interval estimation for proportions
  • Bayesian estimation
9

Hypothesis Testing

Master the logic and methods of statistical hypothesis testing.

  • Hypothesis testing framework
  • Type I and Type II errors
  • Power of statistical tests
  • One-sample tests for means
  • One-sample tests for proportions
  • Two-sample tests
  • Paired sample tests
  • p-values and significance levels
10

Analysis of Variance (ANOVA)

Learn to compare means across multiple groups and factors.

  • One-way ANOVA
  • ANOVA assumptions
  • Post-hoc tests
  • Two-way ANOVA
  • Interaction effects
  • Repeated measures ANOVA
  • Non-parametric alternatives
  • Effect sizes
11

Regression Analysis

Study relationships between variables using regression methods.

  • Simple linear regression
  • Least squares estimation
  • Regression assumptions
  • Inference in regression
  • Multiple linear regression
  • Model selection
  • Logistic regression
  • Non-linear regression
12

Advanced Topics and Applications

Explore modern statistical methods and their applications.

  • Non-parametric methods
  • Survival analysis
  • Time series analysis
  • Experimental design
  • Quality control
  • Machine learning connections
  • Bayesian statistics
  • Statistical computing

Unit 1: Foundations of Probability

Build the mathematical foundation for probability theory and learn the basic rules of probability.

Sample Spaces and Events

Learn sample space Ω as the set of all possible outcomes. Define events as subsets of the sample space and study set operations on events.

Probability Axioms

Master Kolmogorov's axioms: P(Ω) = 1, P(A) ≥ 0 for all events A, and countable additivity for disjoint events. Derive basic probability rules.

Conditional Probability

Define P(A|B) = P(A ∩ B)/P(B) and understand it as probability of A given information about B. Learn multiplication rule and its applications.

Independence

Learn that events A and B are independent if P(A ∩ B) = P(A)P(B). Understand independence vs. disjointness and mutual independence.

Law of Total Probability

For partition {B₁, B₂, ...}, learn P(A) = Σ P(A|Bᵢ)P(Bᵢ). Use this law to break complex problems into simpler conditional problems.

Bayes' Theorem

Learn P(Bᵢ|A) = P(A|Bᵢ)P(Bᵢ)/P(A) for updating probabilities with new information. Apply to medical diagnosis, spam filtering, and other inverse problems.

Counting Principles

Master fundamental counting principle, addition principle, and inclusion-exclusion. Learn to count outcomes systematically for probability calculations.

Permutations and Combinations

Learn P(n,r) = n!/(n-r)! for arrangements and C(n,r) = n!/(r!(n-r)!) for selections. Apply to probability problems involving equal likelihood.

Unit 2: Random Variables

Learn how to model uncertain quantities using random variables and their distributions.

Random Variable Definition

Define random variable X as a function from sample space to real numbers: X: Ω → ℝ. Understand how this maps outcomes to numerical values.

Discrete Random Variables

Study random variables with countable range. Learn that all probability mass concentrates at specific values with positive probability.

Probability Mass Functions

Define PMF as p(x) = P(X = x) for discrete X. Learn that PMF satisfies p(x) ≥ 0 and Σp(x) = 1 over all possible values.

Continuous Random Variables

Study random variables with uncountable range. Learn that P(X = x) = 0 for any specific value, so we work with intervals instead.

Probability Density Functions

Define PDF f(x) where P(a ≤ X ≤ b) = ∫ₐᵇ f(x)dx. Learn that f(x) ≥ 0 and ∫₋∞^∞ f(x)dx = 1.

Cumulative Distribution Functions

Define CDF as F(x) = P(X ≤ x) for all real x. Learn properties: F is non-decreasing, right-continuous, with F(-∞) = 0 and F(∞) = 1.

Expectation and Variance

Learn E[X] = Σx·p(x) or ∫x·f(x)dx as the "center" of distribution. Define Var(X) = E[(X - μ)²] as measure of spread.

Moment Generating Functions

Define MGF as M(t) = E[e^(tX)]. Learn how MGFs uniquely determine distributions and simplify calculations involving sums of random variables.

Unit 3: Common Probability Distributions

Master the most important probability distributions and their applications.

Bernoulli and Binomial

Study Bernoulli(p) for single success/failure trial and Binomial(n,p) for number of successes in n independent trials. Learn formulas and applications.

Geometric and Negative Binomial

Learn Geometric(p) for number of trials until first success and NegativeBinomial(r,p) for trials until r-th success. Understand memoryless property.

Poisson Distribution

Study Poisson(λ) for counting rare events in fixed time/space. Learn as limit of binomial when n → ∞, p → 0, np → λ. Apply to queuing, reliability.

Uniform Distribution

Learn Uniform(a,b) with constant density on [a,b]. Understand as model for "equally likely" outcomes and its use in simulation and random number generation.

Normal Distribution

Master Normal(μ,σ²) as the most important continuous distribution. Learn standard normal, 68-95-99.7 rule, and central role in statistics via CLT.

Exponential Distribution

Study Exponential(λ) for modeling waiting times. Learn memoryless property and relationship to Poisson process. Apply to reliability and survival analysis.

Chi-square, t, and F

Learn these distributions from normal: χ² for sums of squared normals, t for ratios involving sample variance, F for ratios of χ² variables. Essential for inference.

Beta and Gamma

Study Gamma(α,β) as generalization of exponential and Beta(α,β) for probabilities on [0,1]. Learn their flexibility for modeling various phenomena.

Unit 4: Joint Distributions and Independence

Study multiple random variables simultaneously and their relationships.

Joint Probability Distributions

Define joint PMF p(x,y) = P(X=x, Y=y) for discrete variables and joint PDF f(x,y) for continuous variables. Learn to compute probabilities over regions.

Marginal Distributions

Obtain marginal distributions by "summing out" or "integrating out" other variables: pₓ(x) = Σᵧ p(x,y) or fₓ(x) = ∫ f(x,y)dy.

Conditional Distributions