Unit 4: Comprehensive Study Guide: Probability, Statistics, and Numerical Methods

Probability and Statistics

Random Variables

A random variable is a variable whose value is determined by the outcome of a random phenomenon. It maps the outcomes of a random process to numerical values.

Definition: A random variable is a function that assigns a numerical value to each outcome in the sample space of a random experiment.

Random variables can be classified into two main types:

• Discrete Random Variable: A variable that can take on a finite or countably infinite number of values. These are typically integer values, often resulting from counting.Examples: Number of heads in two coin flips (0, 1, 2), number of defective items in a sample.
• Continuous Random Variable: A variable that can take on any value within a given range or interval. These values are typically measurements.Examples: Height of a student, time taken to complete a task, temperature.

Associated with random variables are probability distributions:

• Probability Mass Function (PMF): For a discrete random variable, the PMF gives the probability that the random variable takes on a specific value. P(X = x).
• Probability Density Function (PDF): For a continuous random variable, the PDF describes the likelihood of the random variable falling within a particular range of values. The probability of X taking on any single value is 0. P(a ≤ X ≤ b) = ∫_a^b f(x) dx.
• Cumulative Distribution Function (CDF): For both discrete and continuous random variables, the CDF gives the probability that the random variable takes on a value less than or equal to a specific value. F(x) = P(X ≤ x).

Binomial Distribution

The Binomial distribution models the number of successes in a fixed number of independent Bernoulli trials.

Conditions for a Binomial Distribution:

1. Fixed number of trials (n).
2. Each trial has only two possible outcomes: 'success' or 'failure'.
3. The probability of success (p) is constant for each trial.
4. The trials are independent of each other.

The probability mass function (PMF) for a Binomial distribution is:

P(X = k) = C(n, k) × p^k × (1 - p)^{(n - k)}

Where:
X = number of successes
k = specific number of successes
n = number of trials
p = probability of success
C(n, k) = n! / (k! × (n - k)!) (binomial coefficient)

Important properties:

• Mean (μ) = n × p
• Variance (σ²) = n × p × (1 - p)

Example: If you flip a fair coin 10 times, the number of heads follows a Binomial distribution with n=10 and p=0.5.

Poisson Distribution

The Poisson distribution models the number of events occurring in a fixed interval of time or space, given a constant average rate of occurrence.

Conditions for a Poisson Distribution:

1. Events occur independently.
2. The average rate of events (λ) is constant over the interval.
3. The probability of two or more events occurring at exactly the same time or place is negligible.

The probability mass function (PMF) for a Poisson distribution is:

P(X = k) = (λ^k × e^-λ) / k!

Where:
X = number of events
k = specific number of events
λ = average rate of events per interval (also the mean and variance)
e = Euler's number (approximately 2.71828)

Important properties:

• Mean (μ) = λ
• Variance (σ²) = λ

Observation: The Poisson distribution can be used as an approximation to the Binomial distribution when n is large and p is small (typically n ≥ 20, p ≤ 0.05, and n × p ≤ 5), with λ = n × p.

Example: The number of calls received by a call center in an hour, if calls arrive at an average rate of 10 per hour.

Normal Distribution

The Normal distribution, also known as the Gaussian distribution, is a continuous probability distribution that is symmetric about its mean, forming a bell-shaped curve.

Characteristics of the Normal Distribution:

1. It is bell-shaped and symmetric around its mean (μ).
2. The mean, median, and mode are all equal.
3. The total area under the curve is 1.
4. Its tails extend infinitely in both directions but never touch the horizontal axis.

The probability density function (PDF) for a Normal distribution is:

f(x) = (1 / (σ√2π)) × e^{-(x - μ)2 / (2σ2)}

Where:
μ = mean
σ = standard deviation
σ² = variance
π ≈ 3.14159
e ≈ 2.71828

Standard Normal Distribution:

A special case where the mean (μ) is 0 and the standard deviation (σ) is 1. Any Normal distribution can be converted to a Standard Normal distribution using the Z-score formula:

Z = (X - μ) / σ

The Z-score represents the number of standard deviations a data point is from the mean.

Central Limit Theorem (CLT)

The Central Limit Theorem is a fundamental theorem of probability theory. It states that, under certain conditions, the distribution of sample means (or sums) from any population will approximate a Normal distribution, regardless of the original population's distribution, as the sample size becomes sufficiently large.

Statement of the Central Limit Theorem:
If a sufficiently large number of random samples are taken from any population with mean μ and finite variance σ², then the distribution of the sample means (X̄) will be approximately normally distributed with mean μ and variance σ²/n.

Key points: