Introduction to the Gaussian Distribution
The Gaussian distribution, more commonly referred to as the Normal Distribution, is a continuous probability distribution that plays a central role in many fields, including statistics, physics, and machine learning. It is characterized by its iconic "bell curve" shape, which is symmetric around a central value. The importance of this distribution stems from the Central Limit Theorem, which suggests that the sum of many independent, identically distributed random variables tends toward a normal distribution, regardless of the original distribution.
The Probability Density Function
The mathematical shape of the Gaussian distribution is defined by its Probability Density Function (PDF). This function describes the likelihood of a continuous random variable \(x\) taking on a specific value. The formula for the PDF of a normal distribution is:
$$f(x) = \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2}$$
Core Parameters
A normal distribution is uniquely determined by two key parameters that dictate its position and spread on the horizontal axis:
- Mean (\(\mu\)): This is the arithmetic average of the distribution. It determines the location of the center of the bell curve. Because the distribution is symmetric, the mean, median, and mode are all equal to \(\mu\).
- Standard Deviation (\(\sigma\)): This parameter measures the dispersion or spread of the data. A small \(\sigma\) indicates that the data points are clustered closely around the mean, resulting in a tall, narrow peak. A large \(\sigma\) indicates that the data is spread out, resulting in a shorter, wider curve.
The Empirical Rule (68-95-99.7 Rule)
One of the most practical applications of the Gaussian distribution is the Empirical Rule. This rule provides a quick way to understand how much of the data lies within certain distances from the mean:
- Approximately \(68\%\) of the total area under the curve lies within one standard deviation of the mean: \(\mu \pm \sigma\).
- Approximately \(95\%\) of the data falls within two standard deviations of the mean: \(\mu \pm 2\sigma\).
- Approximately \(99.7\%\) of the data falls within three standard deviations of the mean: \(\mu \pm 3\sigma\).
Standardization and Z-Scores
In many statistical analyses, it is necessary to compare data points from different normal distributions. To do this, we transform the data into a "Standard Normal Distribution," which has a mean of \(0\) and a standard deviation of \(1\). This is achieved by calculating the Z-score for any given value \(x\). The formula for the Z-score is:
$$z = \frac{x - \mu}{\sigma}$$
The resulting Z-score tells us exactly how many standard deviations a value is above or below the mean. For example, a Z-score of \(+2.0\) means the observation is two standard deviations above the mean, while a Z-score of \(-1.5\) means it is one and a half standard deviations below the mean.
.jpg)