Misplaced Pages

#226773

74-407: Several measures of statistical dispersion are defined in terms of the absolute deviation. The term "average absolute deviation" does not uniquely identify a measure of statistical dispersion , as there are several measures that can be used to measure absolute deviations, and there are several measures of central tendency that can be used as well. Thus, to uniquely identify the absolute deviation it

148-431: A {\displaystyle a} , that is, ignores a preceding negative sign − {\displaystyle -} . Other measures of dispersion are dimensionless . In other words, they have no units even if the variable itself has units. These include: There are other measures of dispersion: Some measures of dispersion have specialized purposes. The Allan variance can be used for applications where

222-402: A X + b {\displaystyle Y=aX+b} for real a {\displaystyle a} and b {\displaystyle b} should have dispersion S Y = | a | S X {\displaystyle S_{Y}=|a|S_{X}} , where | a | {\displaystyle |a|} is the absolute value of

296-560: A continuous real-valued random variable X with probability density function p ( x ) is σ = ∫ X ( x − μ ) 2 p ( x ) d x ,  where  μ = ∫ X x p ( x ) d x , {\displaystyle \sigma ={\sqrt {\int _{\mathbf {X} }(x-\mu )^{2}\,p(x)\,\mathrm {d} x}},{\text{ where }}\mu =\int _{\mathbf {X} }x\,p(x)\,\mathrm {d} x,} and where

370-614: A built-in bias. See the discussion on Bessel's correction further down below. or, by using summation notation, σ = 1 N ∑ i = 1 N ( x i − μ ) 2 ,  where  μ = 1 N ∑ i = 1 N x i . {\displaystyle \sigma ={\sqrt {{\frac {1}{N}}\sum _{i=1}^{N}(x_{i}-\mu )^{2}}},{\text{ where }}\mu ={\frac {1}{N}}\sum _{i=1}^{N}x_{i}.} If, instead of having equal probabilities,

444-724: A correction factor to produce an unbiased estimate. For the normal distribution, an unbiased estimator is given by ⁠ s / c 4 ⁠ , where the correction factor (which depends on N ) is given in terms of the Gamma function , and equals: c 4 ( N ) = 2 N − 1 Γ ( N 2 ) Γ ( N − 1 2 ) . {\displaystyle c_{4}(N)\,=\,{\sqrt {\frac {2}{N-1}}}\,\,\,{\frac {\Gamma \left({\frac {N}{2}}\right)}{\Gamma \left({\frac {N-1}{2}}\right)}}.} This arises because

518-798: A finite data set x 1 , x 2 , ..., x N , with each value having the same probability, the standard deviation is σ = 1 N [ ( x 1 − μ ) 2 + ( x 2 − μ ) 2 + ⋯ + ( x N − μ ) 2 ] ,  where  μ = 1 N ( x 1 + ⋯ + x N ) , {\displaystyle \sigma ={\sqrt {{\frac {1}{N}}\left[(x_{1}-\mu )^{2}+(x_{2}-\mu )^{2}+\cdots +(x_{N}-\mu )^{2}\right]}},{\text{ where }}\mu ={\frac {1}{N}}(x_{1}+\cdots +x_{N}),} Note: The above expression has

592-441: A height within 6 inches of the mean ( 63–75 inches ) – two standard deviations. If the standard deviation were zero, then all men would share an identical height of 69 inches. Three standard deviations account for 99.73% of the sample population being studied, assuming the distribution is normal or bell-shaped (see the 68–95–99.7 rule , or the empirical rule, for more information). Let μ be

666-425: A measure of potential error in the findings). By convention, only effects more than two standard errors away from a null expectation are considered "statistically significant" , a safeguard against spurious conclusion that is really due to random sampling error. When only a sample of data from a population is available, the term standard deviation of the sample or sample standard deviation can refer to either

740-447: A median of 1, in this case unaffected by the value of the outlier 14, so the median absolute deviation is 1. For a symmetric distribution, the median absolute deviation is equal to half the interquartile range . The maximum absolute deviation around an arbitrary point is the maximum of the absolute deviations of a sample from that point. While not strictly a measure of central tendency, the maximum absolute deviation can be found using

814-413: A set X  = { x 1 , x 2 , …, x n } is 1 n ∑ i = 1 n | x i − m ( X ) | . {\displaystyle {\frac {1}{n}}\sum _{i=1}^{n}|x_{i}-m(X)|.} The choice of measure of central tendency, m ( X ) {\displaystyle m(X)} , has a marked effect on

SECTION 10

#1732771762227

888-458: A small number of outliers , and include the IQR and MAD. All the above measures of statistical dispersion have the useful property that they are location-invariant and linear in scale . This means that if a random variable X {\displaystyle X} has a dispersion of S X {\displaystyle S_{X}} then a linear transformation Y =

962-459: A specified central point (see above). MAD has been proposed to be used in place of standard deviation since it corresponds better to real life. Because the MAD is a simpler measure of variability than the standard deviation , it can be useful in school teaching. This method's forecast accuracy is very closely related to the mean squared error (MSE) method which is just the average squared error of

1036-988: Is φ ( E [ Y ] ) ≤ E [ φ ( Y ) ] {\displaystyle \varphi \left(\mathbb {E} [Y]\right)\leq \mathbb {E} \left[\varphi (Y)\right]} , where φ is a convex function, this implies for Y = | X − μ | {\displaystyle Y=\vert X-\mu \vert } that: ( E | X − μ | ) 2 ≤ E ( | X − μ | 2 ) {\displaystyle \left(\mathbb {E} |X-\mu \right|)^{2}\leq \mathbb {E} \left(|X-\mu |^{2}\right)} ( E | X − μ | ) 2 ≤ Var ⁡ ( X ) {\displaystyle \left(\mathbb {E} |X-\mu \right|)^{2}\leq \operatorname {Var} (X)} Since both sides are positive, and

1110-779: Is defined as σ ≡ E ⁡ [ ( X − μ ) 2 ] = ∫ − ∞ + ∞ ( x − μ ) 2 f ( x ) d x , {\displaystyle \sigma \equiv {\sqrt {\operatorname {E} \left[(X-\mu )^{2}\right]}}={\sqrt {\int _{-\infty }^{+\infty }(x-\mu )^{2}f(x)\,\mathrm {d} x}},} which can be shown to equal E ⁡ [ X 2 ] − ( E ⁡ [ X ] ) 2 . {\textstyle {\sqrt {\operatorname {E} \left[X^{2}\right]-(\operatorname {E} [X])^{2}}}.} Using words,

1184-489: Is a measure of the amount of variation of the values of a variable about its mean . A low standard deviation indicates that the values tend to be close to the mean (also called the expected value ) of the set, while a high standard deviation indicates that the values are spread out over a wider range. The standard deviation is commonly used in the determination of what constitutes an outlier and what does not. Standard deviation may be abbreviated SD or Std Dev , and

1258-547: Is a nonnegative real number that is zero if all the data are the same and increases as the data become more diverse. Most measures of dispersion have the same units as the quantity being measured. In other words, if the measurements are in metres or seconds, so is the measure of dispersion. Examples of dispersion measures include: These are frequently used (together with scale factors ) as estimators of scale parameters , in which capacity they are called estimates of scale. Robust measures of scale are those unaffected by

1332-400: Is a normally distributed random variable with expected value 0 then, see Geary (1935): w = E | X | E ( X 2 ) = 2 π . {\displaystyle w={\frac {E|X|}{\sqrt {E(X^{2})}}}={\sqrt {\frac {2}{\pi }}}.} In other words, for a normal distribution, mean absolute deviation is about 0.8 times

1406-429: Is a very technically involved problem. Most often, the standard deviation is estimated using the corrected sample standard deviation (using N  − 1), defined below, and this is often referred to as the "sample standard deviation", without qualifiers. However, other estimators are better in other respects: the uncorrected estimator (using N ) yields lower mean squared error, while using N  − 1.5 (for

1480-422: Is additional inter-rater variability in interpreting and reporting the measured results. One may assume that the quantity being measured is stable, and that the variation between measurements is due to observational error . A system of a large number of particles is characterized by the mean values of a relatively few number of macroscopic quantities such as temperature, energy, and density. The standard deviation

1554-483: Is an important measure in fluctuation theory, which explains many physical phenomena, including why the sky is blue. In the biological sciences , the quantity being measured is seldom unchanging and stable, and the variation observed might additionally be intrinsic to the phenomenon: It may be due to inter-individual variability , that is, distinct members of a population differing from each other. Also, it may be due to intra-individual variability , that is, one and

SECTION 20

#1732771762227

1628-448: Is an unbiased estimator for the population variance, s is still a biased estimator for the population standard deviation, though markedly less biased than the uncorrected sample standard deviation. This estimator is commonly used and generally known simply as the "sample standard deviation". The bias may still be large for small samples ( N less than 10). As sample size increases, the amount of bias decreases. We obtain more information and

1702-442: Is based on the notion of mean-unbiasedness. Each measure of location has its own form of unbiasedness (see entry on biased estimator ). The relevant form of unbiasedness here is median unbiasedness. Statistical dispersion In statistics , dispersion (also called variability , scatter , or spread ) is the extent to which a distribution is stretched or squeezed. Common examples of measures of statistical dispersion are

1776-403: Is known as Bessel's correction . Roughly, the reason for it is that the formula for the sample variance relies on computing differences of observations from the sample mean, and the sample mean itself was constructed to be as close as possible to the observations, so just dividing by n would underestimate the variability. If the population of interest is approximately normally distributed,

1850-502: Is most commonly represented in mathematical texts and equations by the lowercase Greek letter σ (sigma), for the population standard deviation, or the Latin letter s , for the sample standard deviation. The standard deviation of a random variable , sample , statistical population , data set , or probability distribution is the square root of its variance. It is algebraically simpler, though in practice less robust , than

1924-458: Is necessary to specify both the measure of deviation and the measure of central tendency. The statistical literature has not yet adopted a standard notation, as both the mean absolute deviation around the mean and the median absolute deviation around the median have been denoted by their initials "MAD" in the literature, which may lead to confusion, since they generally have values considerably different from each other. The mean absolute deviation of

1998-420: Is suited for all but the smallest samples or highest precision: for N = 3 the bias is equal to 1.3%, and for N = 9 the bias is already less than 0.1%. A more accurate approximation is to replace N − 1.5 above with N − 1.5 + ⁠ 1 / 8( N − 1) ⁠ . For other distributions, the correct formula depends on the distribution, but a rule of thumb is to use the further refinement of

2072-492: Is the mean of these values: σ 2 = 9 + 1 + 1 + 1 + 0 + 0 + 4 + 16 8 = 32 8 = 4. {\displaystyle \sigma ^{2}={\frac {9+1+1+1+0+0+4+16}{8}}={\frac {32}{8}}=4.} and the population standard deviation is equal to the square root of the variance: σ = 4 = 2. {\displaystyle \sigma ={\sqrt {4}}=2.} This formula

2146-452: Is the measure of central tendency most associated with the absolute deviation. Some location parameters can be compared as follows: The mean absolute deviation of a sample is a biased estimator of the mean absolute deviation of the population. In order for the absolute deviation to be an unbiased estimator, the expected value (average) of all the sample absolute deviations must equal the population absolute deviation. However, it does not. For

2220-419: Is the point about which the mean deviation is minimized. The MAD median offers a direct measure of the scale of a random variable around its median D med = E | X − median | {\displaystyle D_{\text{med}}=E|X-{\text{median}}|} This is the maximum likelihood estimator of the scale parameter b {\displaystyle b} of

2294-524: Is unbiased if the variance exists and the sample values are drawn independently with replacement. N  − 1 corresponds to the number of degrees of freedom in the vector of deviations from the mean, ( x 1 − x ¯ , … , x n − x ¯ ) . {\displaystyle \textstyle (x_{1}-{\bar {x}},\;\dots ,\;x_{n}-{\bar {x}}).} Taking square roots reintroduces bias (because

Average absolute deviation - Misplaced Pages Continue

2368-537: Is valid only if the eight values with which we began form the complete population. If the values instead were a random sample drawn from some large parent population (for example, they were 8 students randomly and independently chosen from a class of 2 million), then one divides by 7 (which is n − 1) instead of 8 (which is n ) in the denominator of the last formula, and the result is s = 32 / 7 ≈ 2.1. {\textstyle s={\sqrt {32/7}}\approx 2.1.} In that case,

2442-476: The Laplace distribution . Since the median minimizes the average absolute distance, we have D med ≤ D mean {\displaystyle D_{\text{med}}\leq D_{\text{mean}}} . The mean absolute deviation from the median is less than or equal to the mean absolute deviation from the mean. In fact, the mean absolute deviation from the median is always less than or equal to

2516-463: The average absolute deviation . A useful property of the standard deviation is that, unlike the variance, it is expressed in the same unit as the data. The standard deviation of a population or sample and the standard error of a statistic (e.g., of the sample mean) are quite different, but related. The sample mean's standard error is the standard deviation of the set of means that would be found by drawing an infinite number of repeated samples from

2590-867: The confidence interval or CI. To show how a larger sample will make the confidence interval narrower, consider the following examples: A small population of N = 2 has only one degree of freedom for estimating the standard deviation. The result is that a 95% CI of the SD runs from 0.45 × SD to 31.9 × SD; the factors here are as follows : Pr ( q α 2 < k s 2 σ 2 < q 1 − α 2 ) = 1 − α , {\displaystyle \Pr \left(q_{\frac {\alpha }{2}}<k{\frac {s^{2}}{\sigma ^{2}}}<q_{1-{\frac {\alpha }{2}}}\right)=1-\alpha ,} where q p {\displaystyle q_{p}}

2664-411: The expected value (the average) of random variable X with density f ( x ) : μ ≡ E ⁡ [ X ] = ∫ − ∞ + ∞ x f ( x ) d x {\displaystyle \mu \equiv \operatorname {E} [X]=\int _{-\infty }^{+\infty }xf(x)\,\mathrm {d} x} The standard deviation σ of X

2738-1437: The mean (average) of 5: μ = 2 + 4 + 4 + 4 + 5 + 5 + 7 + 9 8 = 40 8 = 5. {\displaystyle \mu ={\frac {2+4+4+4+5+5+7+9}{8}}={\frac {40}{8}}=5.} First, calculate the deviations of each data point from the mean, and square the result of each: ( 2 − 5 ) 2 = ( − 3 ) 2 = 9 ( 5 − 5 ) 2 = 0 2 = 0 ( 4 − 5 ) 2 = ( − 1 ) 2 = 1 ( 5 − 5 ) 2 = 0 2 = 0 ( 4 − 5 ) 2 = ( − 1 ) 2 = 1 ( 7 − 5 ) 2 = 2 2 = 4 ( 4 − 5 ) 2 = ( − 1 ) 2 = 1 ( 9 − 5 ) 2 = 4 2 = 16. {\displaystyle {\begin{array}{lll}(2-5)^{2}=(-3)^{2}=9&&(5-5)^{2}=0^{2}=0\\(4-5)^{2}=(-1)^{2}=1&&(5-5)^{2}=0^{2}=0\\(4-5)^{2}=(-1)^{2}=1&&(7-5)^{2}=2^{2}=4\\(4-5)^{2}=(-1)^{2}=1&&(9-5)^{2}=4^{2}=16.\\\end{array}}} The variance

2812-401: The square root is a monotonically increasing function in the positive domain: E ( | X − μ | ) ≤ Var ⁡ ( X ) {\displaystyle \mathbb {E} \left(|X-\mu \right|)\leq {\sqrt {\operatorname {Var} (X)}}} For a general case of this statement, see Hölder's inequality . The median

2886-599: The standard deviation of the sample (considered as the entire population), and is defined as follows: s N = 1 N ∑ i = 1 N ( x i − x ¯ ) 2 , {\displaystyle s_{N}={\sqrt {{\frac {1}{N}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}}},} where { x 1 , x 2 , … , x N } {\displaystyle \{x_{1},\,x_{2},\,\ldots ,\,x_{N}\}} are

2960-402: The variance , standard deviation , and interquartile range . For instance, when the variance of data in a set is large, the data is widely scattered. On the other hand, when the variance is small, the data in the set is clustered. Dispersion is contrasted with location or central tendency , and together they are the most used properties of distributions. A measure of statistical dispersion

3034-409: The above-mentioned quantity as applied to those data, or to a modified quantity that is an unbiased estimate of the population standard deviation (the standard deviation of the entire population). Suppose that the entire population of interest is eight students in a particular class. For a finite set of numbers, the population standard deviation is found by taking the square root of the average of

Average absolute deviation - Misplaced Pages Continue

3108-497: The approximation: σ ^ = 1 N − 1.5 − 1 4 γ 2 ∑ i = 1 N ( x i − x ¯ ) 2 , {\displaystyle {\hat {\sigma }}={\sqrt {{\frac {1}{N-1.5-{\frac {1}{4}}\gamma _{2}}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}}},} where γ 2 denotes

3182-411: The bias is below 1%. Thus for very large sample sizes, the uncorrected sample standard deviation is generally acceptable. This estimator also has a uniformly smaller mean squared error than the corrected sample standard deviation. If the biased sample variance (the second central moment of the sample, which is a downward-biased estimate of the population variance) is used to compute an estimate of

3256-399: The difference between 1 N {\displaystyle {\frac {1}{N}}} and 1 N − 1 {\displaystyle {\frac {1}{N-1}}} becomes smaller. For unbiased estimation of standard deviation , there is no formula that works across all distributions, unlike for mean and variance. Instead, s is used as a basis, and is scaled by

3330-407: The estimated mean if the same poll were to be conducted multiple times. Thus, the standard error estimates the standard deviation of an estimate, which itself measures how much the estimate depends on the particular sample that was taken from the population. In science , it is common to report both the standard deviation of the data (as a summary statistic) and the standard error of the estimate (as

3404-493: The estimator (or the value of the estimator, namely the estimate) is called a sample standard deviation, and is denoted by s (possibly with modifiers). Unlike in the case of estimating the population mean of a normal distribution, for which the sample mean is a simple estimator with many desirable properties ( unbiased , efficient , maximum likelihood), there is no single estimator for the standard deviation with all these properties, and unbiased estimation of standard deviation

3478-444: The forecasts. Although these methods are very closely related, MAD is more commonly used because it is both easier to compute (avoiding the need for squaring) and easier to understand. For the normal distribution , the ratio of mean absolute deviation from the mean to standard deviation is 2 / π = 0.79788456 … {\textstyle {\sqrt {2/\pi }}=0.79788456\ldots } . Thus if X

3552-422: The formula for the average absolute deviation as above with m ( X ) = max ( X ) {\displaystyle m(X)=\max(X)} , where max ( X ) {\displaystyle \max(X)} is the sample maximum . The measures of statistical dispersion derived from absolute deviation characterize various measures of central tendency as minimizing dispersion: The median

3626-428: The indicator function is I O := { 1 if  x > median , 0 otherwise . {\displaystyle \mathbf {I} _{O}:={\begin{cases}1&{\text{if }}x>{\text{median}},\\0&{\text{otherwise}}.\end{cases}}} This representation allows for obtaining MAD median correlation coefficients. While in principle

3700-636: The integrals are definite integrals taken for x ranging over the set of possible values of the random variable  X . In the case of a parametric family of distributions , the standard deviation can be expressed in terms of the parameters. For example, in the case of the log-normal distribution with parameters μ and σ , the standard deviation is ( e σ 2 − 1 ) e 2 μ + σ 2 . {\displaystyle {\sqrt {\left(e^{\sigma ^{2}}-1\right)e^{2\mu +\sigma ^{2}}}}.} One can find

3774-406: The mean (the expected value) unchanged. The concept of a mean-preserving spread provides a partial ordering of probability distributions according to their dispersions: of two probability distributions, one may be ranked as having more dispersion than the other, or alternatively neither may be ranked as having more dispersion. Standard deviation In statistics , the standard deviation

SECTION 50

#1732771762227

3848-400: The mean absolute deviation from any other fixed number. By using the general dispersion function, Habib (2011) defined MAD about median as D med = E | X − median | = 2 Cov ⁡ ( X , I O ) {\displaystyle D_{\text{med}}=E|X-{\text{median}}|=2\operatorname {Cov} (X,I_{O})} where

3922-462: The mean or any other central point could be taken as the central point for the median absolute deviation, most often the median value is taken instead. The median absolute deviation (also MAD) is the median of the absolute deviation from the median . It is a robust estimator of dispersion . For the example {2, 2, 3, 4, 14}: 3 is the median, so the absolute deviations from the median are {1, 1, 0, 1, 11} (reordered as {0, 1, 1, 1, 11}) with

3996-470: The noise disrupts convergence. The Hadamard variance can be used to counteract linear frequency drift sensitivity. For categorical variables , it is less common to measure dispersion by a single number; see qualitative variation . One measure that does so is the discrete entropy . In the physical sciences , such variability may result from random measurement errors: instrument measurements are often not perfectly precise, i.e., reproducible , and there

4070-423: The normal distribution) almost completely eliminates bias. The formula for the population standard deviation (of a finite population) can be applied to the sample, using the size of the sample as the size of the population (though the actual population size from which the sample is drawn may be much larger). This estimator, denoted by s N , is known as the uncorrected sample standard deviation , or sometimes

4144-418: The observed values of the sample items, and x ¯ {\displaystyle {\bar {x}}} is the mean value of these observations, while the denominator  N stands for the size of the sample: this is the square root of the sample variance, which is the average of the squared deviations about the sample mean. This is a consistent estimator (it converges in probability to

4218-417: The population excess kurtosis . The excess kurtosis may be either known beforehand for certain distributions, or estimated from the data. The standard deviation we obtain by sampling a distribution is itself not absolutely accurate, both for mathematical reasons (explained here by the confidence interval) and for practical reasons of measurement (measurement error). The mathematical effect can be described by

4292-424: The population 1,2,3 both the population absolute deviation about the median and the population absolute deviation about the mean are 2/3. The average of all the sample absolute deviations about the mean of size 3 that can be drawn from the population is 44/81, while the average of all the sample absolute deviations about the median is 4/9. Therefore, the absolute deviation is a biased estimator. However, this argument

4366-414: The population and computing a mean for each sample. The mean's standard error turns out to equal the population standard deviation divided by the square root of the sample size, and is estimated by using the sample standard deviation divided by the square root of the sample size. For example, a poll's standard error (what is reported as the margin of error of the poll), is the expected standard deviation of

4440-421: The population value as the number of samples goes to infinity), and is the maximum-likelihood estimate when the population is normally distributed. However, this is a biased estimator , as the estimates are generally too low. The bias decreases as sample size grows, dropping off as 1/ N , and thus is most significant for small or moderate sample sizes; for N > 75 {\displaystyle N>75}

4514-456: The population's standard deviation, the result is s N = 1 N ∑ i = 1 N ( x i − x ¯ ) 2 . {\displaystyle s_{N}={\sqrt {{\frac {1}{N}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}}}.} Here taking the square root introduces further downward bias, by Jensen's inequality , due to

SECTION 60

#1732771762227

4588-431: The result of the original formula would be called the sample standard deviation and denoted by s {\textstyle s} instead of σ . {\displaystyle \sigma .} Dividing by n − 1 {\textstyle n-1} rather than by n {\textstyle n} gives an unbiased estimate of the variance of the larger parent population. This

4662-455: The same subject differing in tests taken at different times or in other differing conditions. Such types of variability are also seen in the arena of manufactured products; even there, the meticulous scientist finds variation. A mean-preserving spread (MPS) is a change from one probability distribution A to another probability distribution B, where B is formed by spreading out one or more portions of A's probability density function while leaving

4736-735: The sampling distribution of the sample standard deviation follows a (scaled) chi distribution , and the correction factor is the mean of the chi distribution. An approximation can be given by replacing N  − 1 with N  − 1.5 , yielding: σ ^ = 1 N − 1.5 ∑ i = 1 N ( x i − x ¯ ) 2 , {\displaystyle {\hat {\sigma }}={\sqrt {{\frac {1}{N-1.5}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}}},} The error in this approximation decays quadratically (as ⁠ 1 / N ⁠ ), and it

4810-653: The square root is a nonlinear function which does not commute with the expectation, i.e. often E [ X ] ≠ E [ X ] {\textstyle E[{\sqrt {X}}]\neq {\sqrt {E[X]}}} ), yielding the corrected sample standard deviation, denoted by s: s = 1 N − 1 ∑ i = 1 N ( x i − x ¯ ) 2 . {\displaystyle s={\sqrt {{\frac {1}{N-1}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}}}.} As explained above, while s

4884-713: The square root's being a concave function . The bias in the variance is easily corrected, but the bias from the square root is more difficult to correct, and depends on the distribution in question. An unbiased estimator for the variance is given by applying Bessel's correction , using N  − 1 instead of N to yield the unbiased sample variance, denoted s : s 2 = 1 N − 1 ∑ i = 1 N ( x i − x ¯ ) 2 . {\displaystyle s^{2}={\frac {1}{N-1}}\sum _{i=1}^{N}\left(x_{i}-{\bar {x}}\right)^{2}.} This estimator

4958-428: The squared deviations of the values subtracted from their average value. The marks of a class of eight students (that is, a statistical population ) are the following eight values: 2 ,   4 ,   4 ,   4 ,   5 ,   5 ,   7 ,   9. {\displaystyle 2,\ 4,\ 4,\ 4,\ 5,\ 5,\ 7,\ 9.} These eight data points have

5032-497: The standard deviation is the square root of the variance of X . The standard deviation of a probability distribution is the same as that of a random variable having that distribution. Not all random variables have a standard deviation. If the distribution has fat tails going out to infinity, the standard deviation might not exist, because the integral might not converge. The normal distribution has tails going out to infinity, but its mean and standard deviation do exist, because

5106-423: The standard deviation of an entire population in cases (such as standardized testing ) where every member of a population is sampled. In cases where that cannot be done, the standard deviation σ is estimated by examining a random sample taken from the population and computing a statistic of the sample, which is used as an estimate of the population standard deviation. Such a statistic is called an estimator , and

5180-560: The standard deviation provides information on the proportion of observations above or below certain values. For example, the average height for adult men in the United States is about 69 inches , with a standard deviation of around 3 inches . This means that most men (about 68%, assuming a normal distribution ) have a height within 3 inches of the mean ( 66–72 inches ) – one standard deviation – and almost all men (about 95%) have

5254-501: The standard deviation. However, in-sample measurements deliver values of the ratio of mean average deviation / standard deviation for a given Gaussian sample n with the following bounds: w n ∈ [ 0 , 1 ] {\displaystyle w_{n}\in [0,1]} , with a bias for small n . The mean absolute deviation from the mean is less than or equal to the standard deviation ; one way of proving this relies on Jensen's inequality . Jensen's inequality

5328-399: The tails diminish quickly enough. The Pareto distribution with parameter α ∈ ( 1 , 2 ] {\displaystyle \alpha \in (1,2]} has a mean, but not a standard deviation (loosely speaking, the standard deviation is infinite). The Cauchy distribution has neither a mean nor a standard deviation. In the case where X takes random values from

5402-420: The value of the mean deviation. For example, for the data set {2, 2, 3, 4, 14}: The mean absolute deviation (MAD), also referred to as the "mean deviation" or sometimes "average absolute deviation", is the mean of the data's absolute deviations around the data's mean: the average (absolute) distance from the mean. "Average absolute deviation" can refer to either this usage, or to the general form with respect to

5476-684: The values have different probabilities, let x 1 have probability p 1 , x 2 have probability p 2 , ..., x N have probability p N . In this case, the standard deviation will be σ = ∑ i = 1 N p i ( x i − μ ) 2 ,  where  μ = ∑ i = 1 N p i x i . {\displaystyle \sigma ={\sqrt {\sum _{i=1}^{N}p_{i}(x_{i}-\mu )^{2}}},{\text{ where }}\mu =\sum _{i=1}^{N}p_{i}x_{i}.} The standard deviation of

#226773