Box plot: Difference between revisions

Revision as of 21:40, 14 August 2023

Latest revision as of 09:09, 23 July 2025

(48 intermediate revisions by 24 users not shown)

Line 1:

{{short description|Data visualization}}

[[File:Michelsonmorley-boxplot.svg|thumb|upright=1.535|Figure 1. Box plot of data from the [[Michelson–Morley experiment#Michelson experiment (1881)|Michelson experiment]]]]

In [[descriptive statistics]], a '''box plot''' or '''boxplot''' is a method for graphically demonstrating graphically the locality, spread and skewness groups of numerical data through their [[quartile]]s.<ref>{{Cite book|last=C.|first=Dutoit, S. H.|url=http://worldcat.org/oclc/1019645745|title=Graphical exploratory data analysis.|date=2012|publisher=Springer|isbn=978-1-4612-9371-2|oclc=1019645745}}</ref>

In addition to the box on a box plot, there can be lines (which are called ''whiskers'') extending from the box indicating variability outside the upper and lower quartiles, thus, the plot is also called the '''box-and-whisker plot''' and the '''box-and-whisker diagram'''. [[Outlier]]s that differ significantly from the rest of the dataset<ref>{{Cite journal|last=Grubbs|first=Frank E.|date=February 1969|title=Procedures for Detecting Outlying Observations in Samples|url=http://dx.doi.org/10.1080/00401706.1969.10490657|journal=Technometrics|volume=11|issue=1|pages=1–21|doi=10.1080/00401706.1969.10490657|issn=0040-1706|url-access=subscription}}</ref> may be plotted as individual points beyond the whiskers on the box-plot. Box plots are [[non-parametric]]: they display variation in samples of a [[statistical population]] without making any assumptions of the underlying [[probability distribution|statistical distribution]]<ref>{{Cite book|last=Richard.|first=Boddy|url=http://worldcat.org/oclc/940679163|title=Statistical Methods in Practice : for Scientists and Technologists.|date=2009|publisher=John Wiley & Sons|isbn=978-0-470-74664-6|oclc=940679163}}</ref> (though Tukey's boxplot assumes symmetry for the whiskers and normality for their length).

Box plots are [[non-parametric]]: they display variation in samples of a [[statistical population]] without making any assumptions of the underlying [[probability distribution|statistical distribution]]<ref>{{Cite book|last=Richard.|first=Boddy|url=http://worldcat.org/oclc/940679163|title=Statistical Methods in Practice : for Scientists and Technologists.|date=2009|publisher=John Wiley & Sons|isbn=978-0-470-74664-6|oclc=940679163}}</ref> (though Tukey's boxplot assumes symmetry for the whiskers and normality for their length). The spacings in each subsection of the box-plot indicate the degree of [[statistical dispersion|dispersion]] (spread) and [[skewness]] of the data, which are usually described using the [[five-number summary]]. In addition, the box-plot allows one to visually estimate various [[L-estimator]]s, notably the [[interquartile range]], [[midhinge]], [[range (statistics)|range]], [[mid-range]], and [[trimean]]. Box plots can be drawn either horizontally or vertically.

== History ==

The range-bar method was first introduced by [[Mary Eleanor Spear]] in her book "Charting Statistics" in 1952<ref>{{Cite book|title=Charting Statistics|last=Spear|first=Mary Eleanor|publisher=McGraw Hill|year=19522024


|pages=166}}</ref> and again in her book "Practical Charting Techniques" in 1969.<ref>{{Cite book|title=Practical charting techniques|last=Spear, Mary Eleanor.|date=1969|publisher=McGraw-Hill|isbn=0070600104|___location=New York|oclc=924909765}}</ref> The box-and-whisker plot was first introduced in 1970 by [[John Tukey]], who later published on the subject in his book "Exploratory Data Analysis" in 1977.<ref name=":0">{{cite web |first1=Hadley |last1=Wickham |first2=Lisa |last2=Stryjewski |url=https://vita.had.co.nz/papers/boxplots.pdf |title=40 years of boxplots |access-date=December 24, 2020}}</ref>

==Elements==

[[File:Box-Plot mit Min-Max Abstand.png|thumb|Figure 2. Box-plot with whiskers from minimum to maximum]]

[[File:Box-Plot mit Interquartilsabstand.png|thumb|FigureThe 3. Samesame box-plot with whiskers drawn within the 1.5 IQR value]]

A boxplot is a standardized way of displaying the dataset based on the [[five-number summary]]: the minimum, the maximum, the sample median, and the first and third quartiles.

Line 18 ⟶ 24:

* '''[[Median]] (''Q''₂ or 50th percentile)''': the middle value in the data set

* '''[[First quartile]] (''Q''₁ or 25th percentile)''': also known as the ''lower quartile'' ''q''_''n''(0.25), it is the median of the lower half of the dataset.

* '''[[Third quartile]] (''Q''₃ or 75th percentile)''': also known as the ''upper quartile'' ''q''_''n''(0.75), it is the median of the upper half of the dataset.<ref>{{cite journal |last1=Holmes |first1=Alexander |last2=Illowsky |first2=Barbara |last3=Dean |first3=Susan |title=Introductory Business Statistics |website=OpenStax |date=31 March 2015 |url=https://opentextbc.ca/introbusinessstatopenstax/chapter/measures-of-the-___location-of-the-data/ |access-date=29 April 2020 |archive-date=27 July 2020 |archive-url=https://web.archive.org/web/20200727025431/https://opentextbc.ca/introbusinessstatopenstax/chapter/measures-of-the-___location-of-the-data/ |url-status=dead }}</ref>

In addition to the minimum and maximum values used to construct a box-plot, another important element that can also be employed to obtain a box-plot is the interquartile range (IQR), as denoted below:

* '''[[Interquartile range]] (IQR)''' : the distance between the upper and lower quartiles

:: <math>\text{IQR} = Q_3 - Q_1 = q_n(0.75) - q_n(0.25)</math>

A box-plot usually includes two parts, a box and a set of whiskers.

===Whiskers===

A box-plot usually includes two parts, a box and a set of whiskers as shown in Figure 2. The box is drawn from ''Q''₁ to ''Q''₃ with a horizontal line drawn in the middle to denote the median. The whiskers must end at an observed data point, but can be defined in various ways.

===Box===

In the most straight-forward method, the boundary of the lower whisker is the minimum value of the data set, and the boundary of the upper whisker is the maximum value of the data set.

The box is drawn from ''Q''₁ to ''Q''₃ with a horizontal line drawn inside it to denote the median. Some box plots include an additional character to represent the mean of the data.<ref name="frigge hoaglin iglewicz2">{{Cite journal|last1=Frigge|first1=Michael|last2=Hoaglin|first2=David C.|last3=Iglewicz|first3=Boris|date=February 1989|title=Some Implementations of the Boxplot|journal=[[The American Statistician]]|volume=43|issue=1|pages=50–54|doi=10.2307/2685173|jstor=2685173}}</ref><ref>{{cite journal|last1=Marmolejo-Ramos|first1=F.|last2=Tian|first2=S.|date=2010|title=The shifting boxplot. A boxplot based on essential summary statistics around the mean|journal=International Journal of Psychological Research|volume=3|issue=1|pages=37–46|doi=10.21500/20112084.823|doi-access=free|hdl=10819/6492|hdl-access=free}}</ref>

===Whiskers===

Another popular choice for the boundaries of the whiskers is based on the 1.5 IQR value. From above the upper quartile ('''''Q''₃'''), a distance of 1.5 times the IQR is measured out and a whisker is drawn ''up to'' the largest observed data point from the dataset that falls within this distance. Similarly, a distance of 1.5 times the IQR is measured out below the lower quartile ('''''Q''₁''') and a whisker is drawn ''down to'' the lowest observed data point from the dataset that falls within this distance. Because the whiskers must end at an observed data point, the whisker lengths can look unequal, even though 1.5 IQR is the same for both sides. All other observed data points outside the boundary of the whiskers are plotted as '''outliers'''.<ref>{{Cite book |title=A Modern Introduction to Probability and Statistics |url=https://archive.org/details/modernintroducti00dekk_722 |url-access=limited |last=Dekking |first=F.M. |publisher=Springer |year=2005 |isbn=1-85233-896-2 |pages=[https://archive.org/details/modernintroducti00dekk_722/page/n240 234]–238 }}</ref> The outliers can be plotted on the box-plot as a dot, a small circle, a star, ''etc.'' (see example below).

The whiskers must end at an observed data point, but can be defined in various ways. In the most straightforward method, the boundary of the lower whisker is the minimum value of the data set, and the boundary of the upper whisker is the maximum value of the data set. Because of this variability, it is appropriate to describe the convention that is being used for the whiskers and outliers in the caption of the box-plot.

Another popular choice for the boundaries of the whiskers is based on the 1.5 IQR value. From above the upper quartile ('''''Q''₃'''), a distance of 1.5 times the IQR is measured out and a whisker is drawn ''up to'' the largest observed data point from the dataset that falls within this distance. Similarly, a distance of 1.5 times the IQR is measured out below the lower quartile ('''''Q''₁''') and a whisker is drawn ''down to'' the lowest observed data point from the dataset that falls within this distance. Because the whiskers must end at an observed data point, the whisker lengths can look unequal, even though 1.5 IQR is the same for both sides. All other observed data points outside the boundary of the whiskers are plotted as '''outliers'''.<ref>{{Cite book |title=A Modern Introduction to Probability and Statistics |url=https://archive.org/details/modernintroducti00dekk_722 |url-access=limited |last=Dekking |first=F.M. |publisher=Springer |year=2005 |isbn=1-85233-896-2 |pages=[https://archive.org/details/modernintroducti00dekk_722/page/n240 234]–238 }}</ref> The outliers can be plotted on the box-plot as a dot, a small circle, a star, ''etc.'' (see example below).

[[File:Box Plot Picture.png|thumb|A box plot representing data]]

There are other representations in which the whiskers can stand for several other things, such as:

* The minimum and the maximum value of the data set (as shown in Figure 2)

* One [[standard deviation]] above and below the mean of the data set

* The 9th percentile and the 91st percentile of the data set

* The 2nd percentile and the 98th percentile of the data set

Rarely, box-plot can be plotted without the whiskers. This can be appropriate for sensitive information to avoid whiskers (and outliers) disclosing actual values observed.<ref name="DGRW">{{Cite journalbook|last1=Derrick|first1=Ben|last2=Green|first2=Elizabeth|last3=Ritchie|first3=Felix|last4=White|first4=Paul|date=September 2022|titlechapter=The Risk of Disclosure When Reporting Commonly Used Univariate Statistics|journaltitle=Privacy in Statistical Databases|series=Lecture Notes in Computer Science |volume=13463|pages=119–129|doi=10.1007/978-3-031-13945-1_9|isbn=978-3-031-13944-4 }}</ref>

Some box plots include an additional character to represent the mean of the data.<ref name="frigge hoaglin iglewicz2">{{Cite journal|last1=Frigge|first1=Michael|last2=Hoaglin|first2=David C.|last3=Iglewicz|first3=Boris|date=February 1989|title=Some Implementations of the Boxplot|journal=[[The American Statistician]]|volume=43|issue=1|pages=50–54|doi=10.2307/2685173|jstor=2685173}}</ref><ref>{{cite journal|last1=Marmolejo-Ramos|first1=F.|last2=Tian|first2=S.|date=2010|title=The shifting boxplot. A boxplot based on essential summary statistics around the mean|journal=International Journal of Psychological Research|volume=3|issue=1|pages=37–46|doi=10.21500/20112084.823|doi-access=free}}</ref>

The unusual percentiles 2%, 9%, 91%, 98% are sometimes used for whisker cross-hatches and whisker ends to depict the [[seven-number summary]]. If the data are [[Normal distribution|normally distributed]], the locations of the seven marks on the box plot will be equally spaced. On some box plots, a cross-hatch is placed before the end of each whisker.

Because of this variability, it is appropriate to describe the convention that is being used for the whiskers and outliers in the caption of the box-plot.

==Variations==

[[File:Fourboxplots.svg|thumb|Figure&nbsp;4upright=1. 3|Four box plots, with and without notches and variable width]]

Since the mathematician [[John W. Tukey]] first popularized this type of visual data display in 1969, several variations on the classical box plot have been developed, and the two most commonly found variations are the variable -width box plots and the notched box plots shown in Figure 4.

'''Variable -width box''' plots illustrate the size of each group whose data is being plotted by making the width of the box proportional to the size of the group. A popular convention is to make the box width proportional to the square root of the size of the group.<ref name="mcgill tukey larsen">{{Cite journal|last1=McGill|first1=Robert|last2=Tukey|first2=John W.|author2-link=John W. Tukey|last3=Larsen|first3=Wayne A.|date=February 1978|title=Variations of Box Plots|journal=[[The American Statistician]]|volume=32|issue=1|pages=12–16|doi=10.2307/2683468|jstor=2683468}}</ref>

'''Notched box''' plots apply a "notch" or narrowing of the box around the median. Notches are useful in offering a rough guide of the significance of the difference of medians; if the notches of two boxes do not overlap, this will provide evidence of a statistically significant difference between the medians.<ref name="mcgill tukey larsen" /> The height of the notches is proportional to the interquartile range (IQR) of the sample and is inversely proportional to the square root of the size of the sample. However, there is aan uncertainty about the most appropriate multiplier (as this may vary depending on the similarity of the variances of the samples).<ref name="mcgill tukey larsen" /> The width of the notch is arbitrarily chosen to be visually pleasing, and should be consistent amongst all box plots being displayed on the same page.

One convention for obtaining the boundaries of these notches is to use a distance of <math alt="±1.58×IQR/sqrt(n)">\pm \frac{1.58 \text{ IQR}}{\sqrt n}</math> around the median.<ref name="Rboxplotstats">{{Cite web | title = R: Box Plot Statistics | work = R manual | url = http://stat.ethz.ch/R-manual/R-devel/library/grDevices/html/boxplot.stats.html | access-date = 26 June 2011}}</ref>

Line 82 ⟶ 86:

=== Example without outliers ===

[[File:No Outlier.png|thumb|Figure 5. The generatedA boxplot figure of the example on the left with no outliers.]]

A series of hourly temperatures were measured throughout the day in degrees Fahrenheit. The recorded values are listed in order as follows (°F): 57, 57, 57, 58, 63, 66, 66, 67, 67, 68, 69, 70, 70, 70, 70, 72, 73, 75, 75, 76, 76, 78, 79, 81.

A box plot of the data set can be generated by first calculating five relevant values of this data set: minimum, maximum, median ('''''Q''₂'''), first quartile ('''''Q''₁'''), and third quartile ('''''Q''₃''').

The minimum is the smallest number of the data set. In this case, the minimum recorded day temperature is 57 °F.

The maximum is the largest number of the data set. In this case, the maximum recorded day temperature is 81 °F.

The median is the "middle" number of the ordered data set. This means that there are exactly 50% of the elements isare less thanbelow the median and 50% of the elements isare greater than the median. The median of this ordered data set is 70 °F.

The first quartile value ('''''Q''₁''' '''or 25th percentile)''' is the number that marks one quarter of the ordered data set. In other words, there are exactly 25% of the elements that are less than the first quartile and exactly 75% of the elements that are greater than it. The first quartile value can be easily determined by finding the "middle" number between the minimum and the median. For the hourly temperatures, the "middle" number found between 57 °F and 70 °F is 66 °F.

The third quartile value ('''''Q''₃''' '''or 75th percentile)''' is the number that marks three quarters of the ordered data set. In other words, there are exactly 75% of the elements that are less than the third quartile and 25% of the elements that are greater than it. The third quartile value can be easily obtained by finding the "middle" number between the median and the maximum. For the hourly temperatures, the "middle" number between 70 °F and 81 °F is 75 °F.

The interquartile range, or IQR, can be calculated by subtracting the first quartile value ('''''Q''₁''') from the third quartile value ('''''Q''₃'''):

Line 111 ⟶ 115:

: <math>Q_1-1.5\text{ IQR}=66^\circ F-13.5^\circ F=52.5^\circ F.</math>

The upper whisker boundary of the box-plot is the largest data value that is within 1.5 IQR above the third quartile. Here, 1.5 IQR above the third quartile is 88.5 °F and the maximum is 81 °F. Therefore, the upper whisker is drawn at the value of the maximum, which is 81 °F.

Similarly, the lower whisker boundary of the box plot is the smallest data value that is within 1.5 IQR below the first quartile. Here, 1.5 IQR below the first quartile is 52.5 °F and the minimum is 57 °F. Therefore, the lower whisker is drawn at the value of the minimum, which is 57 °F.

=== Example with outliers ===

[[File:Boxplot with outlier.png|thumb|FigureA 6.box The generated boxplot of the example on the leftplot with outliers.]]

Above is an example without outliers. Here is a followupfollow-up example for generating box-plot with outliers:

The ordered set for the recorded temperatures is (°F): 52, 57, 57, 58, 63, 66, 66, 67, 67, 68, 69, 70, 70, 70, 70, 72, 73, 75, 75, 76, 76, 78, 79, 89.

Line 123 ⟶ 127:

In this example, only the first and the last number are changed. The median, third quartile, and first quartile remain the same.

In this case, the maximum value in this data set is 89 °F, and 1.5 IQR above the third quartile is 88.5 °F. The maximum is greater than 1.5 IQR plus the third quartile, so the maximum is an outlier. Therefore, the upper whisker is drawn at the greatest value smaller than 1.5 IQR above the third quartile, which is 79 °F.

Similarly, the minimum value in this data set is 52 °F, and 1.5 IQR below the first quartile is 52.5 °F. The minimum is smaller than 1.5 IQR minus the first quartile, so the minimum is also an outlier. Therefore, the lower whisker is drawn at the smallest value greater than 1.5 IQR below the first quartile, which is 57 °F.

=== In the case of large datasets ===

An additional example for obtaining box-plot from a data set containing a large number of data points is:

==== General equation to compute empirical quantiles ====

Line 139 ⟶ 143:

Using the above example that has 24 data points (''n'' = 24), one can calculate the median, first and third quartile either mathematically or visually.

'''Median'''
: <math>
\begin{align}
q_n(0.5) & = x_{(12)} + (0.5\cdot25-12)\cdot(x_{(13)}-x_{(12)}) \\[5pt]

& = 70+(0.5\cdot25-12)\cdot(70-70) = 70^\circ \text{F</math>}

\end{align}

</math>

'''First quartile'''
: <math>
\begin{align}
q_n(0.25) & = x_{(6)} + (0.25\cdot25-6)\cdot(x_{(7)}-x_{(6)}) \\[5pt]

& = 66 +(0.25\cdot25 - 6)\cdot(66-66) = 66^\circ \text{F</math>}

\end{align}

</math>

'''Third quartile'''
: <math>
\begin{align}
q_n(0.75) & = x_{(18)} + (0.75\cdot25-18)\cdot(x_{(19)}-x_{(18)}) \\[5pt]

& =75 + (0.75\cdot25-18)\cdot(75-75) = 75^\circ \text{F</math>}

\end{align}

</math>

== Visualization ==

[[File:Boxplot vs PDF.svg|thumb|upright=1.2|Figure 7. Box-plot and a [[probability density function]] (pdf) of a Normal N(0,1σ²) Population]]

[[File:Boxplots with skewness.png|thumb|Figure 8. Box-plots displaying the skewness of the data set]]

Although box plots may seem more primitive than [[histogram|histograms]]s or [[kernel density estimation|kernel density estimates]], they do have a number of advantages. First, the box plot enables statisticians to do a quick graphical examination on one or more data sets. Box-plots also take up less space and are therefore particularly useful for comparing distributions between several groups or sets of data in parallel (see Figure 1 for an example). Lastly, the overall structure of histograms and kernel density estimate can be strongly influenced by the choice of [[Histogram#Number of bins and width|number and width of bins]] techniques and the choice of bandwidth, respectively.

Although looking at a statistical distribution is more common than looking at a box plot, it can be useful to compare the box plot against the probability density function (theoretical histogram) for a normal N(0,''σ''²) distribution and observe their characteristics directly (as shown in Figure 7).

[[File:Boxplots with skewness.png|thumb|Figure 8. Box-plots displaying the skewness of the data set]]

{{clear}}

Line 161 ⟶ 180:

* [[Bagplot]]

* [[Contour boxplot]]

* [[Candlestick chart]]

* [[Data and information visualization]]

* [[Exploratory data analysis]]

Line 167 ⟶ 185:

* [[Five-number summary]]

* [[Functional boxplot]]

* [[Seasonality]]

* [[Seven-number summary]]

* [[Sina plot]]

* [[Violin plot]]