17.3. Statistical Uncertainties
Table of Contents
Counting statistics
In many ROOT analyses each bin of a histogram, or each event count in a region, represents a number of independent trials where an event either occurs or does not occur. In this situation the appropriate model is usually the Poisson distribution. If the expected mean number of events is $\mu$, then the probability to observe $n$ events is
$$
P(n \mid \mu) = \frac{\mu^n}{n!} e^{-\mu}.
$$
For Poisson statistics the variance of the observed count is equal to the mean:
$$
\mathrm{Var}(n) = \mu.
$$
When you measure $n$ events, your best estimate of the mean is $\hat{\mu} = n$, so the estimated variance and standard deviation of the count are
$$
\sigma_n^2 \approx n, \qquad \sigma_n \approx \sqrt{n}.
$$
For a simple event count with Poisson statistics, the statistical uncertainty on the count is
$$\Delta n = \sqrt{n}.$$
This rule is used everywhere in ROOT-based analyses. For example, the vertical error bar on a histogram bin content $N_{\text{bin}}$ is by default taken as $\sqrt{N_{\text{bin}}}$, if the histogram has been filled with unit weights.
When events are filled into a histogram with weights, for example using efficiency or luminosity weights, the situation changes. Let $w_i$ be the weight of the $i$-th event that falls into a particular bin, and let the bin content be
$$
B = \sum_{i=1}^{N} w_i.
$$
If the events are independent, the variance of the bin content is
$$
\sigma_B^2 = \sum_{i=1}^{N} w_i^2.
$$
In ROOT, when you call Sumw2() on a histogram before filling, the histogram stores this sum of squared weights and uses it to compute bin errors.
For a histogram with weights and Sumw2() enabled, the bin error is
$$\Delta B = \sqrt{\sum_{i} w_i^2}.$$
Without Sumw2(), ROOT assumes unit weights and sets $\Delta B = \sqrt{B}$.
For very small counts, such as $n = 0, 1, 2$, the approximation $\Delta n = \sqrt{n}$ becomes less accurate if you need precise confidence intervals. There are more refined formulas and tables for low-count Poisson uncertainties, but for many introductory analyses the $\sqrt{n}$ rule is sufficient.
When you add or subtract independent counts, their uncertainties combine accordingly. If you have two independent Poisson counts $n_1$ and $n_2$ with uncertainties $\sqrt{n_1}$ and $\sqrt{n_2}$, then for the sum $S = n_1 + n_2$,
$$
\sigma_S^2 = \sigma_{n_1}^2 + \sigma_{n_2}^2 = n_1 + n_2,
$$
so $\sigma_S = \sqrt{n_1 + n_2}$. For the difference $D = n_1 - n_2$ the same variance formula applies as long as the counts are independent:
$$
\sigma_D^2 = n_1 + n_2.
$$
These rules are built into ROOT operations on histograms. When you use methods like Add(), Add(h1,h2, a, b) or Divide(), ROOT automatically propagates the bin errors using the statistical formulas that correspond to independent quantities. This is one of the reasons to always let the histogram manage its errors correctly from the start.
Propagation of uncertainties
In a ROOT analysis you rarely use raw counts alone. You usually compute derived quantities, such as efficiencies, cross sections, normalized yields, ratios, and corrected measurements. Each of these quantities depends on one or more measured variables that have their own statistical uncertainties. To estimate the uncertainty on the derived quantity from the uncertainties of its inputs you use error propagation.
Suppose you have a quantity
$$
y = f(x_1, x_2, \dots, x_n),
$$
where each $x_i$ has an uncertainty $\sigma_{x_i}$. If the uncertainties are small and the $x_i$ are statistically independent, the variance of $y$ is approximated by
$$
\sigma_y^2 \approx \sum_{i=1}^{n} \left( \frac{\partial f}{\partial x_i} \right)^2 \sigma_{x_i}^2.
$$
For a function $y = f(x_1,\dots,x_n)$ of independent variables, the standard error propagation formula is
$$
\sigma_y^2 = \sum_{i}\left(\frac{\partial f}{\partial x_i}\right)^2 \sigma_{x_i}^2,
$$
with partial derivatives evaluated at the measured values.
This formula is the basis for almost all analytic uncertainty calculations in simple ROOT macros. Below are some very common special cases that appear frequently in analyses.
If you have a sum or difference
$$
y = x_1 \pm x_2,
$$
then
$$
\sigma_y^2 = \sigma_{x_1}^2 + \sigma_{x_2}^2.
$$
If you have a product or a ratio
$$
y = x_1 x_2 \quad \text{or} \quad y = \frac{x_1}{x_2},
$$
the relative uncertainties combine approximately as
$$
\left( \frac{\sigma_y}{y} \right)^2 = \left( \frac{\sigma_{x_1}}{x_1} \right)^2 + \left( \frac{\sigma_{x_2}}{x_2} \right)^2.
$$
A particularly important case is the efficiency or fraction
$$
\epsilon = \frac{N_{\text{pass}}}{N_{\text{total}}},
$$
where $N_{\text{pass}}$ events pass a selection out of $N_{\text{total}}$ total events. If each event either passes or fails, and events are independent, the number of passing events follows a binomial distribution. The binomial variance for $\epsilon$ is
$$
\sigma_\epsilon^2 = \frac{\epsilon (1 - \epsilon)}{N_{\text{total}}}.
$$
This result can also be derived from error propagation using $N_{\text{pass}}$ and $N_{\text{total}}$ and the binomial model. In ROOT, when you compute an efficiency with classes designed for that purpose, such as TEfficiency, this binomial uncertainty is what is usually used.
In many situations you need to propagate uncertainties numerically rather than analytically. For example, if $f$ is complicated or depends on the result of a ROOT fit, you can use the fit covariance matrix. If a fit returns parameters $p_i$ with covariance matrix elements $V_{ij}$, and you define
$$
y = g(p_1, p_2, \dots),
$$
the general propagation formula with correlations is
$$
\sigma_y^2 = \sum_{i,j} \frac{\partial g}{\partial p_i} \frac{\partial g}{\partial p_j} V_{ij}.
$$
ROOT stores this covariance matrix inside fit results and makes it accessible, so later chapters that work with fits use this formula implicitly when computing uncertainties on derived quantities.
Although systematic uncertainties are conceptually different from statistical ones, the same mathematical propagation rules apply to them. You usually evaluate how a given systematic effect shifts your result, interpret that shift as an uncertainty contribution, and combine several independent contributions in quadrature. The key distinction is that statistical uncertainties decrease when you collect more data, while systematic contributions usually do not.
In practice, when writing ROOT code for statistical uncertainties, you will often rely on ROOT to handle propagation when combining histograms or using built in classes for efficiencies and fits. Understanding the analytic formulas remains important, because it tells you when ROOT's default behavior is appropriate and when you must implement your own uncertainty calculations for specific derived quantities.
Views: 0
Where to Move
Move chapter:
- ☰ 1. Introduction to ROOT
- ☰ 1.1. What Is ROOT?
- ☰ 1.2. Installing ROOT
- ☰ 1.3. Starting ROOT
- ☰ 1.4. Your First ROOT Session
-
- ☰ 2. C++ Basics for ROOT
- ☰ 2.1. Why ROOT Uses C++
- ☰ 2.2. Variables and Data Types
- ☰ 2.3. Operators
- ☰ 2.4. Conditional Statements
- ☰ 2.5. Loops
- ☰ 2.6. Functions
- ☰ 2.7. Arrays and Vectors
-
- ☰ 3. ROOT Macros
- ☰ 3.1. What Is a ROOT Macro?
- ☰ 3.2. Running ROOT Macros
- ☰ 3.3. Functions Inside ROOT Macros
- ☰ 3.4. Compiling ROOT Macros
- ☰ 3.5. Organizing a ROOT Project
-
- ☰ 4. ROOT Objects and the ROOT Object Model
- ☰ 4.1. Introduction to ROOT Classes
- ☰ 4.2. Object Names and Titles
- ☰ 4.3. ROOT Collections
- ☰ 4.4. Inspecting ROOT Objects
-
- ☰ 5. Histograms
- ☰ 5.1. Introduction to Histograms
- ☰ 5.2. Creating a 1D Histogram
- ☰ 5.3. Filling Histograms
- ☰ 5.4. Drawing Histograms
- ☰ 5.5. Histogram Properties
- ☰ 5.6. Accessing Histogram Bins
- ☰ 5.7. Histogram Errors
- ☰ 5.8. Normalizing Histograms
- ☰ 5.9. Combining Histograms
-
- ☰ 6. Two-Dimensional Histograms
- ☰ 6.1. Creating 2D Histograms
- ☰ 6.2. Filling 2D Histograms
- ☰ 6.3. Drawing 2D Histograms
- ☰ 6.4. Projections
- ☰ 6.5. Profiles
-
- ☰ 7. Graphs
- ☰ 7.1. Introduction to TGraph
- ☰ 7.2. Creating a TGraph
- ☰ 7.3. Graph Styling
- ☰ 7.4. TGraphErrors
- ☰ 7.5. TGraphAsymmErrors
- ☰ 7.6. MultiGraph
-
- ☰ 8. Canvases and Plotting
- ☰ 8.1. TCanvas
- ☰ 8.2. Dividing a Canvas
- ☰ 8.3. Drawing Multiple Objects
- ☰ 8.4. Legends
- ☰ 8.5. Text and Annotations
- ☰ 8.6. Logarithmic Axes
- ☰ 8.7. Saving Plots
-
- ☰ 9. Styling ROOT Plots
- ☰ 9.1. ROOT Plot Styles
- ☰ 9.2. Axis Configuration
- ☰ 9.3. Line Styles
- ☰ 9.4. Marker Styles
- ☰ 9.5. Publication-Quality Figures
-
- ☰ 10. Mathematical Functions
- ☰ 10.1. Introduction to TF1
- ☰ 10.2. Built-in Functions
- ☰ 10.3. Custom Functions
- ☰ 10.4. Evaluating Functions
- ☰ 10.5. Function Integrals
-
- ☰ 11. Curve Fitting
- ☰ 11.1. Introduction to Fitting
- ☰ 11.2. Gaussian Fits
- ☰ 11.3. Polynomial Fits
- ☰ 11.4. Custom Fit Functions
- ☰ 11.5. Fit Parameters
- ☰ 11.6. Goodness of Fit
- ☰ 11.7. Fit Residuals
- ☰ 11.8. Fitting Graphs
-
- ☰ 12. ROOT Files
- ☰ 12.1. Introduction to ROOT Files
- ☰ 12.2. Creating ROOT Files
- ☰ 12.3. Writing Objects
- ☰ 12.4. Reading ROOT Files
- ☰ 12.5. Exploring ROOT Files
- ☰ 12.6. Directories Inside ROOT Files
-
- ☰ 13. TTrees
- ☰ 13.1. Introduction to TTrees
- ☰ 13.2. Creating a TTree
- ☰ 13.3. Filling a TTree
- ☰ 13.4. Writing a TTree to a File
- ☰ 13.5. Reading a TTree
- ☰ 13.6. Inspecting TTrees
- ☰ 13.7. Drawing Data from TTrees
- ☰ 13.8. Applying Selection Cuts
- ☰ 13.9. Branch Addresses
-
- ☰ 14. Event-Based Data Analysis
- ☰ 14.1. Understanding Event Data
- ☰ 14.2. Event Loops
- ☰ 14.3. Event Selection
- ☰ 14.4. Derived Quantities
- ☰ 14.5. Analysis Workflow
-
- ☰ 15. Working with Real Experimental Data
- ☰ 15.1. Importing Text Data
- ☰ 15.2. Converting Data to ROOT
- ☰ 15.3. Data Cleaning
- ☰ 15.4. Data Calibration
- ☰ 15.5. Signal and Background
-
- ☰ 16. Random Numbers and Simulations
- ☰ 16.1. Random Number Generation
- ☰ 16.2. Common Distributions
- ☰ 16.3. Simple Monte Carlo Simulation
- ☰ 16.4. Detector Resolution Simulation
- ☰ 16.5. Efficiency Simulation
-
- ☰ 17. Statistical Analysis with ROOT
- ☰ 17.1. Basic Statistics
- ☰ 17.2. Probability Distributions
- ☰ 17.3. Statistical Uncertainties
- ☰ 17.4. Chi-Square Tests
- ☰ 17.5. Confidence Intervals
-
- ☰ 18. Modern ROOT with RDataFrame
- ☰ 18.1. Introduction to RDataFrame
- ☰ 18.2. Loading Data
- ☰ 18.3. Filtering Data
- ☰ 18.4. Defining New Columns
- ☰ 18.5. Creating Histograms
- ☰ 18.6. Statistical Operations
- ☰ 18.7. Saving Results
- ☰ 18.8. Multithreading
-
- ☰ 19. ROOT and Python
- ☰ 19.1. Introduction to PyROOT
- ☰ 19.2. ROOT Objects in Python
- ☰ 19.3. Reading ROOT Files with Python
- ☰ 19.4. PyROOT and NumPy
- ☰ 19.5. PyROOT and Matplotlib
- ☰ 19.6. Choosing Between C++ and Python
-
- ☰ 20. Advanced TTree Techniques
- ☰ 20.1. Trees with Multiple Branches
- ☰ 20.2. Storing std::vector Objects
- ☰ 20.3. TChain
- ☰ 20.4. Friends
- ☰ 20.5. Efficient TTree Analysis
-
- ☰ 21. ROOT for Particle and Nuclear Physics
- ☰ 21.1. Four-Vectors
- ☰ 21.2. Particle Kinematics
- ☰ 21.3. Invariant Mass
- ☰ 21.4. Angular Distributions
- ☰ 21.5. Detector Spectra
-
- ☰ 22. Debugging and Common ROOT Problems
- ☰ 22.1. ROOT Object Ownership
- ☰ 22.2. Null Pointers
- ☰ 22.3. Segmentation Faults
- ☰ 22.4. Missing Histograms
- ☰ 22.5. ROOT File Problems
- ☰ 22.6. TTree Branch Problems
- ☰ 22.7. Histogram Range Problems
- ☰ 22.8. Fit Failures
- ☰ 22.9. Debugging ROOT Macros
-
- ☰ 23. Writing Better ROOT Analysis Code
- ☰ 23.1. Separating Analysis and Plotting
- ☰ 23.2. Using Functions
- ☰ 23.3. Using Header Files
- ☰ 23.4. Naming Conventions
- ☰ 23.5. Avoiding Hard-Coded Values
- ☰ 23.6. Configuration Parameters
- ☰ 23.7. Reproducible Analysis
- ☰ 23.8. Version Control with Git
-
- ☰ 24. Final Project
- ☰ 24.1. Project Overview
- ☰ 24.2. Analyze a complete scientific dataset using ROOT.
- ☰ 24.3. Import the Data
- ☰ 24.4. Explore the Dataset
- ☰ 24.5. Apply Data Selection
- ☰ 24.6. Create Histograms
- ☰ 24.7. Fit the Data
- ☰ 24.8. Calculate Physical Quantities
- ☰ 24.9. Estimate Statistical Uncertainties
- ☰ 24.10. Create Publication-Quality Figures
- ☰ 24.11. Save the Analysis Results
- ☰ 24.12. Write a Short Analysis Report
-
- ☰ 25. Appendices
- ☰ 25.1. A. ROOT Command Cheat Sheet
- ☰ 25.2. B. ROOT Histogram Classes
- ☰ 25.3. C. ROOT Graph Classes
- ☰ 25.4. D. Common TTree Commands
- ☰ 25.5. E. Common Drawing Options
- ☰ 25.6. F. Common Fit Functions
- ☰ 25.7. G. ROOT C++ Cheat Sheet
- ☰ 25.8. H. PyROOT Cheat Sheet
- ☰ 25.9. I. Common ROOT Errors and Solutions
- ☰ 25.10. J. Recommended ROOT Analysis Workflow
-
Comments
Please login to add a comment.
Don't have an account? Register now!