====== Chapter 1.7 - General Uncertainty Evaluation =====
===== Introduction =====
{{ general:uncertainty_evaluation:breaking_ice.png?nolink}}
Uncertainties are a key part of any emission inventory effort. Recording and assessing the inevitable errors made in estimating emissions allows for the inventory team to direct their attention as well as for the public and the scientific community to work with the results presented. Germany employs the statistical approaches as defined in the EMEP/EEA Guidebook to evaluate its inventory's uncertainties. The Guidebook offers two methods for the combination of individual source uncertainties to the level of categories and national totals, namely error propagation (EP, tier 1) and Monte Carlo simulation (MC, tier 2). Although Germany presents all results from both approaches here, the MC values are generally considered to represent the actual confidence interval more precisely.
An important aspect of an uncertainty analysis concerns the ways on how to express the uncertainties associated with individual estimates or the total inventory. It is recommended to use the same quantity to express uncertainty in a LRTAP Convention inventory as required in a greenhouse gas inventory, namely the 95% confidence interval. The confidence interval is specified by the confidence limits defined by the 2.5 percentile and 97.5 percentile of the cumulative distribution function of the estimated quantity, that means that there is a 95% probability that the actual value of the quantity estimated is within the interval defined by the confidence limits. For a normal distribution, the 95% confidence interval lies between ±2 standard deviations around the mean.
The data presented in this chapter are derived from the work of the emissions inventory experts contributing to the German emission inventory, who picked a confidence interval and a probability distribution function for each of the ~2,000 activity data and ~20,000 emission factor time series employed. In practice, every time series receives a metadata record in the database comprised of upper limit, lower limit and distribution function as well as an uncertainty information source reference (e.g. EEA/EMEP GB 2019, other literature or expert judgement). However, while uncertainties are currently considered separately for each individual time series, they remain static for each series across years. On this basis, the combination approaches described above are used to derive uncertainty information at the level of categories and national totals.
===== Uncertainty overview =====
Germany currently reports detailed uncertainty information for five pollutants: NOx, SO2, NMVOC, NH3 and PM2.5. While detailed spreadsheet tables are available for download below, the following table offers a quick overview and comparison per pollutants at the level of the national totals:
^ ^ Base year [kt] ^ 2020 [kt] ^ Trend [%] ^ Method ^ Base year uncertainty [%] |^ 2020 uncertainty [%] |^ Trend uncertainty [%] ||
^ NOx | 2,835 | 979 | -65.5 | EP | 27.7 || 18.5 || 11.7 ||
| |||| MC | -10.9 | +14.2 | -9.2 | +15.8 | -13.0 | +16.1 |
^ SO2 | 5,460 | 233 | -95.7 | EP | 8.7 || 8.1 || 1.5 ||
| |||| MC | -8.1 | +8.9 | -6.7 | +6.9 | -1.6 | +1.7 |
^ NMVOC | 3,892 | 1,036 | -73.4 | EP | 23.3 || 33.5 || 20.9 ||
| |||| MC | -14.5 | +23.1 | -15.9 | +31.3 | -20.4 | +29.0 |
^ NH3 | 718 | 537 | -25.2 | EP | 12.7 || 10.3 || 12.8 ||
| |||| MC | -10.1 | +11.7 | -9.4 | +9.7 | -102.3 | +107.8 |
^ PM2.5 | 202 | 81 | -59.9 | EP | 23.3 || 30.0 || 17.0 ||
| |||| MC | -10.9 | +13.0 | -17.1 | +19.6 | -14.3 | +16.5 |
===== Uncertainties per pollutant =====
The sections below detail pollutant specific uncertainty interpretations and show the values in the context of the pollutant's emissions and trends.
==== NOx ====
{{general:uncertainty_evaluation:nox.png?nolink}}
Compared to other pollutants, NOx emission uncertainties are moderate. The national total has a 95% confidence interval of about -9.2% to +15.8% in 2020, which amounts to about 250kt of NOx. Interestingly, with NOx, the differences between the two approaches in uncertainty combination (EP and MC) are particularly visible. This is because of the highest contributing sector [[sector:agriculture:agricultural_soils:start|3.D - Agricultural Soils]], where emissions and uncertainties are high (> +300%) and, crucially, do not follow a normal distribution. Therefore, only the MC simulation, which takes the log-normal distribution of these emissions into account, correctly reflects this source, while the EP yields unrealistic high uncertainties at about 18.5%.
Using the MC simulation, the top three contributors to the overall uncertainty are [[sector:agriculture:agricultural_soils:start|3.D.a.1 - Inorganic N-fertilizers]], [[sector:agriculture:agricultural_soils:start|3.D.a.2.a - Animal manure applied to soils]] and [[sector:agriculture:agricultural_soils:start|3.D.a.2.c - Other organic fertilisers applied to soils]]. [[sector:energy:fuel_combustion:transport:road_transport:emissions_from_fuel_combustion_in_road_vehicles:passenger_cars|1.A.3.b i - Road transport: Passenger cars]] and [[sector:energy:fuel_combustion:small_combustion:stationary_small_combustion:residential|1.A.4.b.i - Residential: Stationary]] are other important sector in regard to NOx overall uncertainties. Please refer to the {{general:uncertainty_evaluation:uncertainty_details_nox.xlsx | spreadsheet file}} for details.
==== SO2 ====
{{general:uncertainty_evaluation:so2.png?nolink}}
SO2 emissions are mainly emitted by stationary combustion plants. Since those are heavily regulated and fuel sulphur contents are generally well known, uncertainties in SO2 emissions are low. The national total has a 95% confidence interval of about -6.7% to +6.9% in 2020, which amounts to about 30kt of SO2. The top contributing sector to the SO2 uncertainties is [[sector:energy:fuel_combustion:energy_industries:public_electricity_and_heat_production|1.A.1.a - Public Electricity And Heat Production]], followed by a rather big margin by [[sector:energy:fuel_combustion:energy_industries:petroleum_refining|1.A.1.b - Petroleum Refining]], [[sector:energy:fuel_combustion:small_combustion:stationary_small_combustion:residential|1.A.4.b i - Residential: Stationary Combustion]], as well as [[sector:ippu:metal_production:iron_and_steel_production:start|2.C.1 - Iron and Steel Production]]. All data is available in the {{general:uncertainty_evaluation:uncertainty_details_so2.xlsx | spreadsheet file}}.
==== NMVOC ====
{{general:uncertainty_evaluation:nmvoc.png?nolink}}
NMVOC emissions and trends are driven by solvent use. While solvent contents of most products are well known, application context and use statistics introduce significant model error bars. Agriculture emissions of NMVOC are, while not very high in value, very uncertain and also contribute to the overall error margins. In sum, NMVOC emissions show moderate to high uncertainty. The national total has a 95% confidence interval of about -15.9% to +31.3% in 2020, which amounts to about 490kt of NMVOC. In order of significance, the top five contributors are [[sector:agriculture:manure_management:start|3.B - Manure Management - Dairy cattle]], [[sector:agriculture:manure_management:start|3.B.1.b Manure management - Non-dairy cattle]], [[sector:ippu:other_solvent_and_product_use:domestic_solvent_use:start|2.D.3.a - Domestic Solvent Use, including Fungicides]], [[sector:energy:fuel_combustion:small_combustion:stationary_small_combustion:residential|1.A.4.b.i - Residential: Stationary Combustion]] as well as [[sector:ippu:other_solvent_and_product_use:coating_applications:start|2.D.3.d - Coating Application]]. As with the other pollutants, details are to be found in the {{general:uncertainty_evaluation:uncertainty_details_nmvoc.xlsx | spreadsheet file}}.
==== NH3 ====
{{general:uncertainty_evaluation:nh3.png?nolink}}
Uncertainty in the NH3 emission national total is moderate and mainly caused by agriculture sources, in particular [[sector:agriculture:agricultural_soils:start|3.D.a.2.a - Animal manure applied to soils]]. [[sector:agriculture:manure_management:start|3.B.3 - Manure management - Swine]], [[sector:agriculture:manure_management:start|3.B - Manure Management - Dairy cattle]] and [[sector:agriculture:agricultural_soils:start|3.D.a.1 - Inorganic N-fertilizers]] do also play significant roles. The national total has a 95% confidence interval of about -9.4% to +9.7% in 2020, which amounts to about 100kt of NH3. You can drive your own analysis with the numbers found in the {{general:uncertainty_evaluation:uncertainty_details_nh3.xlsx | spreadsheet file}} attached.
==== PM2.5 ====
{{general:uncertainty_evaluation:pm25.png?nolink}}
PM2.5 emissions are associated with high uncertainties. The national total has a 95% confidence interval of about -17.1% to +19.6% in 2020, which amounts to about 30kt of PM2.5. Two sectors contribute the bulk of these errors: [[sector:energy:fuel_combustion:small_combustion:stationary_small_combustion:residential|1.A.4.b.i - Residential: Stationary Combustion]] and [[sector:ippu:bulk_products:handling_of_bulk_products:start|2.L - Other production, consumption, storage, transportation or handling of bulk products]]. Germany is also one of the few countries that reports abrasion under [[sector:energy:fuel_combustion:transport:railways:start|1.A.3.c - Transport: Railways]], adding noticeably to both emission values and uncertainties. Please refer to the {{general:uncertainty_evaluation:uncertainty_details_pm2.5.xlsx | spreadsheet file}} for details.
===== Other pollutants =====
There is currently no uncertainty assessment for additional air pollutants, heavy metals and POPs. Germany seeks to expand the list of pollutants covered as resources allow.