Chapter 1.6 - QA/QC and Verification Methods

The Quality System for Emission Inventories and it´s contribution to UNECE-CLRTAP reporting

The German Quality System for Emission Inventories (QSE) originally was designed to serve the purposes of emission reporting under the UN Framework Convention on Climate Change (UNFCCC). It takes account of provisions of the 2006 IPCC (Intergovernmental Panel on Climate Change) Guidelines - General Guidance and Reporting (GGR), of national circumstances in Germany and of the internal structures and procedures of the German Environment Agency (UBA), the reporting institution.
Thus it can be assumed that by adopting the IPCC Guidelines, the UNECE-CLRTAP seriously facilitated the task of developing a QC/QA-System for the reporting of air pollutants. It is likely that all QSE procedures are flexible enough to be able to routinely incorporate these demands in the future as well.
The QSE is designed to cover all participants of the National System on Emissions (NaSE) which are mostly identical to those responsible for the reporting of air pollutants. Within the German German Environment Agency, the appliance of the QSE and it’s procedures has been made mandatory for UNFCCC reporting by an internal directive (UBA-Hausanordnung 11/2005). The adoption of the QSE´s approach will be useful for CLRTAP-reporting too but its implications have to be considered carefully (mostly due to human resources), which is why the appliance of QSE procedures is partly outstanding. Currently few parts are used for reporting under CLRTAP, (see below, “Current State”).

The requirements pertaining to a system for quality control and quality assurance (QC/QA system) and to measures for quality control and quality assurance are defined primarily by Chapter 6 of the 2006 IPCC GL GGR.
From those provisions, the German Environment Agency derived “General requirements pertaining to quality control and quality assurance in connection with greenhouse-gas-emissions reporting”. It is assumed that these requirements completely apply for CLRTAP-reporting too. Therefore they are briefly given in the following to depict the necessary though partly outstanding trail of action for the development of a consistent QC/QA-System under UNECE-CLRTAP.

Main demands

The 2006 IPCC Guidelines require that QC/QA systems be introduced with the aim of enhancing transparency, consistency, comparability, completeness, accuracy and timeliness and, especially, that such inventories fulfill requirements pertaining to “good inventory practice”.

A QC/QA system comprises the following:

an agency responsible for coordinating QC/QA activities,

development and implementation of a QC/QA plan,

general QC procedures,

source-category-specific QC procedures,

QA procedures,

verification activities,

reporting procedures,

documentation and archiving procedures

Agency responsible for coordinating QC/QA activities

A Single National Entity (national coordinating agency) is responsible for the QC/QA system.

The German Single National Entity is established in the German Environment Agency (Umweltbundesamt - UBA). In executing its function, it is good practice to establish the position of a coordinator for the Quality System to be developed. A QC/QA coordinator has responsibility for ensuring that a relevant QC/QA system is developed and implemented. Such implementation should be suitably institutionalised – for example by means of an in-house directive or association agreements.

QC/QA plan

The purpose of a QC/QA plan is to ensure that QC/QA measures are properly organised and executed. It includes a description of all required QC/QA measures and a schedule for implementation of such measures. It also defines the primary emphasis of such measures.
Good practice calls for establishing a QC/QA plan and then reviewing and updating it each year after the latest inventory has been prepared. On the basis of the results of annual inventory review, the results of QC/QA measures and other informations of which it is aware, the Single National Entity aims to prepare an improvement plan for the entire inventory. On this basis, in turn, it will then derive proposals for a binding inventory plan for the next year to be reported.

General quality control

Pursuant to the definition used by the 2006 IPCC GL (Chapter 6.1 GGR), quality control (QC) comprises a system of routine specialised measures for measuring and checking the quality of inventories in preparation.
Requirements pertaining to general (formerly so called Tier-1) QC procedures can be derived from the requirements mentioned in Chapter 6.6, especially Table 6.1 which includes a complete list of general QC measures.
Required quality controls and their results should be recorded and not all quality controls have to be carried out on an annual basis. It should be ensured that all source categories undergo detailed quality control at least periodically.

Source-category-specific quality control

In addition to undergoing general procedures, particularly relevant source categories (such as key sources), available resources presupposed, should undergo category specific (formerly so called Tier 2) quality control with regard to determination of activity data, emissions and uncertainties (cf. Chapter 6.7; GGR).

The chapters of the 2006 IPCC GL that pertain to the various individual source categories (Vol 2-5) include additional information relative to source-category-specific QC measures. Such guidelines should be considered in preparation of a QC/QA plan.

Quality assurance procedures

While the primary aim of quality control is to ensure that methods are correctly applied, the primary purpose of quality assurance is to examine methods and data as such and improve or correct it as necessary.

Pursuant to the relevant IPCC definition (Chapter 6.1; GGR), measures for quality assurance (QA) are based “on a planned system of reviews by persons who are not directly involved in preparing the inventory. Such reviews – which are best carried out by independent third parties – should be applied to completed inventories, after QC procedures have been carried out.

The required instrument for quality assurance is the annual “basic” peer review, though additional audits on “strategic points of the inventory” should also be conducted.

Verification activities

According to the GGR-Chapter 6.10 “verification activities” refer to emission estimates only. Verification activities for emission factors and activity data are subsumed under the headword and chapter “quality control”, which is a somewhat confusing approach. Nevertheless, and by leaving this peculiarity aside, verification, next to QC, is undoubtedly one key to ensure confidence and reliability of the estimates, corresponding emission factors and activity data.

Reporting procedures

The Single National Entity is responsible for initiating, coordinating and globally organising reporting. Provision of data and reports by third parties must conform to applicable requirements pertaining to the scope, form and scheduling for such provision.

Documentation and Archiving

As a general requirement, all data and information used for inventory calculation must be documented (i.e. recorded) and archived, for each report year. The purpose of such documentation (i.e. recording) is to make it possible to completely reconstruct all emissions calculations. The general requirements pertaining to documentation and archiving for the entire process of of inventory preparation are described in Chapter 6.10.1 of the 2006 IPCC GL GGR.

Consequently, data providers have the obligation to keep records information relative to data they supply to the UBA for purposes of inventory calculations.
Information to be recorded by the institution supplying the pertinent data include:

the types of quality control,

the dates on which those measures were carried out,

the pertinent results,

and

the corrections and modifications triggered by quality control measures.

Providers of emissions calculations are obliged to record the calculation methods and the rationale for their appliance. Calculation models, -files and -software, as well as the assumptions and criteria for the appliance of activity data and emission factors and their references have to be archived.

Moreover, quality assurance (QA) and confidentiality issues for data secrecy have to be archived.

Current state

Information regarding the German Environment Agency's current organisational measures for implementing the requirements given above is provided in the following.

Structural organisation - Role concept

Within the QSE framework, a concept was developed that defines binding responsibilities inside the German Environment Agency for the implementation of the necessary QC and QA measures.

The purpose of defining roles and responsibilities is to facilitate the effective information exchange and the directive-conformal execution of QC and QA. The following roles are also used for reporting under CLRTAP (but are not yet established on a mandatory basis).

Specialised expert at the operational level (FV) source (NFR) specific expert tasks: compilation and entry (into the CSE) of activity data (AD)

Quality control manager (QKV) superior of the FV tasks: checking and approving of activity data

Specialized contact person (source-category specific, FAP) member of the Single National Entity tasks: checking of AD, compiling emission factors; data entry (into CSE) & calculation; preparation of texts; facilitation of specialised and technical support (inventory work and reporting).

Report co-ordinator (IIRK) member of the Single National Entity tasks: co-ordination of textual work; establishing the framework for preparation of the IIR from the various relevant contributors.

CSE co-ordinator (ZSEK) member of the Single National Entity tasks: ensuring database integrity; compliation of NFR tables and final emissions reporting.

NaSE co-ordinator (NaSEK) member of the Single National Entity tasks: co-ordination of reporting activities; final emissions reporting (upload of IIR & NFR tables to CDR).

Current workflow management

The workflow specified by the QSE is currently also used for activity data and additionally for emission factors in the agriculture sector (but not yet established on a mandatory basis).

Moreover, these parts of the adopted design are altered to serve the purposes of CLRTAP-reporting in the present state. For example, FV are currently responsible for compiling, entry (into the CSE data base) and,if necessary, the calculating of activity data but, in contrast to GHG reporting under UNFCCC, not for compiling of emission factors. Figure: QSE – Roles, responsibilities and workflow

General and category-specific quality control (QC)

As all activity data (except for the handling of bulk products) are also applied for UNFCCC-Reporting, the same general and category-specific quality control of the QSE is already in force for activity data within the UNECE reporting.

The quality of these activity data is supervised by the appliance of QC checks via special QSE checklists mandatory for all partcipants. The QSE checklists cover the set of general QC measures given in Table 6.1 of the 2006 IPCC GL GGR plus additional category-specific measures for key-category-specific quality control.

The QSE checklists are to be filled in annually throughout the whole inventory regardles if an specific NFR category is a key source for emissions and by FV, FAP, and QKV.

Quality assurance (QA)

Data, methods and estimates are generally derived by staff (FV) who are not member of the Single National Entity (see “Structural organisation - Role concept”). The quality-related activities to be performed by the FV are limited to quality control (QC).

QA tasks are to be performed by the following roles, starting with the QKV (internal QA). The tasks are given within the already mentioned consecutive and successive QSE checklists for FV, QKV and FAP relying on reviewing and checking of finalized estimates and data. Within these checklists, each role7participant has it's own set of QA checks.

The FAP, as a member of the Single National Entity, is the first role that is not directly involved in activity data preparation (external QA) so a “basic annual peer review” is conducted by the FAP. QA independence is guaranteed henceforward.

The QA checks are carried out annually and for the entire emissions inventory.

More intense peer reviews are undertaken whenever necessary and are performed by national experts and, in most cases, conducted by means of a national workshop.

As mentioned above, as all activity data (except for the handling of bulk products) are also applied for UNFCCC-Reporting, the same QA procedures are already in force for activity data within the UNECE reporting.