meta data for this page
  •  

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
general:quality_verification:start [2021/01/27 09:08] – schillergeneral:quality_verification:start [2021/12/15 20:00] (current) – external edit 127.0.0.1
Line 1: Line 1:
 ====== Chapter 1.6 - QA/QC and Verification Methods ====== ====== Chapter 1.6 - QA/QC and Verification Methods ======
 +{{  :general:quality_verification:qaqc1.png?nolink&400}}
 ===== The Quality System for Emission Inventories and it´s contribution to UNECE-CLRTAP reporting ===== ===== The Quality System for Emission Inventories and it´s contribution to UNECE-CLRTAP reporting =====
 The German Quality System for Emission Inventories (QSE) originally was designed to serve the purposes of emission reporting under the UN Framework Convention on Climate Change (UNFCCC). It takes account of provisions of the 2006 IPCC (Intergovernmental Panel on Climate Change) Guidelines - General Guidance and Reporting (GGR), of national circumstances in Germany and of the internal structures and procedures of the German Environment Agency (UBA), the reporting institution.\\ The German Quality System for Emission Inventories (QSE) originally was designed to serve the purposes of emission reporting under the UN Framework Convention on Climate Change (UNFCCC). It takes account of provisions of the 2006 IPCC (Intergovernmental Panel on Climate Change) Guidelines - General Guidance and Reporting (GGR), of national circumstances in Germany and of the internal structures and procedures of the German Environment Agency (UBA), the reporting institution.\\
Line 12: Line 12:
 The 2006 IPCC Guidelines require that QC/QA systems be introduced with the aim of enhancing transparency, consistency, comparability, completeness, accuracy and timeliness and, especially, that such inventories fulfill requirements pertaining to "good inventory practice". A QC/QA system comprises the following: The 2006 IPCC Guidelines require that QC/QA systems be introduced with the aim of enhancing transparency, consistency, comparability, completeness, accuracy and timeliness and, especially, that such inventories fulfill requirements pertaining to "good inventory practice". A QC/QA system comprises the following:
  
-^ • An agency responsible for coordinating QC/QA activities\\ • Development and implementation of a QC/QA plan\\ • General QC procedures\\ • Source-category-specific QC procedures\\ • QA procedures\\ • Verification activities\\ • Reporting procedures\\ • Documentation and archiving procedures  ^+ • An agency responsible for coordinating QC/QA activities\\ • Development and implementation of a QC/QA plan\\ • General QC procedures\\ • Source-category-specific QC procedures\\ • QA procedures\\ • Verification activities\\ • Reporting procedures\\ • Documentation and archiving procedures  
  
-=== Agency responsible for coordinating QC/QA activities ===+==== Agency responsible for coordinating QC/QA activities ====
 A Single National Entity (national coordinating agency), is responsible for the QC/QA system. The German Single National Entity is established in the German Environment Agency (UBA). In executing its function, it is good practice to establish the position of a coordinator for the Quality System to be developed. A QC/QA coordinator has responsibility for ensuring that a relevant QC/QA system is developed and implemented. Such implementation should be suitably institutionalised – for example, by means of an in-house directive or association agreement. A Single National Entity (national coordinating agency), is responsible for the QC/QA system. The German Single National Entity is established in the German Environment Agency (UBA). In executing its function, it is good practice to establish the position of a coordinator for the Quality System to be developed. A QC/QA coordinator has responsibility for ensuring that a relevant QC/QA system is developed and implemented. Such implementation should be suitably institutionalised – for example, by means of an in-house directive or association agreement.
  
-=== QC/QA plan === +==== QC/QA plan ==== 
-The purpose of a QC/QA plan is to ensure that QC/QA measures are properly organised and executed. It includes a description of all required QC/QA measures and a schedule for implementation of such measures. It also defines the primary emphasis of such measures.+The purpose of a QC/QA plan is to ensure that QC/QA measures are properly organised and executed. It includes a description of all required QC/QA measures and a schedule for implementation of such measures. It also defines the primary emphasis of such measures.\\
 Good practice calls for establishing a QC/QA plan and then reviewing and updating it each year after the latest inventory has been prepared. Good practice calls for establishing a QC/QA plan and then reviewing and updating it each year after the latest inventory has been prepared.
 On the basis of the results of annual inventory review, the results of QC/QA measures and other informations of which it is aware, the Single National Entity aims to prepare an improvement plan for the entire inventory. On this basis, in turn, it will then derive proposals for a binding inventory plan for the next year to be reported. On the basis of the results of annual inventory review, the results of QC/QA measures and other informations of which it is aware, the Single National Entity aims to prepare an improvement plan for the entire inventory. On this basis, in turn, it will then derive proposals for a binding inventory plan for the next year to be reported.
  
-=== General quality control === +==== General quality control ==== 
-Pursuant to the definition used by the 2006 IPCC GL (Chapter 6.1 GGR), quality control (QC) comprises a system of routine specialised measures for measuring and checking the quality of inventories in preparation. +Pursuant to the definition used by the 2006 IPCC GL (Chapter 6.1 GGR), quality control (QC) comprises a system of routine specialised measures for measuring and checking the quality of inventories in preparation.\\ 
-Requirements pertaining to general (formerly so called Tier-1) QC procedures can be derived from the requirements mentioned in Chapter 6.6, especially Table 6.1 which includes a complete list of general QC measures.+Requirements pertaining to general (formerly so called Tier-1) QC procedures can be derived from the requirements mentioned in Chapter 6.6, especially Table 6.1 which includes a complete list of general QC measures.\\
 Required quality controls and their results should be recorded and not all quality controls have to be carried out on an annual basis. It should be ensured that all source categories undergo detailed quality control at least periodically. Required quality controls and their results should be recorded and not all quality controls have to be carried out on an annual basis. It should be ensured that all source categories undergo detailed quality control at least periodically.
  
-=== Source-category-specific quality control ===+==== Source-category-specific quality control ====
 In addition to undergoing general procedures, particularly relevant source categories (such as key sources), available resources presupposed, should undergo category specific (formerly so called Tier 2) quality control with regard to determination of activity rates, emissions and uncertainties (cf. Chapter 6.7; GGR). The chapters of the 2006 IPCC GL that pertain to the various individual source categories (Vol 2-5) include additional information relative to source-category-specific QC measures. Such guidelines should be considered in preparation of a QC/QA plan. In addition to undergoing general procedures, particularly relevant source categories (such as key sources), available resources presupposed, should undergo category specific (formerly so called Tier 2) quality control with regard to determination of activity rates, emissions and uncertainties (cf. Chapter 6.7; GGR). The chapters of the 2006 IPCC GL that pertain to the various individual source categories (Vol 2-5) include additional information relative to source-category-specific QC measures. Such guidelines should be considered in preparation of a QC/QA plan.
  
-=== Quality assurance procedures === +==== Quality assurance procedures ==== 
-While the primary aim of quality control is to ensure that methods are correctly applied, the primary purpose of quality assurance is to examine methods and data as such and improve or correct them as necessary. +While the primary aim of quality control is to ensure that methods are correctly applied, the primary purpose of quality assurance is to examine methods and data as such and improve or correct them as necessary.\\ 
-Pursuant to the relevant IPCC definition (Chapter 6.1; GGR), measures for quality assurance (QA) are based "on a planned system of reviews by persons who are not directly involved in preparing the inventory. Such reviews – which are best carried out by independent third parties – should be applied to completed inventories, after QC procedures have been carried out+Pursuant to the relevant IPCC definition (Chapter 6.1; GGR), measures for quality assurance (QA) are based "on a planned system of reviews by persons who are not directly involved in preparing the inventory. Such reviews – which are best carried out by independent third parties – should be applied to completed inventories, after QC procedures have been carried out.\\
 The required instrument for quality assurance is the annual "basic" peer review, though additional audits on "strategic points of the inventory" should also be conducted. The required instrument for quality assurance is the annual "basic" peer review, though additional audits on "strategic points of the inventory" should also be conducted.
  
-=== Verification activities ===+==== Verification activities ====
 According to the GGR-Chapter 6.10 "verification activities" refer to emission estimates only. Verification activities for emission factors and activity data are subsumed under the headword and chapter "quality control", which is a somewhat confusing approach. Nevertheless, and by leaving this peculiarity aside, verification, next to QC, is undoubtedly one key to ensure confidence and reliability of the estimates, corresponding emission factors and activity data. According to the GGR-Chapter 6.10 "verification activities" refer to emission estimates only. Verification activities for emission factors and activity data are subsumed under the headword and chapter "quality control", which is a somewhat confusing approach. Nevertheless, and by leaving this peculiarity aside, verification, next to QC, is undoubtedly one key to ensure confidence and reliability of the estimates, corresponding emission factors and activity data.
  
-=== Reporting procedures ===+==== Reporting procedures ====
 The Single National Entity is responsible for initiating, coordinating and globally organising reporting. Provision of data and reports by third parties must conform to applicable requirements pertaining to the scope, form and scheduling for such provision. The Single National Entity is responsible for initiating, coordinating and globally organising reporting. Provision of data and reports by third parties must conform to applicable requirements pertaining to the scope, form and scheduling for such provision.
  
-=== Documentation and Archiving === +==== Documentation and Archiving ==== 
-As a general requirement, all data and information used for inventory calculation must be documented (i.e. recorded) and archived, for each report year. The purpose of such documentation (i.e. recording) is to make it possible to completely reconstruct all emissions calculations after the fact. The general requirements pertaining to documentation and archiving for the entire process of preparation of the inventory are described in Chapter 6.10.1 of the 2006 IPCC GL GGR. +As a general requirement, all data and information used for inventory calculation must be documented (i.e. recorded) and archived, for each report year. The purpose of such documentation (i.e. recording) is to make it possible to completely reconstruct all emissions calculations after the fact. The general requirements pertaining to documentation and archiving for the entire process of preparation of the inventory are described in Chapter 6.10.1 of the 2006 IPCC GL GGR.\\ 
-Consequently, data providers have the obligation to keep records information relative to data they supply to the German Environment Agency, for purposes of inventory calculations. +Consequently, **data providers** have the obligation to keep records information relative to data they supply to the German Environment Agency, for purposes of inventory calculations.\\ 
-The types of quality control, the dates on which those measures were carried out, the pertinent results, and the corrections and modifications triggered by quality control measures should be recorded by the institution supplying the pertinent data. +The types of quality control, the dates on which those measures were carried out, the pertinent results, and the corrections and modifications triggered by quality control measures should be recorded by the institution supplying the pertinent data.\\ 
-Providers of emissions calculations have obligations to record the calculation methods and the rationale for their appliance. Calculation models, -files and -software, as well as the assumptions and criteria for the appliance of activity data and emission factors and their references have to be archived.+**Providers of emissions calculations** have obligations to record the calculation methods and the rationale for their appliance. Calculation models, -files and -software, as well as the assumptions and criteria for the appliance of activity data and emission factors and their references have to be archived.
 Moreoverthis quality assurance (QA) and confidentiality issues for data secrecy have to be archived. Moreoverthis quality assurance (QA) and confidentiality issues for data secrecy have to be archived.
  
Line 54: Line 54:
 Within the QSE framework, a concept for a start-up organisation was developed that defines binding responsibilities inside the German Environment Agency, for implementation of the necessary QC and QA measures. The purpose of defining roles and responsibilities is to facilitate the effective information exchange and the directive-conformal execution of QC and QA. The following roles are also used for reporting under CLRTAP (but are not yet established on a mandatory basis). Within the QSE framework, a concept for a start-up organisation was developed that defines binding responsibilities inside the German Environment Agency, for implementation of the necessary QC and QA measures. The purpose of defining roles and responsibilities is to facilitate the effective information exchange and the directive-conformal execution of QC and QA. The following roles are also used for reporting under CLRTAP (but are not yet established on a mandatory basis).
  
-**Specialised expert at the operational level (FV)** +**Specialised expert at the operational level (FV)**\\ 
-Source specific expert+Source specific expert\\
 Tasks: Activity-Data collection and entry. Tasks: Activity-Data collection and entry.
  
-**Quality control manager (QKV)** +**Quality control manager (QKV)**\\ 
-Is the superior for the FV+Is the superior for the FV\\
 Tasks: Checking and approving activity-data Tasks: Checking and approving activity-data
  
-**Specialized contact person (source-category-specific, FAP)** +**Specialized contact person (source-category-specific, FAP)**\\ 
-Member of the Single National Entity+Member of the Single National Entity\\
 Tasks: Checking activity-data, Emission-Factor collection, entry and calculation. Preparation of texts, Facilitation of specialised and technical support (inventory work and reporting). Tasks: Checking activity-data, Emission-Factor collection, entry and calculation. Preparation of texts, Facilitation of specialised and technical support (inventory work and reporting).
  
-**Report coordinator (IIRK)** +**Report coordinator (IIRK)**\\ 
-Member of the Single National Entity+Member of the Single National Entity\\
 Tasks: Coordination of textual work. Establishing the Framework for preparation of the IIR from the various relevant contributions. Tasks: Coordination of textual work. Establishing the Framework for preparation of the IIR from the various relevant contributions.
  
-**CSE Coordinator (ZSEK)** +**CSE Coordinator (ZSEK)**\\ 
-Member of the Single National Entity+Member of the Single National Entity\\
 Tasks: Ensuring the integrity of databases. Emissions reporting and data aggregation into report formats. Tasks: Ensuring the integrity of databases. Emissions reporting and data aggregation into report formats.
  
 ==== Current workflow management organisation ==== ==== Current workflow management organisation ====
 The workflow specified by the QSE is currently also used for activity data and additionally for emission factors in the agriculture sector (but not yet established on a mandatory basis). Moreoverthis parts of the adopted design are additionally altered to serve the purposes of CLRTAP-reporting in the present state. For example FV are currently responsible for activity data collection, entry and calculation and not also for collecting emission factors as is with the UNFCCC-Reporting. The workflow specified by the QSE is currently also used for activity data and additionally for emission factors in the agriculture sector (but not yet established on a mandatory basis). Moreoverthis parts of the adopted design are additionally altered to serve the purposes of CLRTAP-reporting in the present state. For example FV are currently responsible for activity data collection, entry and calculation and not also for collecting emission factors as is with the UNFCCC-Reporting.
 +{{  :general:quality_verification:grafik_qcqa_roles-responsibilities.png?700  }}
 Figure: QSE – Roles, responsibilities and workflow Figure: QSE – Roles, responsibilities and workflow
  
 ==== General and Key-Source-category-specific quality control (QC) ==== ==== General and Key-Source-category-specific quality control (QC) ====
-The general and Key-category-specific quality control of the QSE is already in force for Activity Data. This is due to the fact that all AD are the same as those used for UNFCCC-Reporting (except for the Handling of Bulk Products, because these AD aren’t used under UNFCCC). The quality of AD is supervised by the appliance of QC-Checks. The appliance of these QC-Checks (via special QSE-Checklists) is mandatory for all partcipants. The QSE-Checklists cover the set of general QC measures given by Table 6.1 of the 2006 IPCC GL GGR plus additional category-specific measures for key-source-category-specific quality control.+The general and Key-category-specific quality control of the QSE is already in force for Activity Data. This is due to the fact that all AD are the same as those used for UNFCCC-Reporting (except for the Handling of Bulk Products, because these AD aren’t used under UNFCCC). The quality of AD is supervised by the appliance of QC-Checks. The appliance of these QC-Checks (via special QSE-Checklists) is mandatory for all partcipants. The QSE-Checklists cover the set of general QC measures given by Table 6.1 of the 2006 IPCC GL GGR plus additional category-specific measures for key-source-category-specific quality control.\\
 The QSE-Checklist are carried out annually throughout the whole inventory regardles if key-category or not. The QSE-Checklist are carried out annually throughout the whole inventory regardles if key-category or not.
  
Line 86: Line 86:
 Data, Methods and Estimates are generally derived by Staff (FV) who are not member of the Single National Entity (see "Structural organisation - Role concept"). The activities to be performed by FV, concerning quality issues, are related to QC only. Data, Methods and Estimates are generally derived by Staff (FV) who are not member of the Single National Entity (see "Structural organisation - Role concept"). The activities to be performed by FV, concerning quality issues, are related to QC only.
  
-QA-tasks are to be performed by the following roles, starting with the QKV (internal QA). The tasks are given within the already mentioned QSE-Checklists. They build up on another and rely on reviewing and checking of finalized estimates and data. Each participant has it's own set of QA-Checks.+QA-tasks are to be performed by the following roles, starting with the QKV (internal QA). The tasks are given within the already mentioned QSE-Checklists. They build up on another and rely on reviewing and checking of finalized estimates and data. Each participant has it's own set of QA-Checks.\\
 The FAP, as a member of the Single National Entity, is the first role that is not directly involved in preparing the AD (external QA). The "basic annual peer review" is conducted by this role. QA-independence is guaranteed henceforward. The FAP, as a member of the Single National Entity, is the first role that is not directly involved in preparing the AD (external QA). The "basic annual peer review" is conducted by this role. QA-independence is guaranteed henceforward.
  
-The QA-Checks are carried out annually throughout the whole inventory. More intense peer reviews are undertaken when the need arises, performed by national experts and in most cases conducted by means of an national workshop.+The QA-Checks are carried out annually throughout the whole inventory. More intense peer reviews are undertaken when the need arises, performed by national experts and in most cases conducted by means of an national workshop.\\
 The QSE´s QA-procedures are already in force for Activity Data. This is due to the fact that all AD are the same as those used for UNFCCC-Reporting (except for the Handling of Bulk Products, because these AD aren’t used under UNFCCC). The QSE´s QA-procedures are already in force for Activity Data. This is due to the fact that all AD are the same as those used for UNFCCC-Reporting (except for the Handling of Bulk Products, because these AD aren’t used under UNFCCC).