Criteria of Coverage Elements
Availability of indicators & disaggregations (coverage element 1)
This element measures whether indicators are available in each data category and what disaggregations are available.
Because there are a unique number of indicators in each data category, the number of indicators and disaggregations required to receive full credit for this element vary by data category. See the section of the official ODIN methodology, Data Categories & Indicators, for the criteria required in each category for full or partial credit on this element.
Availability of data in the last 5 years (coverage element 2)
This element measures whether the data identified in coverage element 1 are available over the last five years. ODIN 2022/23 includes the years 2017-2021 (or 2016/2017- 2020/2021 for non-calendar years).
If data are presented on a quarterly or monthly basis, a majority of quarters or months for a given year must have data available to receive credit for that year. For example, at least 3 out of 4 quarters or 7 out of 12 months for a particular year must be present to award credit for that year.
The following table shows how each data category is scored for this element. Full credit only requires publication of data for 3 of the last 5 years, since not all indicators have enough variability from year to year to warrant more frequent data collection in many countries.
Coverage Element 2: How to receive credit
|
Score
|
Minimum Criteria
|
1 point
|
All indicators available in the category must have national data for at least 3 of the last 5 years for all available disaggregations.
|
.5 point
|
One indicator in the category has national data for at least 1 year of the last 5 years for any number of disaggregations.
|
0 points
|
No indicators in the category have any national data for any of the last 5 years.
|
Note: Coverage element 2 cannot score higher than coverage element 1. This is to prevent inflated coverage scores based on the publication of just a few indicators.
|
Availability of data in the last 10 years (coverage element 3)
This element measures whether the data identified in coverage element 1 are available over the last ten years. For ODIN 2022/23, this includes the years 2012-2021 (or 2011/2012- 2020/2021 for non-calendar years)
If data are presented on a quarterly or monthly basis, the majority of quarters or months for a given year must have data available to receive credit for that year. For example, at least 3 out of 4 quarters or 7 out of 12 months for a particular year must be present to award credit for that year.
The following table shows how each data category is scored for this element. Full credit only requires publication of data for 6 of the last 10 years, since not all indicators have enough variability from year to year to warrant more frequent data collection in many countries.
Coverage Element 3: How to receive credit
|
Score
|
Minimum Criteria
|
1 point
|
All indicators available in the category must have national data for at least 6 of the last 10 years for all available disaggregations.
|
.5 point
|
One indicator in the category has national data for at least 3 years of the last 10 years for any number of disaggregations.
|
0 points
|
No indicators in the category have any national data for at least 2 of the last 10 years.
|
Note: Coverage element 3 cannot score higher than coverage element 1.
|
Availability of data at the first administrative geographic level (coverage element 4)
This element records whether the data identified in coverage element 1 are also available at the subnational level defined as the first administrative geographic level. To identify the first administrative levels, ODIN largely draws on the ISO 3166-2 standard. For a full list of first administrative levels used in ODIN, see this file.
If data are presented at the first administrative level, the majority of first administrative level divisions must have data available to receive credit for that year. Credit will only be given for less than a majority of first administrative divisions if there are methodological reasons for them not to exist (sample size is too small, indicator not relevant to those divisions, or other reasons) and this is stated in the metadata of the dataset.
In certain data categories, all indicators in the category are not scored for data at the first administrative level because how these indicators are calculated often do now allow for geographic disaggregation in most countries. These categories are Money & Banking, International Trade, Balance of Payments, and Energy.
The following table shows how each data category is scored for this element.
Coverage Element 4: How to receive credit
|
Score
|
Minimum Criteria
|
1 point
|
All indicators available in the category must have first administrative level data for all available disaggregations.
|
.5 point
|
One indicator in the category has first administrative data for any number of disaggregations.
|
0 points
|
No indicators in the category have any data available at the first administrative level.
|
Note: Coverage element 4 cannot score higher than coverage element 1. In addition, ODIN designates certain countries as “Small Countries” which are not scored for publishing data at the first administrative level for the indicators 2.3, 4.3, 6.1, 6.2, 7.3, 7.4, 7.5, 8.2, 9.3, 10.2, and 18.2.
|
Availability of data at the second administrative geographic level (coverage element 5)
This element measures whether the data identified in coverage element 1 are also available at the subnational level defined as the second administrative geographic level. Second administrative levels are defined by the country but must be a further division of their first administrative levels. For a full list of the possible second administrative levels used in ODIN, see this file.
If data are presented at the second administrative level, the majority of second administrative level divisions must have data available to award credit for that year. Credit will only be given for less than a majority of second administrative divisions if there are methodological reasons for them not to exist (sample size is too small, indicator not relevant to those divisions, or other reasons) and this is stated in the metadata of the dataset.
In certain data categories, all indicators in the category are not scored at the second administrative level because administrative units responsible for producing these data do not exist in many countries or the indicators are not typically defined for small administrative units. These categories are Money & Banking, International Trade, Balance of Payments, National Accounts, Government Finance, Pollution, Energy, Price Indexes, and Resource Use.
In addition, the following indicators in other categories are not scored at the second administrative level for the same reasons. These include:
(2.3) Education expenditures
(4.3) Health expenditures
(6.1) Maternal mortality rate
(6.2) Infant mortality rate or neonatal mortality rate
(7.3) Prevalence of obesity
(7.4) Prevalence of stunting
(7.5) Prevalence of wasting
(8.2) Proportion of women in government
(9.3) Data on prison population
(10.2) Distribution of income by deciles or Gini coefficient
(18.2) Data on protected lands
The following table shows how each data category is scored for this element.
Coverage Element 5: How to receive credit
|
Score
|
Minimum Criteria
|
1 point
|
All indicators available in the category must have second administrative level data for all available disaggregations.
|
.5 point
|
One indicator in the category has second administrative data for any number of disaggregations or years.
|
0 points
|
No indicators in the category have any data available at the second administrative level.
|
Note: Coverage element 5 cannot score higher than coverage element 1. In addition, ODIN designates certain countries as “Small Countries” which are not scored for publishing data at the second administrative level for any category.
|
Coverage scores are the average scores across the five coverage elements. Each element receives a score of 0, .5 or 1. Some category coverage scores will be based on 3 or 4 elements, if first or second administrative level data are not required. You can read more about the coverage elements and how to score them here.
Coverage elements 2-5 cannot score higher than coverage element 1 within any given category.
|