Secretariat's methodology

About the applied methodology

  • Background

    Background

    For its assessment underpinning the Implementation Report findings, the Secretariat uses specific transposition and implementation indicators, paired with a methodology to calculate the summary indicators and the overall implementation score.

    The implementation indicator tables are based on a methodology quantifying the Contracting Parties’ success in transposing and implementing the acquis and having in place effective institutions. It is based on standardised assumptions and evaluations, cases under the Energy Community’s dispute settlement mechanism, country missions, review of legislation, market analysis, expert interviews and desk research. The quantification of all figures used to measure implementation was performed by experts of the Energy Community Secretariat.

    The final data set entailed more than 2.000 individual values that were used to produce 41 key implementation indicators across the areas of work assessed in the Secretariat's Implementation Report. Each year, the Secretariat reassesses the scope and weighting of the final data set and decides on possible incorporation of new areas of work and/or on weighting adjustments to better reflect a pressing issue in the reporting period.

    For the 2020 report, the Secretariat incorporated new indicators for energy efficiency in heating and cooling, oil fuel quality and cybersecurity into its final data set. Also the weighting for energy efficiency, oil, environment, infrastructure and statistics underwent small adjustments.

  • Transposition assessment

    Transposition assessment

    The transposition assessment is presented by using an easy to understand traffic light system.

      red no transposition
     orange  partial transposition with ongoing activities
     green  full transposition or significant progress

    The corresponding summary table (online / pdf) groups together all the transposition assessments indicators displayed in the implementation tables of the nine Contracting Parties.

  • Implementation assessment

    Implementation assessment

    The implementation assessment is based on a system of performance indicators.

    •  A total of 41 implementation sub-indicators per each Contracting Party across the areas of work: electricity, gas, oil, renewable energy, energy efficiency, environment, climate, infrastructure, statistics and cybersecurity. Aggregation is based on the weighting explained in the table below;
    • Key sectoral implementation indicators aggregating the values of the sub-indicators at sectoral level: electricity, gas, oil, sustainability (including renewable energy, energy efficiency, environment, climate), produced per Contracting Party; 
    • Summary indicators – the overall implementation score for each Contracting Party and overall (average) implementation score for the Energy Community calculated based on the sectoral indicators.

    The level of independence and performance of national authorities (energy regulators, competition and state aid authorities) was also measured and included in calculation of the overall score, with three sub-indicators shown in sub-table below (institutions).

    All of the values are normalised to percentages between 0% and 100%, where 100% implies full implementation. For the Contracting Parties where certain indicators are not applicable (for example due to the lack of a gas market in Kosovo* and Montenegro), these indicators were not taken into account in the overall score, but the remaining indicators were increased in weight, where justifiable.