Skip to main content
ESG Ratings and Their Disagreements

ESG Rating Transparency: The Case for Open-Source ESG Data

Pomegra Learn

Should ESG Ratings Be More Transparent?

ESG rating methodologies are largely proprietary. The specific weights given to different ESG factors, the rules for translating raw data into scores, and the models used to aggregate pillar scores are treated as competitive intellectual property by most major rating agencies. This opacity creates problems: investors cannot evaluate whether a provider's methodology aligns with their objectives; regulators cannot assess whether rating processes are sound; academics cannot fully validate rating quality; and companies cannot understand why their scores differ across providers. The ESG rating transparency debate asks how much methodology openness is necessary for ESG data to be trusted in investment decisions.

Quick definition: ESG rating transparency refers to the degree to which ESG rating agencies disclose their methodologies — the factors assessed, their relative weights, data sources, scoring rules, and aggregation processes. Higher transparency enables investors, companies, and regulators to evaluate whether ESG ratings measure what they claim to measure.

Key takeaways

  • Current ESG rating transparency is limited: most providers share general methodology descriptions but do not disclose specific factor weights, aggregation formulas, or the detailed rules used to translate raw data into scores.
  • The EU's ESG Rating Regulation requires registered providers to disclose methodologies, data sources, assumptions, and limitations — a significant transparency improvement for EU-market providers.
  • Open-source ESG data initiatives — including CDP's publicly available climate data, academic ESG databases, and some governmental ESG data repositories — demonstrate that some ESG data can be provided openly without destroying commercial incentives.
  • Transparency enables validation: with full methodology disclosure, independent researchers can test whether ESG ratings measure what they claim to measure and whether they predict the outcomes that would validate their claims.
  • The tension is between commercial viability (proprietary methodologies are competitive assets) and epistemic integrity (users need to understand what they are buying to trust it).

The Case for Greater Transparency

Investment decision quality: Investors who do not understand how ESG scores are constructed cannot fully evaluate whether the scores are appropriate for their investment objectives. A methodology that weights governance at 40% globally is appropriate for some mandates and inappropriate for others — but investors cannot know this without methodology disclosure.

Conflict of interest detection: Detailed methodology disclosure makes it easier to detect whether a provider is applying consistent standards or providing favorable treatment to commercial clients. Transparent scoring rules reduce the space for subjective adjustment in ways that could serve commercial relationships.

Academic validation: The growing academic literature on ESG investing depends on understanding what ESG scores measure. Researchers who cannot access full methodologies must treat rating outputs as black boxes — limiting the strength of academic evidence about ESG's financial and societal effects.

Regulatory oversight: Supervisors who must oversee ESG rating agencies under the EU's ESG Rating Regulation need to understand the methodologies they are overseeing. Opacity makes supervisory assessment difficult and may allow substandard practices to persist undetected.

Systemic risk assessment: ESG ratings are embedded in regulatory frameworks — SFDR requires funds to report portfolio ESG characteristics; CSRD requires companies to assess ESG materiality; central banks are exploring ESG in stress testing. For ESG data to be used reliably in these systemic functions, its methodological foundations need to be understood and validated.

What Transparent Methodology Disclosure Would Include

Full transparency would require ESG rating agencies to disclose:

  1. Factor inventory: Complete list of ESG factors assessed for each industry
  2. Factor weights: The relative importance of each factor in calculating pillar and overall scores
  3. Scoring rules: The specific rules used to translate raw data points into 0–10 or percentage scores for each factor
  4. Data sources: The specific data sources used for each factor, including whether the data is company-disclosed, third-party verified, or estimated
  5. Aggregation formulas: The specific mathematical formulas used to combine factor scores into pillar and overall scores
  6. Missing data treatment: How missing data points are handled (imputed, zero-scored, excluded from aggregation)
  7. Controversy overlay rules: The rules governing when and how controversy events affect scores
  8. Update triggers: The conditions under which scores are updated and the timeline for updates following disclosure events or controversy incidents

Most providers currently disclose broad descriptions of items 1 and 2; few disclose 3–8 in detail sufficient for independent validation.

What Rating Agencies Resist Disclosing and Why

Rating agencies have several commercial reasons for resisting full transparency:

Competitive advantage: Methodologies developed over years are genuine intellectual property. Full disclosure would allow competitors (and companies seeking to game ratings) to replicate the methodology without the investment required to develop it.

Gaming risk: Detailed scoring rules provide companies with a roadmap for questionnaire optimization — knowing exactly which answers produce which scores enables more precise gaming. Some opacity may be necessary to maintain rating integrity.

Methodology evolution: Specific rules and weights change frequently as providers update their frameworks. Committing to precise public formulas creates compliance burden when methodologies need to evolve.

Liability risk: Detailed methodology disclosures may increase legal liability if users claim damages based on specific methodology representations that did not produce expected results.

Transparency spectrum

Open-Source ESG Data Initiatives

Several initiatives provide ESG data under open-access frameworks:

CDP (Carbon Disclosure Project): CDP collects climate, water, and forests disclosure data from thousands of companies annually and makes a substantial portion of the data publicly available. CDP provides one of the most accessible open-source climate disclosure datasets globally.

SFDR PAI data: The EU's SFDR requires financial product providers to report on Principal Adverse Impacts (PAIs) — standardized ESG metrics at portfolio level. These disclosures create a growing open-access dataset of portfolio-level ESG characteristics.

Academic ESG databases: Some academic research initiatives have created open-access ESG datasets for research purposes. The Sustainable Economies Law Center and similar organizations have advocated for open-source ESG data to improve academic research quality.

Government ESG data repositories: Environmental data (EPA emissions databases, EU environmental agency data), worker safety data (OSHA inspections), and governance data (SEC proxy filing databases) are freely available as underlying data that ESG rating agencies incorporate — though the aggregated ratings themselves remain commercial products.

Real-world examples

MSCI methodology publications: MSCI publishes "Methodology Factsheets" for its ESG rating and index products that describe the general framework, the list of key ESG issues assessed, and the general approach to industry weighting. These documents are publicly available but do not disclose specific numerical weights or aggregation formulas — illustrating the current norm of partial transparency.

Morningstar Sustainalytics methodology disclosure: Sustainalytics publishes detailed methodology documentation for its ESG Risk Rating, including descriptions of the exposure and management framework, lists of Material ESG Issues by industry, and general guidance on how management scores are assessed. The documentation is more detailed than MSCI's public materials but still does not provide the complete scoring rules that would enable independent replication.

Open Source ESG (OSESG) initiative: Various academics and practitioners have advocated for open-source ESG rating frameworks where methodologies are publicly published and results can be independently validated. The Global Reporting Initiative's standards represent a partially open framework — GRI publishes its complete standards publicly, and companies' GRI disclosures are publicly available.

Common mistakes

Expecting full transparency without recognizing commercial trade-offs: Full methodology transparency would allow competitors to replicate proprietary methodologies and companies to game ratings more precisely. The appropriate level of transparency balances these costs against the epistemic benefits of investor understanding. Regulation is threading this needle by requiring more transparency than currently exists while stopping short of complete methodology publication.

Treating transparency as a substitute for methodology quality: A fully transparent but poorly designed methodology is worse than a partially opaque but well-designed one. Transparency enables validation of quality; it does not guarantee it. The goal is transparency + quality, not transparency alone.

Conflating data transparency with methodology transparency: CDP's open-access climate disclosure data is data transparency — the underlying numbers are publicly available. ESG rating methodology transparency is different — it means disclosing the rules used to convert data into scores. Both matter, but they address different issues.

FAQ

How does the EU ESG Rating Regulation improve transparency?

The regulation requires registered ESG rating providers to publicly disclose their methodologies, including the main factors assessed, their relative weights, the data sources used, and key assumptions and limitations. It also requires disclosure of whether the rating involves issuer participation (company engagement) or is purely third-party assessed. This is a significant improvement over current voluntary disclosure practices, though the regulation does not require full formula-level disclosure.

Can investors request methodology details from their ESG data providers?

Yes — most major providers offer detailed methodology briefings for significant institutional clients, including information about specific weighting approaches and scoring rules beyond what is publicly available. Investment managers can negotiate for more detailed methodology documentation as part of data licensing agreements.

Are there efforts to standardize ESG rating methodologies?

IOSCO has recommended that ESG rating agencies adopt best practices for transparency, but has not mandated specific methodologies. The EU regulation requires transparency about methodologies but does not mandate any particular approach. Some industry groups have developed voluntary standards for ESG data quality and methodology disclosure, but standardization of the underlying methodologies themselves would eliminate the diversity of approaches that, despite creating divergence, also provides complementary perspectives.

What would "open-source ESG ratings" look like in practice?

Open-source ESG ratings would mean that the complete scoring algorithm, factor weights, data sources, and aggregation rules are publicly published and independently replicable. Companies like ShareAction and academic initiatives have called for this model. The practical implementation would require ESG rating agencies to either accept that competitors can replicate their work or find alternative competitive differentiation (data quality, coverage, timeliness) beyond methodology.

Does transparency affect the accuracy of ESG ratings?

Some opacity may be necessary to maintain rating integrity against gaming. But the primary determinant of ESG rating accuracy is methodology quality, data quality, and analyst expertise — not opacity. Greater transparency enables external validation that can improve accuracy over time, as external criticism of methodology weaknesses creates pressure for improvement.

Summary

ESG rating transparency — the degree to which providers disclose their methodologies, factor weights, scoring rules, and data sources — is currently limited, with most providers sharing only general framework descriptions rather than complete methodological detail. The EU's ESG Rating Regulation represents a significant step toward greater required transparency, mandating methodology disclosure for registered providers. Open-source ESG data initiatives (CDP, SFDR PAIs, academic databases) demonstrate that some ESG data can be provided openly. The fundamental tension is between commercial viability (proprietary methodologies as competitive assets), gaming risk (detailed rules enable precise questionnaire optimization), and epistemic integrity (users need to understand what they are buying). The resolution is moving toward regulated transparency requirements that mandate disclosure of key methodology elements without requiring complete formula-level openness.

Next

Controversies vs. Scores