Published November 15, 2026 | Version v2026.11.0

Public Utility Data Liberation Project (PUDL) Data Release

Description

v2026.11.0 (2026-11-10)

This is a regular quarterly PUDL release, with updates to EIA-860m, EIA-923, EIA-930, EPA CEMS, EPA MATS, and the EIA Bulk API data, plus a ton of other incidental updates.

This release upgrades PUDL dependencies to Pandas 3, DuckDB 2, Polars 2, and Splink 5. The upgrade to Pandas 3 came with some bonus bugfixes.

We've also got better data validation tests for FERC EQR and RUS, and a pile of bug fixes in RUS, EIA-861, EIA-176, and the EIA-860m changelog.

See below for details.

Enhancements

  • Standardized how distributed datapackage.json descriptors are produced. FERC EQR now has its own package, FERCEQR_PACKAGE, and a dedicated ferceqr_datapackage asset built with the same factory as pudl_datapackage. Descriptors list only the sources their tables use and describe partitioned tables with per-partition bytes and hash entries. Each quarterly FERC EQR archive is now verified against the md5 checksum in its Zenodo metadata, and downloading archives from remote storage requires setting PUDL_FERCEQR_ALLOW_DOWNLOADS. See #5279 and #5693.

Expanded Data Coverage

EIA-191

EIA-860M

EIA-923

EIA-930

  • Updated EIA-930 data through the beginning of November 2026. See issue #5742 and PR #5743.

EIA API Bulk Electricity Data

  • Updated the EIA API bulk electricity data through August 2026. See issue #5742 and PR #5743.

EPA CEMS

  • Updated the EPA CEMS with data through 2026 Q3 (September, 2026). See issue #5742 and PR #5748.

EPA MATS

  • Updated the raw EPA MATS archive with data through 2026 Q3 (September, 2026). This data is not yet deeply integrated into PUDL. See issue #5742 and PR #5748.

FERC CID

  • Updated the FERC company identifiers to the October 2026 release. See issue #5742 and PR #5743.

FERC Forms 2 and 6

  • Re-archived the raw FERC Form 2 and FERC Form 6 XBRL data. Coverage still ends with 2025. This data is converted to SQLite, but not deeply integrated into PUDL. See issue #5742 and PR #5743.

PHMSA

  • Updated the raw PHMSA archive with revised records. Coverage still ends with 2025. See issue #5742 and PR #5743.

New Data Tests & Validations

  • Updated dbt data validation now to support FERC EQR data. This requires dbt configuration changes to handle partitioned parquet outputs. See issue #4864 and PR #5676. This PR also applies basic validation tests to FERC EQR tables, including row count tests.

  • Updated dbt data validation to support FERC EQR, whose partitioned parquet outputs required several configuration changes. The external_location of each table is now generated automatically, row count tests accept string partition keys such as year_quarter, and dbt_helper can generate row counts for partitioned tables. Validation tests can also run against remote parquet datasets without downloading the files, and the FERC EQR deployment asset now runs the EQR validations before publishing. All FERC EQR tables get basic validation tests, including row counts. See #4864 and #5676.

  • Validate that the net utility plant, total other property and investments, and total assets in core_rus7__yearly_balance_sheet_assets and out_rus7__yearly_balance_sheet_assets equal the sum of their subcomponents. The existing total_utility_plant and total_current_and_accrued tests no longer allow any failures. See #5566 and #5729.

Bug Fixes & Data Cleaning

  • Added a missing US minor outlying islands territory entry to the core_pudl__codes_subdivisions table. See #5696 and #5716.

  • Restored non-utility property (RUS Form 7 Part C, line 6) to core_rus7__yearly_balance_sheet_assets and out_rus7__yearly_balance_sheet_assets. A typo in the column map (non_utility_property_asset) meant the transform never picked it up. See #5566 and #5729.

  • Restored non-utility property (RUS Form 12 Section B, line 6) to core_rus12__yearly_balance_sheet_assets and out_rus12__yearly_balance_sheet_assets. As in RUS 7, a typo in the column map (non_utility_property_asset) meant the transform never picked it up, and the RUS 12 asset_type values are corrected to match. See #5737, a follow-up to #5729.

  • Added plant_function values to a few factoids in out_ferc1__yearly_rate_base. See #5690.

  • Made transforms in FERC 1, FERC 714, SEC 10-K, PHMSA, RUS and the EIA API extractor behave identically under pandas 2 and 3 by replacing in-place, chained and dtype-changing assignments. Along the way: the PHMSA operators cleanup no longer nulls non-string values like numeric zip codes. SEC 10-K ownership percentages no longer misread leader dots ("...99" was 0.0099, now 0.99), and fraction_owned is now always within 0-1, with out-of-range values (about 9% of non-null values, e.g. adjacent percentages run together) set to null and a field constraint enforcing the range. drop_invalid_rows() has a new dropna argument (default True) instead of requiring null values in invalid_values; outputs are unchanged. See #5616, #5623 and #5720.

  • X in the EIA-861 dynamic pricing time-of-use, critical peak, real time and variable peak columns is now treated as True (a checked box) instead of being turned into a null, which changes four 2018 rows of core_eia861__yearly_dynamic_pricing. All EIA-861 Y/N flag columns now share one case-insensitive conversion to booleans, so a lowercase y or n is no longer turned into a null in a few core_eia861__yearly_reliability rows, and unexpected codes other than Y, N and X raise an error. See #5617, #5601 and #5718.

  • Fixed the 2007-2011 EIA-861 advanced metering infrastructure column map, which was loading the utility ownership codes (e.g. C for cooperative) into short_form and leaving entity_type null. Those years of core_eia861__yearly_advanced_metering_infrastructure now have entity_type populated and short_form null. See #5617 #5718.

  • When EIA-861 rows for the withheld utility 88888 are combined, boolean columns are no longer summed, nulls are now compatible with non-null values, and the row kept when values conflict no longer depends on input row order, which may change a few rows in several EIA-861 tables. See #5612 and #5718.

  • Made the EIA-923 transforms behave the same under pandas 3: date and month columns are now assigned directly instead of through chained .loc assignment, and the numeric columns summed when de-duplicating EIA-923 generation fuel rows are explicitly cast to float64. See #5619, #5620 and #5719.

  • Made null handling in stack_generators(), the EIA-176 "other" gas disposition categorization and the EIA-860 ownership spot-fix behave identically under pandas 2 and 3. Pandas 3 changed how nulls are treated by stack(), astype(str) and string comparisons, which would otherwise have left spurious null energy sources, null primary keys, or unremoved bogus ownership records. See #5621, #5622, #5624 and #5721.

  • Stop make_changelog() from dropping records whose values reverted to an earlier state (e.g. OP -> OA -> OP), leaving the intermediate value looking like a permanent change. This adds 3-7% more rows to core_eia860m__changelog_generators and the entity resolution forensics tables. It also removes empty valid_until_date intervals, and ensures every series ends on the same date – one month past the entity's final report date. See #5730 and #5731.

Developer Experience

  • The FERC DBF field types we can't convert to SQL column types are now listed apart from the ones we can, instead of being mixed in as placeholder strings. A field of an unsupported type fails immediately with an error naming the type, field and table. See #5734.

  • Plant part record IDs for records with a null utility_id_eia now end in null instead of <NA> (or <na>), consistent with the rest of the ID. This changes record_id_eia and plant_part_id_eia in out_eia__yearly_plant_parts and the related plant-part association tables for a few hundred records. See #5598 and #5721.

  • Replaced the standalone pixi run unmapped-ids pytest task with analogous Dagster assets (pudl.dagster.assets.core.unmapped_ids) that identify FERC1 and EIA plant/utility IDs missing from the manual PUDL ID mapping spreadsheet. CSVs are saved with other build outputs on builds.catalyst.coop and fail the ETL if they are non-empty. See issue #4338 and PR #5539.

  • Added a DATAPACKAGES registry of every datapackage PUDL distributes, with all_resources() and find_resource() helpers, so asset checks, the docs, the data dictionary, dbt tooling and a DuckDB views database per package cover FERC EQR as well as the main PUDL tables. Every <name>_datapackage asset now has blocking checks that validate its descriptor and compare the declared fields with the columns in its Parquet files, and Pandera schemas are strict. This exposed a redundant filing_quarter column in core_ferceqr__quarterly_identity which was removed. The datapackage and deploy_ferceqr assets also record richer Dagster metadata. See #5279 and #5735.

Major Dependency Updates

A bunch of Python tabular data libraries we depend on have had major releases in the last month (or finally made it into PUDL in the last month anyway), with big performance improvements and new features, but also breaking changes.

Pandas 3

  • Upgraded to pandas 3 (pandas>=3.1,<4) and pandas-stubs 3.1, adapting PUDL to the new string dtype, stricter setitem dtype rules, mandatory Copy-on-Write, and groupby(...).apply no longer including grouping columns. We also fixed transforms that failed when only some years were processed (as in the fast ETL), removed pandas 2-only code and warning suppressions, and consolidated fragmented wide data frames that had caused thousands of warnings and slow transforms. See PRs #5130, #5718, #5719, #5720, #5721 and Epic #3737.

  • We aimed to keep the outputs the same, so any difference comes from a deliberate decision rather than from the upgrade. Where pandas 2 was correct or the right value was unclear we preserved its behavior, e.g. missing EIA-860M generator_id and boiler_id values stay the string "nan" (#5645), out-of-range dates stay NaT (#5644), and Unicode whitespace is still collapsed in strings (#5646).

  • Where pandas 3 changed a value and the right one was clear, we fixed the data. This affects a small number of values: EIA-861 rows for the withheld utility 88888 (and the Texas state demand derived from them), the order of FERC 1 small plants rows and the plant and fuel types that depend on it, one malformed EIA-860M date, the dtype of supplier_code_rus in the RUS 7 energy purchased table, etc. See PR #5130 and the commit messages for details.

  • For more on what changed in pandas 3, see the pandas 3.0 announcement, the 3.0.0 and 3.1.0 release notes, and the migration guides.

DuckDB 2

  • Upgraded to DuckDB 2.0. Its Python client fetches results differently and the SQL parser is new, requiring small query changes. See PR #5726, the announcement and migration guide.

Polars 2

  • Upgraded to Polars 2 (in v2026.10.0). Lazy queries now stream by default without guaranteeing row order, and one replace() became strict_replace(). See PR #5689, the announcement and upgrade guide.

Splink 5

  • Upgraded to Splink 5 (in v2026.10.0) and ported the FERC 1 to EIA plant-parts record linkage to its new API. The linkage shifts slightly, as if the random seed had changed. See PR #5698 and the Splink 5.0.0 release notes.

Other PUDL v2026.11.0 Resources

Contact Us

If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch:

Files

censusdp1tract.sqlite.zip

Files (28.4 GB)

Name Size
md5:006e49e7bc2139d4fc401418ea8d4c5f
506.7 MB Preview Download
md5:cf73bdadf7dbfac49685d9b270102a3e
327.2 kB Preview Download
md5:fb4506e472f1b0b3265ae0250ecc98ff
275.0 MB Preview Download
md5:b365602960b11af61388e9903bf56502
131.6 MB Preview Download
md5:121b201eb96c94c251d236287802c27a
274.6 kB Preview Download
md5:e6df92685a50d2a947db8b25d9dfe9ce
236.5 MB Download
md5:d6da4692404ce43e3f99285288ba20b0
246.4 MB Preview Download
md5:19f14d5ff3333f76e0497fd97d52ccf5
95.4 MB Preview Download
md5:de64544d21f239b021240b509194d52f
2.3 MB Preview Download
md5:ee5c7f18d569c58f3f008b96a16bedff
8.5 MB Preview Download
md5:f8c4e00a83d4565e7207553dbcca0383
74.7 MB Preview Download
md5:849dde2e6155a6991fc6a096481f1bc2
34.0 MB Preview Download
md5:a66f98a02e46693146eb8543b7270967
221.2 kB Preview Download
md5:278fc8d652ec405e538370f93df1a105
99.4 MB Download
md5:ba0b0bd3db6c7d9062a8fac5e3595efd
37.5 MB Preview Download
md5:c5c3c561adcbd979fa28442994c0050e
14.8 MB Preview Download
md5:5d63fff57c72d7e7c616900dfe46a5a2
2.3 MB Preview Download
md5:bd09d11e1a79a1623b3d9789bf336c9e
7.2 MB Preview Download
md5:1a34dfdd8f8ede616d0cfa9e6e8cd8b6
2.9 MB Preview Download
md5:3762e886bf44f13665c0bb39c5712006
2.0 MB Preview Download
md5:c95112534754314997f4165bbb15145a
72.2 kB Preview Download
md5:a0be3c4d3993ea3b8f9424548800b3d6
21.0 MB Download
md5:99fc347b82cb2afaaa9beb5194184e90
5.6 MB Preview Download
md5:5487225d520aa6b38409422db454b944
3.9 MB Preview Download
md5:dbef020e9b62f36d21a97e6662b2fbf2
978.1 kB Preview Download
md5:ba679325b7ae96c87b6fa5584cfae491
2.0 MB Preview Download
md5:0f5c1def8020df8660dbb3d632e16c5d
44.0 MB Preview Download
md5:569af710af5f16aa401be49b3772610b
19.3 MB Preview Download
md5:88df5ca65824e8fb8f681761696f3c54
127.9 kB Preview Download
md5:57c48958449a6fa33f4b821289b7e792
55.6 MB Download
md5:6fb3bb64f9a6faf12d9773c5a67ced7c
30.1 MB Preview Download
md5:97266d38c4e085e12c9d2d190ffbc457
10.5 MB Preview Download
md5:3d17c331bb5be5dc68cbd0ca3e8f3af8
1.3 MB Preview Download
md5:240ab648e9b6fb13f2540b217638676e
3.0 MB Preview Download
md5:79f3a0768ef3060e25654f23fac7d808
62.9 MB Download
md5:2939fa8aa483652059627b199759153a
243.5 MB Preview Download
md5:c03cc19aaf698b22284192f9493cebb2
30.5 MB Preview Download
md5:492adfc1db3cdfef8162b27995982d2e
65.7 kB Preview Download
md5:83bcf37029395440c6a0efb7ce49ee8e
192.9 kB Preview Download
md5:cc13b4a8ffdc35f88cf28011436f8067
38 Bytes Download
md5:0344fc812d00eeae1cc264a3a7dfb62b
10.6 GB Download
md5:0a4208cf6e7368c97e0d064769931734
3.5 GB Preview Download
md5:7abeaefe25fd6335a7cd4b6f44830a72
12.0 GB Preview Download
md5:a78fcf196e34d6793c689721b923f396
3.3 MB Preview Download

Additional details