52.0.0.md

Apache DataFusion Python 52.0.0 Changelog

This release consists of 26 commits from 9 contributors. See credits at the end of this changelog for more information.

Implemented enhancements:

• feat: add CatalogProviderList support #1363 (timsaucer)
• feat: add support for generating JSON formatted substrait plan #1376 (Prathamesh9284)
• feat: add regexp_instr function #1382 (mesejo)

Fixed bugs:

• fix: mangled errors #1377 (mesejo)

Documentation updates:

• docs: Clarify first_value usage in select vs aggregate #1348 (AdMub)

Other:

• Release 51.0.0 #1333 (timsaucer)
• Use explicit timer in unit test #1338 (timsaucer)
• Add use_fabric_endpoint parameter to MicrosoftAzure class #1357 (djouallah)
• Prepare for DF52 release #1337 (timsaucer)
• build(deps): bump actions/checkout from 5 to 6 #1310 (dependabot[bot])
• build(deps): bump actions/download-artifact from 5 to 7 #1321 (dependabot[bot])
• build(deps): bump actions/upload-artifact from 4 to 6 #1322 (dependabot[bot])
• build(deps): bump actions/cache from 4 to 5 #1323 (dependabot[bot])
• Pass Field information back and forth when using scalar UDFs #1299 (timsaucer)
• Update dependency minor versions to prepare for DF52 release #1368 (timsaucer)
• Improve displayed error by using DataFusionError's Display trait #1370 (abey79)
• Enforce DataFrame display memory limits with max_rows + min_rows constraint (deprecate repr_rows) #1367 (kosiew)
• Implement all CSV reader options #1361 (timsaucer)
• chore: add confirmation before tarball is released #1372 (milenkovicm)
• Build in debug mode for PRs #1375 (timsaucer)
• minor: remove ffi test wheel from distribution artifact #1378 (timsaucer)
• chore: update rust 2024 edition #1371 (timsaucer)
• Fix Python UDAF list-of-timestamps return by enforcing list-valued scalars and caching PyArrow types #1347 (kosiew)
• minor: update cargo dependencies #1383 (timsaucer)
• chore: bump Python version for RAT checking #1386 (timsaucer)

Credits

Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.

    13	Tim Saucer
     4	dependabot[bot]
     2	Daniel Mesejo
     2	kosiew
     1	Adisa Mubarak (AdMub)
     1	Antoine Beyeler
     1	Dhanashri Prathamesh Iranna
     1	Marko Milenković
     1	Mimoune

Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.