Repository navigation
Release DataFusion-Python 53.0.0 #1442
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Publish the next version of datafusion-python now that datafusion-53 is out.
I noticed that the CI is failing (OOM?), so that has to be fixed first.
@timsaucer are there any TODOs that need to be done before the next version can be published?
PRs to merge
Issues to close
- Add missing SessionContext utility methods #1459
- Add missing SessionContext read/write and registration methods #1458
- Add missing SessionContext deregister methods #1457
- Add missing DataFrame methods (window, unnest_columns_with_options, drop_columns) #1456
- Add missing DataFrame methods (set operations and query) #1455
- Add missing aggregate functions (grouping, percentile_cont, var_population) #1454
- Add missing scalar functions (union, arrow metadata, get_field, version, row) #1453
- Add missing array/list functions and aliases #1452
- Add missing date/time functions (current_timestamp, date_format, make_time) #1451
- Add missing string functions (contains, instr, position, substring_index) #1450
- Add missing conditional functions (greatest, least, nvl2, ifnull) #1449
- Add map functions (map, map_keys, map_values, map_extract, map_entries, element_at) #1448
Activity
kevinjqliu commentedon Mar 25, 2026
#1443 for fixing CI
timsaucer commentedon Apr 1, 2026
Ok, question for both of you: I ran this skill and found a bunch of valid areas where we have APIs upstream that were never exposed in Python. Now have a handful of PRs to resolve all of them. They're all originally AI generated but I've been personally reviewing each one (and making changes) before marking it ready for review.
Question is: should we wait to get all these in and then start the DF53 release or start the release now and get those all in for 54?
nuno-faria commentedon Apr 1, 2026
I think we can try to merge them first. With that said, could there also be a
53.1.0feature release to handle those new APIs, or does the versioning need to be in sync with DataFusion?timsaucer commentedon Apr 8, 2026
I think we're in a good spot. I'd like to purge those deprecated APIs and then start release. What do you think?
timsaucer commentedon Apr 9, 2026
I'll start the release :)