Skip to content

Upgrading pyarrow 10 to 11

Breaking10.0.1 → 11.0.0Breaking3Platform1Deprecated2New93Changed42Fixed119Other160

Full comparisonBack to pyarrow
BreakingUpgrade verdict

3 breaking changes and a platform requirement change.

In plain terms
  • Removes auto generated pyarrow_api.h and pyarrow_lib.h from Python.
  • Removes the C++ AllocateBitmap() overload that takes an out parameter.
  • Removes the C++ API declaration for ConcatenateBuffers.
  • Adds Ruby support for macOS 12 and Xcode 14.
Must act Top 5 of 6 that need code or config changes

What you must change

Breaking3
Removes auto generated pyarrow_api.h and pyarrow_lib.h from Python.
pyarrow_api.hpyarrow_lib.h
11.0.0CHANGELOG.mdSummarizedView source
Removes the C++ AllocateBitmap() overload that takes an out parameter.
AllocateBitmap()
11.0.0CHANGELOG.mdSummarizedView source
Removes the C++ API declaration for ConcatenateBuffers.
ConcatenateBuffers
11.0.0CHANGELOG.mdSummarizedView source
Platform1
Adds Ruby support for macOS 12 and Xcode 14.
11.0.0CHANGELOG.mdSummarizedView source

Deprecations to plan for

Deprecated2
Switches the default and deprecates use_legacy_dataset=True in ParquetDataset.
ParquetDatasetuse_legacy_dataset
11.0.0CHANGELOG.mdSummarizedView source
Removes the ExecPlan::Make deprecation warning in C++.
ExecPlan::Make
11.0.0CHANGELOG.mdSummarizedView source