Upgrading pyarrow 0.15 to 0.16
Breaking0.15.1 → 0.16.0Breaking10Security2Deprecated1New171Changed131Fixed209Other243
BreakingUpgrade verdict
10 breaking changes and 2 security fixes.
In plain terms
- Renames arrow::fs::Selector to FileSelector.
- Removes the Rust array_ops module in favor of the compute sub-module.
- [Ruby] Remove the needless BinaryArrayBuilder#append_values method.
- Renames UnionArray::type_ids to type_codes in C++.
Must act Top 5 of 13 that need code or config changes
What you must change
Breaking10
Renames arrow::fs::Selector to FileSelector.
arrow::fs::SelectorFileSelectorRemoves the Rust array_ops module in favor of the compute sub-module.
array_opscompute[Ruby] Remove the needless BinaryArrayBuilder#append_values method.
BinaryArrayBuilder#append_valuesRenames UnionArray::type_ids to type_codes in C++.
UnionArray::type_idsUnionArray::type_codesRemoves the redundant constructor argument from the C# ListType.
ListTypeRemoves pointer aliases from the C++ dataset API.
Removes the tuple on FixedSizeList in Rust.
FixedSizeListReplaces ConstantPartitionScheme with PrefixDictionaryPartitionScheme in the C++ Dataset API.
ConstantPartitionSchemePrefixDictionaryPartitionSchemeRequires an explicit call to pull Datasets into memory in R.
Makes GArrowTimeDataType abstract.
GArrowTimeDataTypeSecurity2
Updates LZ4 to 1.9.2 for CVE-2019-17543.
LZ4Bumps the Rust flatbuffers version to avoid a vulnerability.
Deprecations to plan for
Deprecated1
Marks GetValueOffset obsolete in C#.
GetValueOffsetAPI changes
Generated by DepDelta from published Python source. Not mixed with prose notes.
- removed:
export SparseTensorCOO - removed:
export SparseTensorCSR - added:
export DurationArray - added:
export DurationType - added:
export DurationValue - added:
export FixedSizeListArray - added:
export FixedSizeListType - added:
export FixedSizeListValue - added:
export MapArray - added:
export MapType - added:
export MapValue - added:
export SparseCOOTensor - added:
export SparseCSRMatrix - added:
export duration - added:
export map_
- added:
function dataset(sources, filesystem=…, partitioning=…, format=…) - added:
function field(name) - added:
function partitioning(schema=…, field_names=…, flavor=…) - added:
function scalar(value) - added:
function source(path_or_paths, filesystem=…, partitioning=…, format=…)
- changed:
function table_to_blockmanager(options, table, categories=…, ignore_metadata=…) → function table_to_blockmanager(options, table, categories=…, ignore_metadata=…, types_mapper=…)
- added:
function is_duration(t) - added:
function is_fixed_size_list(t)
- added:
function find_free_port()