Upgrading dask 2 to 2020
Unknown2.30.0 → 2020.12.0
UnknownUpgrade verdict
The only release in this range publishes no notes, so breaking changes can't be ruled out.
In plain terms
- Some releases in this range publish no notes, so DepDelta can't rule out breaking changes.
- DepDelta found no commit log for them either.
Must act Unknown for releases without notes
Releases without notes may still need changes. Check their commits before upgrading.
API changes
Generated by DepDelta from published Python source. Not mixed with prose notes.
- added:
export annotate
- added:
export ravel_multi_index
- changed:
method Array.cumprod(axis, dtype=…, out=…) → method Array.cumprod(axis, dtype=…, out=…, *, method=…) - changed:
method Array.cumsum(axis, dtype=…, out=…) → method Array.cumsum(axis, dtype=…, out=…, *, method=…) - added:
function new_da_object(dsk, name, chunks, meta=…, dtype=…)
- changed:
function compression_level(n, q, oversampling=…, min_subspace_size=…) → function compression_level(n, q, n_oversamples=…, min_subspace_size=…) - changed:
function compression_matrix(data, q, n_power_iter=…, seed=…, compute=…) → function compression_matrix(data, q, iterator=…, n_power_iter=…, n_oversamples=…, seed=…, compute=…) - changed:
function svd_compressed(a, k, n_power_iter=…, seed=…, compute=…, coerce_signs=…) → function svd_compressed(a, k, iterator=…, n_power_iter=…, n_oversamples=…, seed=…, compute=…, coerce_signs=…)
- removed:
function take_along_axis(arr, indices, axis)
- added:
function coerce_depth_type(ndim, depth) - added:
function ensure_minimum_chunksize(size, chunks)
- changed:
function cumprod(x, axis=…, dtype=…, out=…) → function cumprod(x, axis=…, dtype=…, out=…, method=…) - changed:
function cumreduction(func, binop, ident, x, axis=…, dtype=…, out=…) → function cumreduction(func, binop, ident, x, axis=…, dtype=…, out=…, method=…, preop=…) - changed:
function cumsum(x, axis=…, dtype=…, out=…) → function cumsum(x, axis=…, dtype=…, out=…, method=…) - added:
function prefixscan_blelloch(func, preop, binop, x, axis=…, dtype=…, out=…)
- added:
function ravel_multi_index(multi_index, dims, mode=…, order=…)
- added:
function annotate(**annotations)
- changed:
class Blockwise(Mapping) → class Blockwise(Layer) - changed:
constructor Blockwise(output, output_indices, dsk, indices, numblocks, concatenate=…, new_axes=…) → constructor Blockwise(output, output_indices, dsk, indices, numblocks, concatenate=…, new_axes=…, output_blocks=…, annotations=…) - added:
class BlockwiseIO(Blockwise) - added:
class PackedFunctionCall - added:
constructor BlockwiseIO(io_name, io_subgraph, output, output_indices, dsk, indices, numblocks, concatenate=…, new_axes=…, output_blocks=…, annotations=…) - added:
constructor PackedFunctionCall(func) - added:
method Blockwise.cull(keys, all_hlg_keys) - added:
method Blockwise.get_output_keys() - added:
method Blockwise.is_materialized() - added:
property Blockwise.dims
- added:
function find_all_possible_keys(tasks) -> set
- changed:
method DataFrame.apply(func, axis=…, broadcast=…, raw=…, reduce=…, args=…, meta=…, **kwds) → method DataFrame.apply(func, axis=…, broadcast=…, raw=…, reduce=…, args=…, meta=…, result_type=…, **kwds)
- changed:
constructor SeriesGroupBy(df, by=…, slice=…, **kwargs) → constructor SeriesGroupBy(df, by=…, slice=…, observed=…, **kwargs)
- changed:
function text_blocks_to_pandas(reader, block_lists, header, head, kwargs, enforce=…, specified_dtypes=…, path=…) → function text_blocks_to_pandas(reader, block_lists, header, head, kwargs, enforce=…, specified_dtypes=…, path=…, blocksize=…) - added:
class BlockwiseReadCSV(BlockwiseIO) - added:
constructor BlockwiseReadCSV(name, reader, blocks, is_first, head, header, kwargs, dtypes, columns, enforce, path)
- added:
export create_metadata_file
- removed:
class ArrowEngine(Engine) - removed:
static method ArrowEngine.initialize_write(df, fs, path, append=…, partition_on=…, ignore_divisions=…, division_info=…, schema=…, index_cols=…, **kwargs) - removed:
static method ArrowEngine.read_metadata(fs, paths, categories=…, index=…, gather_statistics=…, filters=…, split_row_groups=…, **kwargs) - removed:
static method ArrowEngine.read_partition(fs, piece, columns, index, categories=…, partitions=…, filters=…, schema=…, **kwargs) - removed:
static method ArrowEngine.write_metadata(parts, fmd, fs, path, append=…, **kwargs) - removed:
static method ArrowEngine.write_partition(df, path, fs, filename, partition_on, return_metadata, fmd=…, compression=…, index_cols=…, schema=…, **kwargs) - added:
class ArrowDatasetEngine(Engine) - added:
class ArrowLegacyEngine(ArrowDatasetEngine) - added:
class PartitionObj - added:
constructor PartitionObj(name, keys) - added:
static method ArrowDatasetEngine.initialize_write(df, fs, path, append=…, partition_on=…, ignore_divisions=…, division_info=…, schema=…, index_cols=…, **kwargs) - added:
static method ArrowDatasetEngine.read_metadata(fs, paths, categories=…, index=…, gather_statistics=…, filters=…, split_row_groups=…, read_from_paths=…, engine=…, **kwargs) - added:
static method ArrowDatasetEngine.read_partition(fs, piece, columns, index, categories=…, partitions=…, filters=…, schema=…, **kwargs) - added:
static method ArrowDatasetEngine.write_metadata(parts, fmd, fs, path, append=…, **kwargs) - added:
static method ArrowDatasetEngine.write_partition(df, path, fs, filename, partition_on, return_metadata, fmd=…, compression=…, index_cols=…, schema=…, head=…, **kwargs) - added:
static method ArrowLegacyEngine.aggregate_metadata(meta_list, fs, out_path) - added:
static method ArrowLegacyEngine.collect_file_metadata(path, fs, file_path) - added:
variable ArrowEngine - added:
variable pa_ds - added:
variable read_row_groups_supported - added:
variable subset_stats_supported
- changed:
function read_parquet(path, columns=…, filters=…, categories=…, index=…, storage_options=…, engine=…, gather_statistics=…, split_row_groups=…, chunksize=…, **kwargs) → function read_parquet(path, columns=…, filters=…, categories=…, index=…, storage_options=…, engine=…, gather_statistics=…, split_row_groups=…, read_from_paths=…, chunksize=…, **kwargs) - changed:
function to_parquet(df, path, engine=…, compression=…, write_index=…, append=…, ignore_divisions=…, partition_on=…, storage_options=…, write_metadata_file=…, compute=…, compute_kwargs=…, schema=…, **kwargs) → function to_parquet(df, path, engine=…, compression=…, write_index=…, append=…, overwrite=…, ignore_divisions=…, partition_on=…, storage_options=…, write_metadata_file=…, compute=…, compute_kwargs=…, schema=…, **kwargs)
- added:
static method Engine.aggregate_metadata(meta_list, fs, out_path) - added:
static method Engine.collect_file_metadata(path, fs, file_path)
- added:
function wrap_skew_reduction(array_skew, index)
- removed:
function concat_and_unsort(frames, columns)
- added:
class ShuffleLayer(SimpleShuffleLayer) - added:
class SimpleShuffleLayer(Layer) - added:
constructor ShuffleLayer(name, column, inputs, stage, npartitions, npartitions_input, nsplits, ignore_index, name_input, meta_input, parts_out=…, annotations=…) - added:
constructor SimpleShuffleLayer(name, column, npartitions, npartitions_input, ignore_index, name_input, meta_input, parts_out=…, annotations=…) - added:
method SimpleShuffleLayer.cull(keys, all_keys) - added:
method SimpleShuffleLayer.get_output_keys() - added:
method SimpleShuffleLayer.is_materialized()
- changed:
constructor HighLevelGraph(layers, dependencies) → constructor HighLevelGraph(layers: Mapping[str, Layer], dependencies: Mapping[str, Set], key_dependencies: Optional[Mapping[Hashable, Set]]=…) - added:
class BasicLayer(Layer) - added:
class Layer(collections.abc.Mapping) - added:
constructor BasicLayer(mapping: Mapping, annotations=…) - added:
constructor Layer(annotations=…) - added:
method BasicLayer.is_materialized() - added:
method HighLevelGraph.copy() - added:
method HighLevelGraph.cull(keys: Set) -> HighLevelGraph - added:
method HighLevelGraph.get_all_dependencies() -> Mapping[Hashable, Set] - added:
method HighLevelGraph.get_all_external_keys() -> Set - added:
method HighLevelGraph.keyset() -> Set - added:
method Layer.cull(keys: Set, all_hlg_keys: Iterable) -> Tuple[Layer, Mapping[Hashable, Set]] - added:
method Layer.get_dependencies(key: Hashable, all_hlg_keys: Iterable) -> Set - added:
method Layer.get_output_keys() -> Set - added:
method Layer.is_materialized() -> bool - added:
method Layer.pack_annotations() -> Mapping[str, Any] - added:
static method Layer.expand_annotations(annotations, keys) -> Mapping[str, Any]
- added:
function format_time_ago(n: datetime) -> str - added:
function stringify(obj, exclusive: Optional[Iterable]=…) - added:
function stringify_collection_keys(obj)