Upgrading dask 0.16 to 0.17
Unknown0.16.1 → 0.17.5
UnknownUpgrade verdict
None of the 6 releases in this range publish notes, so breaking changes can't be ruled out.
In plain terms
- Some releases in this range publish no notes, so DepDelta can't rule out breaking changes.
- Their commits are listed with this comparison.
Must act Unknown for releases without notes
Releases without notes may still need changes. Check their commits before upgrading.
API changes
Generated by DepDelta from published Python source. Not mixed with prose notes.
- added:
export optimize
- added:
export argtopk - added:
export bitwise_and - added:
export bitwise_not - added:
export bitwise_or - added:
export bitwise_xor - added:
export broadcast_arrays - added:
export einsum - added:
export gradient - added:
export isin - added:
export map_overlap - added:
export piecewise
- changed:
function topk(k, x) → function topk(a, k, axis, keepdims) - added:
function argtopk_preprocess(a, idx) - added:
function einsum(*operands, **kwargs) - added:
function topk_postprocess(a, k, axis)
- removed:
function pytest_ignore_collect(path, config)
- changed:
class Array(Base) → class Array(DaskMethodsMixin) - changed:
function insert_to_ooc(arr, out, lock=…, region=…, return_stored=…) → function insert_to_ooc(arr, out, lock=…, region=…, return_stored=…, load_stored=…) - changed:
function load_chunk(x, index, lock, region) → function load_chunk(out, index, lock) - changed:
function retrieve_from_ooc(keys, dsk) → function retrieve_from_ooc(keys, dsk_pre, dsk_post=…) - changed:
function store_chunk(x, out, index, lock, region, return_stored) → function store_chunk(x, out, index, lock, return_stored) - changed:
method Array.squeeze() → method Array.squeeze(axis=…) - changed:
method Array.to_delayed() → method Array.to_delayed(optimize_graph=…) - changed:
method Array.topk(k) → method Array.topk(k, axis=…, split_every=…) - added:
function broadcast_arrays(*args, **kwargs) - added:
function load_store_chunk(x, out, index, lock, return_stored, load_stored) - added:
method Array.argtopk(k, axis=…, split_every=…)
- added:
function einsum(*operands, **kwargs) - added:
function parse_einsum_input(operands) - added:
variable einsum_can_optimize - added:
variable einsum_symbols - added:
variable einsum_symbols_set
- removed:
function broadcast_to(array, shape, subok=…) - removed:
function full(shape, fill_value, dtype=…, order=…) - removed:
function isclose(*args, **kwargs) - removed:
function nanprod(a, axis=…, dtype=…, out=…, keepdims=…) - removed:
variable full - removed:
variable isclose
- changed:
function merge_percentiles(finalq, qs, vals, Ns, interpolation=…) → function merge_percentiles(finalq, qs, vals, interpolation=…, Ns=…)
- added:
function argtopk(a, k, axis=…, split_every=…) - added:
function topk(a, k, axis=…, split_every=…)
- removed:
function topk(k, x) - added:
function gradient(f, *varargs, **kwargs) - added:
function isin(element, test_elements, assume_unique=…, invert=…) - added:
function piecewise(x, condlist, funclist, *args, **kw)
- added:
variable bitwise_and - added:
variable bitwise_not - added:
variable bitwise_or - added:
variable bitwise_xor
- removed:
variable allclose - changed:
function allclose(a, b, **kwargs) → function allclose(a, b, equal_nan=…, **kwargs) - added:
function safe_wraps(wrapped, assigned=…)
- changed:
class Bag(Base) → class Bag(DaskMethodsMixin) - changed:
class Item(Base) → class Item(DaskMethodsMixin) - changed:
method Bag.to_delayed() → method Bag.to_delayed(optimize_graph=…) - changed:
method Item.to_delayed() → method Item.to_delayed(optimize_graph=…)
- added:
function optimize(*args, **kwargs)
- removed:
class OpenFileCreator(object) - removed:
constructor OpenFileCreator(urlpath, compression=…, text=…, encoding=…, errors=…, **kwargs) - removed:
function ensure_protocol(protocol) - removed:
function get_fs_paths_myopen(urlpath, compression, mode, encoding=…, errors=…, num=…, name_function=…, **kwargs) - removed:
function write_block_to_file(data, lazy_file) - removed:
function write_bytes(data, urlpath, name_function=…, compression=…, encoding=…, **kwargs) - removed:
method FileSystem.get_block_locations(path) - removed:
method FileSystem.logical_size(path, compression) - changed:
constructor OpenFile(myopen, path, compression, mode, text, encoding, errors=…) → constructor OpenFile(fs, path, mode=…, compression=…, encoding=…, errors=…) - changed:
function open_files(urlpath, compression=…, mode=…, encoding=…, errors=…, name_function=…, num=…, **kwargs) → function open_files(urlpath, mode=…, compression=…, encoding=…, errors=…, name_function=…, num=…, **kwargs) - added:
function get_compression(urlpath, compression) - added:
function get_fs(protocol, storage_options=…) - added:
function get_fs_token_paths(urlpath, mode=…, num=…, name_function=…, storage_options=…) - added:
function get_hdfs_driver(driver=…) - added:
function infer_options(urlpath) - added:
function logical_size(fs, path, compression=…)
- added:
function generic_glob(fs, path_impl, pathname)
- added:
class HDFS3HadoopFileSystem(object) - added:
constructor HDFS3HadoopFileSystem(**kwargs) - added:
field HDFS3HadoopFileSystem.sep - added:
method HDFS3HadoopFileSystem.glob(path) - added:
method HDFS3HadoopFileSystem.mkdirs(path) - added:
method HDFS3HadoopFileSystem.open(path, mode=…, **kwargs) - added:
method HDFS3HadoopFileSystem.size(path) - added:
method HDFS3HadoopFileSystem.ukey(path) - added:
static method HDFS3HadoopFileSystem.from_hdfs3(fs)
- added:
class HTTPFile(object) - added:
class HTTPFileSystem(core.FileSystem) - added:
constructor HTTPFile(url, session=…, block_size=…, **kwargs) - added:
constructor HTTPFileSystem(**storage_options) - added:
field HTTPFileSystem.sep - added:
function file_size(url, session, **kwargs) - added:
method HTTPFile.close() - added:
method HTTPFile.flush() - added:
method HTTPFile.read(length=…) - added:
method HTTPFile.readable() - added:
method HTTPFile.seek(where, whence=…) - added:
method HTTPFile.seekable() - added:
method HTTPFile.tell() - added:
method HTTPFile.writable() - added:
method HTTPFile.write() - added:
method HTTPFileSystem.glob(url) - added:
method HTTPFileSystem.mkdirs(url) - added:
method HTTPFileSystem.open(url, mode=…, block_size=…, **kwargs) - added:
method HTTPFileSystem.size(url) - added:
method HTTPFileSystem.ukey(url) - added:
variable DEFAULT_BLOCK_SIZE
- added:
class HDFS3Wrapper(pa.filesystem.DaskFileSystem) - added:
class PyArrowHadoopFileSystem(object) - added:
constructor PyArrowHadoopFileSystem(**kwargs) - added:
field PyArrowHadoopFileSystem.sep - added:
method HDFS3Wrapper.isdir(path) - added:
method HDFS3Wrapper.isfile(path) - added:
method PyArrowHadoopFileSystem.glob(path) - added:
method PyArrowHadoopFileSystem.mkdirs(path) - added:
method PyArrowHadoopFileSystem.open(path, mode=…, **kwargs) - added:
method PyArrowHadoopFileSystem.size(path) - added:
method PyArrowHadoopFileSystem.ukey(path) - added:
static method PyArrowHadoopFileSystem.from_pyarrow(fs)
- removed:
method DaskS3FileSystem.glob(path) - removed:
method DaskS3FileSystem.open(path, mode=…)
- added:
function update_storage_options(options, inherited=…)
- added:
export isna - added:
export read_orc
- added:
function str_extractall(series, pat, flags) - added:
method StringAccessor.extractall(pat, flags=…)
- changed:
class Scalar(Base, OperatorMethodMixin) → class Scalar(DaskMethodsMixin, OperatorMethodMixin) - changed:
function new_dd_object(dsk, _name, meta, divisions) → function new_dd_object(dsk, name, meta, divisions) - changed:
function to_delayed(df) → function to_delayed(df, optimize_graph=…) - changed:
method DataFrame.apply(func, axis=…, args=…, meta=…, **kwds) → method DataFrame.apply(func, axis=…, broadcast=…, raw=…, reduce=…, args=…, meta=…, **kwds) - added:
function handle_out(out, result) - added:
function isna(arg) - added:
method DataFrame.squeeze(axis=…) - added:
method Scalar.to_delayed(optimize_graph=…) - added:
method Series.squeeze()
- removed:
variable delayed
- changed:
function make_timeseries(start, end, dtypes, freq, partition_freq, seed=…) → function make_timeseries(start=…, end=…, dtypes=…, freq=…, partition_freq=…, seed=…)
- added:
function read_orc(path, columns=…, storage_options=…)
- changed:
function read_parquet(path, columns=…, filters=…, categories=…, index=…, storage_options=…, engine=…) → function read_parquet(path, columns=…, filters=…, categories=…, index=…, storage_options=…, engine=…, infer_divisions=…)
- changed:
function read_sql_table(table, uri, index_col, divisions=…, npartitions=…, limits=…, columns=…, bytes_per_chunk=…, **kwargs) → function read_sql_table(table, uri, index_col, divisions=…, npartitions=…, limits=…, columns=…, bytes_per_chunk=…, head_rows=…, schema=…, meta=…, **kwargs)
- added:
function values(df)
- changed:
method Rolling.apply(func, args=…, kwargs=…) → method Rolling.apply(func, args=…, kwargs=…, **kwds)
- added:
method Resampler.agg(agg_funcs, *args, **kwargs)
- changed:
function raise_on_meta_error(funcname=…) → function raise_on_meta_error(funcname=…, udf=…) - added:
function index_summary(idx, name=…)
- changed:
class Delayed(Base, OperatorMethodMixin) → class Delayed(DaskMethodsMixin, OperatorMethodMixin)
- added:
export Callback
- changed:
constructor ProgressBar(minimum=…, width=…, dt=…) → constructor ProgressBar(minimum=…, width=…, dt=…, out=…)
- added:
function cull(dsk, keys) - added:
function default_fused_keys_renamer(keys) - added:
function default_fused_linear_keys_renamer(keys) - added:
function functions_of(task) - added:
function fuse(dsk, keys=…, dependencies=…, ave_width=…, max_width=…, max_height=…, max_depth_new_edges=…, rename_keys=…) - added:
function fuse_getitem(dsk, func, place) - added:
function fuse_linear(dsk, keys=…, dependencies=…, rename_keys=…) - added:
function fuse_selections(dsk, head1, head2, merge) - added:
function inline(dsk, keys=…, inline_constants=…, dependencies=…) - added:
function inline_functions(dsk, output, fast_functions=…, inline_constants=…, dependencies=…) - added:
function key_split(s) - added:
function unwrap_partial(func) - added:
variable hex_pattern
- removed:
function cull(dsk, keys) - removed:
function default_fused_keys_renamer(keys) - removed:
function default_fused_linear_keys_renamer(keys) - removed:
function functions_of(task) - removed:
function fuse(dsk, keys=…, dependencies=…, ave_width=…, max_width=…, max_height=…, max_depth_new_edges=…, rename_keys=…) - removed:
function fuse_getitem(dsk, func, place) - removed:
function fuse_linear(dsk, keys=…, dependencies=…, rename_keys=…) - removed:
function fuse_selections(dsk, head1, head2, merge) - removed:
function inline(dsk, keys=…, inline_constants=…, dependencies=…) - removed:
function inline_functions(dsk, output, fast_functions=…, inline_constants=…, dependencies=…) - removed:
function key_split(s) - removed:
function unwrap_partial(func) - removed:
variable hex_pattern
- removed:
function child_max(dependencies, dependents, scores) - removed:
function dfs(dependencies, dependents, key=…) - added:
class ReverseStrComparable(object) - added:
class StrComparable(object) - added:
constructor ReverseStrComparable(obj) - added:
constructor StrComparable(obj) - added:
function ndependencies(dependencies, dependents)
- added:
function is_arraylike(x) - added:
function natural_sort_key(s)