Upgrading dask 0.9 to 0.10
Unknown0.9.0 → 0.10.2
UnknownUpgrade verdict
None of the 3 releases in this range publish notes, so breaking changes can't be ruled out.
In plain terms
- Some releases in this range publish no notes, so DepDelta can't rule out breaking changes.
- Their commits are listed with this comparison.
Must act Unknown for releases without notes
Releases without notes may still need changes. Check their commits before upgrading.
API changes
Generated by DepDelta from published Python source. Not mixed with prose notes.
- added:
export digitize
- changed:
function getem(arr, chunks, shape=…) → function getem(arr, chunks, shape=…, out_name=…) - added:
function digitize(a, bins, right=…)
- added:
method RandomState.multinomial(n, pvals, size=…, chunks=…) - added:
variable multinomial
- changed:
method Bag.groupby(grouper, npartitions=…, blocksize=…) → method Bag.groupby(grouper, method=…, npartitions=…, blocksize=…, max_branch=…) - added:
function accumulate_part(binop, seq, initial, is_first=…) - added:
function empty_safe_aggregate(func, parts) - added:
function empty_safe_apply(func, part) - added:
function groupby_disk(b, grouper, npartitions=…, blocksize=…) - added:
function groupby_tasks(b, grouper, hash=…, max_branch=…) - added:
function make_group(k, stage) - added:
method Bag.accumulate(binop, initial=…) - added:
method Bag.random_sample(prob, random_state=…) - added:
method Bag.unzip(n)
- changed:
function read_text(path, blocksize=…, compression=…, encoding=…, errors=…, linedelimiter=…, collection=…, **kwargs) → function read_text(urlpath, blocksize=…, compression=…, encoding=…, errors=…, linedelimiter=…, collection=…, storage_options=…)
- changed:
function open_files(path, compression=…, **kwargs) → function open_files(urlpath, compression=…, **kwargs) - changed:
function open_text_files(path, encoding=…, errors=…, compression=…, **kwargs) → function open_text_files(urlpath, encoding=…, errors=…, compression=…, **kwargs) - changed:
function read_bytes(path, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…, **kwargs) → function read_bytes(urlpath, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…, **kwargs) - added:
function ensure_protocol(protocol) - added:
function open_files_by(open_files_backend, path, compression=…, **kwargs)
- changed:
function getsize(fn, compression=…) → function getsize(path, compression=…) - changed:
function read_block_from_file(fn, offset, length, delimiter, compression) → function read_block_from_file(path, offset, length, delimiter, compression) - changed:
function read_bytes(fn, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…) → function read_bytes(path, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…)
- changed:
function open_files(path, s3=…, **s3_params) → function open_files(path, s3=…, **kwargs) - changed:
function read_block_from_s3(filename, offset, length, s3_params=…, delimiter=…, compression=…) → function read_block_from_s3(path, offset, length, s3=…, delimiter=…, compression=…, **kwargs) - changed:
function read_bytes(path, s3=…, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…, **s3_params) → function read_bytes(path, s3=…, delimiter=…, not_zero=…, blocksize=…, sample=…, compression=…, **kwargs) - changed:
function s3_open_file(path, s3_params) → function s3_open_file(path, s3=…, **kwargs)
- added:
variable zip
- changed:
function get(d, key, get=…, **kwargs) → function get(d, x, recursive=…) - added:
function has_tasks(dsk, x)
- changed:
function bytes_read_csv(b, header, kwargs, dtypes=…, columns=…) → function bytes_read_csv(b, header, kwargs, dtypes=…, columns=…, write_header=…, enforce=…) - changed:
function read_csv(filename, blocksize=…, chunkbytes=…, collection=…, lineterminator=…, compression=…, enforce_dtypes=…, sample=…, **kwargs) → function read_csv(urlpath, blocksize=…, chunkbytes=…, collection=…, lineterminator=…, compression=…, sample=…, enforce=…, storage_options=…, **kwargs) - changed:
function read_csv_from_bytes(block_lists, header, head, kwargs, collection=…, enforce_dtypes=…) → function read_csv_from_bytes(block_lists, header, head, kwargs, collection=…, enforce=…) - added:
function auto_blocksize(total_memory, cpu_count) - added:
variable AUTO_BLOCKSIZE - added:
variable CPU_COUNT - added:
variable TOTAL_MEM - added:
variable psutil
- changed:
function hash_join(lhs, left_on, rhs, right_on, how=…, npartitions=…, suffixes=…) → function hash_join(lhs, left_on, rhs, right_on, how=…, npartitions=…, suffixes=…, shuffle=…) - changed:
function merge(left, right, how=…, on=…, left_on=…, right_on=…, left_index=…, right_index=…, suffixes=…, npartitions=…) → function merge(left, right, how=…, on=…, left_on=…, right_on=…, left_index=…, right_index=…, suffixes=…, npartitions=…, shuffle=…, max_branch=…) - added:
function single_partition_join(left, right, **kwargs) - added:
variable shuffle_func
- added:
function create_merge_tree(func, keys, token) - added:
function dtype_info(df) - added:
function merge_and_compress_summaries(vals_and_weights) - added:
function partition_quantiles(df, npartitions, upsample=…, random_state=…) - added:
function percentiles_summary(df, num_old, num_new, upsample=…, random_state=…) - added:
function percentiles_to_weights(qs, vals, length) - added:
function process_val_weights(vals_and_weights, npartitions, dtype_info) - added:
function sample_percentiles(num_old, num_new, chunk_length, upsample=…, random_state=…) - added:
function tree_groups(N, num_groups) - added:
function tree_width(N, to_binary=…)
- added:
class Rolling(object) - added:
constructor Rolling(obj, window=…, min_periods=…, freq=…, center=…, win_type=…, axis=…) - added:
function call_pandas_rolling_method_single(this_partition, rolling_kwargs, method_name, method_args, method_kwargs) - added:
function call_pandas_rolling_method_with_neighbors(prev_partition, this_partition, next_partition, before, after, rolling_kwargs, method_name, method_args, method_kwargs) - added:
function head(obj, n) - added:
function tail(obj, n) - added:
method Rolling.apply(*args, **kwargs) - added:
method Rolling.count(*args, **kwargs) - added:
method Rolling.kurt(*args, **kwargs) - added:
method Rolling.max(*args, **kwargs) - added:
method Rolling.mean(*args, **kwargs) - added:
method Rolling.median(*args, **kwargs) - added:
method Rolling.min(*args, **kwargs) - added:
method Rolling.quantile(*args, **kwargs) - added:
method Rolling.skew(*args, **kwargs) - added:
method Rolling.std(*args, **kwargs) - added:
method Rolling.sum(*args, **kwargs) - added:
method Rolling.var(*args, **kwargs)
- removed:
function new_categories(categories, index) - removed:
function partition(df, index, npartitions, p) - changed:
function collect(group, p, meta, barrier_token) → function collect(p, part, meta, barrier_token) - changed:
function set_index(df, index, npartitions=…, compute=…, drop=…, **kwargs) → function set_index(df, index, npartitions=…, shuffle=…, compute=…, drop=…, upsample=…, **kwargs) - changed:
function set_partition(df, index, divisions, compute=…, drop=…, **kwargs) → function set_partition(df, index, divisions, max_branch=…, drop=…, shuffle=…, compute=…) - changed:
function shuffle(df, index, npartitions=…) → function shuffle(df, index, shuffle=…, npartitions=…, max_branch=…, compute=…) - added:
function rearrange_by_column(df, col, npartitions=…, max_branch=…, shuffle=…, compute=…) - added:
function rearrange_by_column_disk(df, column, npartitions=…, compute=…) - added:
function rearrange_by_column_tasks(df, column, max_branch=…, npartitions=…) - added:
function rearrange_by_divisions(df, column, divisions, max_branch=…, shuffle=…) - added:
function set_index_post_scalar(df, index_name, drop, column_dtype) - added:
function set_index_post_series(df, index_name, drop, column_dtype) - added:
function set_partitions_pre(s, divisions) - added:
function shuffle_group(df, col, stage, k, npartitions) - added:
function shuffle_group_2(df, col) - added:
function shuffle_group_3(df, col, npartitions, p) - added:
function shuffle_group_get(g_head, i)
- added:
variable graphviz
- removed:
function identity(x) - changed:
function dealias(dsk, keys=…) → function dealias(dsk, keys=…, dependencies=…)
- added:
function build_name_function(max_int) - added:
function dependency_depth(dsk) - added:
function digit(n, k, base) - added:
function import_required(mod_name, error_msg) - added:
function infer_storage_options(urlpath, inherit_storage_options=…) - added:
function insert(tup, loc, val) - added:
function tmpdir(dir=…)
- removed:
class GetFunctionTestCase(unittest.TestCase) - removed:
field GetFunctionTestCase.get - removed:
method GetFunctionTestCase.runTest() - removed:
method GetFunctionTestCase.test_badkey() - removed:
method GetFunctionTestCase.test_data_not_in_dict_is_ok() - removed:
method GetFunctionTestCase.test_get() - removed:
method GetFunctionTestCase.test_get_stack_limit() - removed:
method GetFunctionTestCase.test_get_with_list() - removed:
method GetFunctionTestCase.test_get_with_nested_list() - removed:
method GetFunctionTestCase.test_get_works_with_unhashables_in_values() - removed:
method GetFunctionTestCase.test_nested_badkey() - removed:
method GetFunctionTestCase.test_nested_tasks() - added:
class GetFunctionTestMixin(object) - added:
field GetFunctionTestMixin.get - added:
method GetFunctionTestMixin.test_badkey() - added:
method GetFunctionTestMixin.test_data_not_in_dict_is_ok() - added:
method GetFunctionTestMixin.test_get() - added:
method GetFunctionTestMixin.test_get_stack_limit() - added:
method GetFunctionTestMixin.test_get_with_list() - added:
method GetFunctionTestMixin.test_get_with_list_top_level() - added:
method GetFunctionTestMixin.test_get_with_nested_list() - added:
method GetFunctionTestMixin.test_get_works_with_unhashables_in_values() - added:
method GetFunctionTestMixin.test_nested_badkey() - added:
method GetFunctionTestMixin.test_nested_tasks()