v0.5.0a1

This is the release notes of v0.5.0a1. See here for the complete list of solved issues and merged PRs.

Changes that break compatibility

• Calling .execute() will no longer return numpy ndarray, pandas DataFrame and so forth, but will return Mars tensor, DataFrame itself instead. Only corner data will be fetched for display purpose. In order to explicitly convert to numpy ndarray, please call .to_numpy(), at the same time, call .to_pandas() to convert to pandas DataFrame. For more details, please refer to #1201.

Highlights

• Remote API is introduced and preliminarily supported in #1238, for more details, refer to proposal #1227.
• Running on Yarn is preliminarily supported in #1210.

New Features

• Tensor
  • Implements mt.trapz (#1205)
• DataFrame
  • Add support of {DataFrame,Series}.ewm (#1164)
  • Add dataframe.unique support (#1208)
  • Implements md.to_datetime, support __setitem__ for DataFrame as well (#1207)
  • Add support for Series.astype and DataFrame.astype (#1224)
• Learn
  • Support Mars Series in PyTorch Dataset (#1190)
  • Implements mars.learn.metrics.{roc_curve, auc} (#1220)
• Others
  • Add preliminary support for Yarn (#1210)
  • Add preliminary remote function support (#1238)

Enhancements

• Make Tileable.execute() return tileable itself, fetching corner data only for correct repr (#1201)
• Allow some operands to fail fast (#1229)
• Rename LocalClusterSession to ClusterSession (#1230)

Bug fixes

• Fix serialization for mars.learn.utils.shuffle (#1192)
• Fix wrong result of column pruning (#1215)
• Fix error in starting local cluster with IPython (#1232)

Documentation

• Add learn docs (#1182)
• Add translation for learn docs (#1183)
• Add documentations for DataFrame arithmetic operands (#1191)
• Add logo in readme and docs (#1213)

Tests

• Workaround for upgraded tiledb (#1195)