v0.4.0

This is the release notes of v0.4.0. See here for the complete list of solved issues and merged PRs.

This release note only covers the difference from v0.4.0rc1; for all highlights and changes, please refer to the release notes of the pre-releases:

• alpha1
• alpha2
• beta1
• beta2
• rc1

Changes that break compatibility

• Calling .execute() will no longer return numpy ndarray, pandas DataFrame and so forth, but will return Mars tensor, DataFrame itself instead. Only corner data will be fetched for display purpose. In order to explicitly convert to numpy ndarray, please call .to_numpy(), at the same time, call .to_pandas() to convert to pandas DataFrame. For more details, please refer to #1201.

Highlights

• Remote API is introduced and preliminarily supported in #1239, for more details, refer to proposal #1227.

New Features

• Tensor
  • Implements mt.trapz (#1223)
• DataFrame
  • Add support of {DataFrame,Series}.ewm (#1198)
  • Add dataframe.unique support (#1225)
  • Implements md.to_datetime, support __setitem__ for DataFrame as well (#1226)
  • Add support for Series.astype and DataFrame.astype (#1237)
• Learn
  • Support Mars Series in PyTorch Dataset (#1194)
  • Implements mars.learn.metrics.{roc_curve, auc} (#1233)
• Others
  • Add preliminary remote function support (#1239)

Enhancements

• Tileable.execute() now will return Tileable itself, repr will act correctly (#1202)
• Rename LocalClusterSession to ClusterSession (#1236)

Bug fixes

• Fix serialization for mars.learn.utils.shuffle (#1193)
• Fix error in starting local cluster with IPython & latest gevent version (#1234)
• Fix wrong result of column pruning (#1235)