Skip to content

v0.3.0a1

Pre-release
Pre-release
Compare
Choose a tag to compare
@qinxuye qinxuye released this 24 Aug 04:05
· 1039 commits to master since this release
v0.3.0a1
7481bd6

This is the release notes of v0.3.0a1. See here for the complete list of solved issues and merged PRs.

Highlights

  • Running on Kubernetes is supported now, for the usage please refer to docs.

New Features

  • Add support for kubernetes (#644)
  • Tensor
    • Implement scipy.special.gammaln for Mars tensor (#623)
    • Add F-order support for tensor (#595)
    • Implements scipy.special.erf for Mars tensor (#635)
    • Add searchsorted support (#628)
  • DataFrame
    • Support add scalar with dataframe (#582)
    • Implements DataFrame.from_records. (#618)
    • Support DataFrame sum (#591)
    • Implementation of Dataframe.merge/join by shuffle (#574)
    • Implements DataFrame.set_index, DataFrame.iloc. (#638)
    • Support getitem with labels for Series or column names for DataFrame (#682)
  • Machine learning
    • Add PCA decomposition algorithm support (#639)
    • Add TruncatedSVD decomposition algorithm support (#686)

Enhancements

  • Move optimizes out of tensor to make it universal. (#598)
  • Extract scheduler discoverer from cluster_info (#611)
  • Support create mars session with given session_id. (#600)
  • Add F-order support for tensor (#595)
  • Get more accurate memory stats from cgroup memory.stat in containers (#632)
  • Use numpy only to calculate fft (#646)
  • Generate seed instead of RandomState in tile of RandomOperand (#648)
  • Remove conjugate in tile of Cholesky which effects performance heavily (#658)
  • Extend the max_buffer_size of tornado server to 4G. (#679)
  • Refactor storage management in worker (#353)
  • Reuse sealer actor on the same worker. (#692)

Bug fixes

  • Backport patch from pyarrow. (#589)
  • Fix proto-serialization for certain dtypes. (#592)
  • Fix web connection error when running in Docker (#567)
  • Fix the default value parsing of open_browser (#602)
  • Fix shuffle failover error in cases (#616)
  • Fix mutable tensor related bugs and some enhancement (#601)
  • Fix infer_index_value when one of input indexes is RangeIndex (#624)
  • Fix readable_size accuracy issue under python2 (#641)
  • Fix compose issues when build chunk graph (#643)
  • Preserve table order while refreshing its contents (#651)
  • Fix the wrong shape of chunks in SVD (#656)
  • Check disks before adding into spill targets (#654)
  • Generate unique key for chunks of mutable tensors which have identical properties (#660)
  • Raise an error when Python version between client and server is different (#671)
  • Support tokenize nested dict in mars.utils.tokenize (#673)
  • Fix bug that set value to copied tensor still changed the original one (#675)
  • Add missing size estimation function for TensorDot (#677)
  • Ensure remaining data removed on session close (#690)
  • Fix bug in creating dataframe from identical tensor. (#695)
Assets 2
Loading