Skip to content

Delta Sharing Python 1.3.0

Compare
Choose a tag to compare
@PatrickJin-db PatrickJin-db released this 18 Dec 21:49
· 9 commits to main since this release

We are excited to announce the release of Delta Sharing Python 1.3 which includes support for CDF queries on shared tables with deletion vectors (DV) enabled on the source table. (#613)

Limitations:

  • If DV is enabled, use_delta_format=True must be specified when calling load_table_changes_to_pandas.
    • Note that unlike load_as_pandas, load_table_changes_to_pandas will NOT auto-resolve to delta format if advanced features (like DV) are enabled.
  • CDF queries with use_delta_format=True will fail if the schema changed during the queried version range.
  • CDF queries on tables with column mappings do not work yet.

Credits: Patrick Jin, Lin Zhou