Delta Sharing Python 1.3.0
We are excited to announce the release of Delta Sharing Python 1.3 which includes support for CDF queries on shared tables with deletion vectors (DV) enabled on the source table. (#613)
Limitations:
- If DV is enabled,
use_delta_format=True
must be specified when callingload_table_changes_to_pandas
.- Note that unlike
load_as_pandas
,load_table_changes_to_pandas
will NOT auto-resolve to delta format if advanced features (like DV) are enabled.
- Note that unlike
- CDF queries with
use_delta_format=True
will fail if the schema changed during the queried version range. - CDF queries on tables with column mappings do not work yet.
Credits: Patrick Jin, Lin Zhou