This repository has been archived by the owner on Sep 23, 2024. It is now read-only.
Partial update of records will set all non-PK columns to null #275
Labels
bug
Something isn't working
Describe the bug
When using the Postgres tap with log-based replication a delete will generate a record message that only contains the primary key properties and metadata columns like
_sdc_deleted_at
. This will cause the Snowflake target to reset all other columns tonull
as theMERGE
query does no distinguish between missing columns in the record message and columns that are trulynull
.This behaviour doesn't matter much when you are using hard-delete and are going to delete the row in the target anyway. However, when you actually want to keep deleted source data in your DWH then it's a big problem.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A partial update should not set unaffected columns to
null
Your environment
The text was updated successfully, but these errors were encountered: