You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When doing incremental loading of data you are often interested in the timestamp that a row was inserted/created.
In practice you often need the technical timestamp that the row was modified in your ingestion layer, rather than the business date from the source system.
E.g if you have to reload some data, the technical timestamp might be very different from the business timestamp
Possible solution
When Arcane will be responsible for merging the data directly into the target table, if would be great if we could include a column with the current timestamp.
Maybe called ARCANE_LOAD_TIMESTAMP or something, that just contains the current timestamp that the row was modified.
Alternatives
No response
Context
No response
The text was updated successfully, but these errors were encountered:
Description
When doing incremental loading of data you are often interested in the timestamp that a row was inserted/created.
In practice you often need the technical timestamp that the row was modified in your ingestion layer, rather than the business date from the source system.
E.g if you have to reload some data, the technical timestamp might be very different from the business timestamp
Possible solution
When Arcane will be responsible for merging the data directly into the target table, if would be great if we could include a column with the current timestamp.
Maybe called
ARCANE_LOAD_TIMESTAMP
or something, that just contains the current timestamp that the row was modified.Alternatives
No response
Context
No response
The text was updated successfully, but these errors were encountered: