Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add ARCANE_LOAD_TIMESTAMP #143

Open
jeppe742 opened this issue Nov 20, 2024 · 0 comments
Open

[FEATURE] Add ARCANE_LOAD_TIMESTAMP #143

jeppe742 opened this issue Nov 20, 2024 · 0 comments
Labels
code/new-feature New feature or request

Comments

@jeppe742
Copy link

Description

When doing incremental loading of data you are often interested in the timestamp that a row was inserted/created.
In practice you often need the technical timestamp that the row was modified in your ingestion layer, rather than the business date from the source system.
E.g if you have to reload some data, the technical timestamp might be very different from the business timestamp

Possible solution

When Arcane will be responsible for merging the data directly into the target table, if would be great if we could include a column with the current timestamp.
Maybe called ARCANE_LOAD_TIMESTAMP or something, that just contains the current timestamp that the row was modified.

Alternatives

No response

Context

No response

@jeppe742 jeppe742 added the code/new-feature New feature or request label Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code/new-feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant