Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: _write_starting_replication_value for _sync_batches #2878

Open
1 task
ReubenFrankel opened this issue Feb 12, 2025 · 4 comments
Open
1 task

fix: _write_starting_replication_value for _sync_batches #2878

ReubenFrankel opened this issue Feb 12, 2025 · 4 comments
Assignees

Comments

@ReubenFrankel
Copy link
Contributor

Singer SDK Version

0.44.3

Is this a regression?

  • Yes

Python Version

NA

Bug scope

Taps (catalog, state, etc.)

Operating System

Ubuntu 22.04

Description

This is currently present for _sync_records, but not for _sync_batches. This means that given no state, if start_date is set in config and get_starting_timestamp is called from a get_batches implementation, it does not return an initial timestamp for the value of start_date.

Link to Slack/Linen

No response

@ReubenFrankel ReubenFrankel changed the title feat: _write_starting_replication_value for _sync_batches fix: _write_starting_replication_value for _sync_batches Feb 12, 2025
@ReubenFrankel
Copy link
Contributor Author

(sorry, not sure if this is a bug report or feature request)

@ReubenFrankel
Copy link
Contributor Author

The workaround is fairly simple:

        if start_date := self.get_starting_timestamp(context) or (
            "start_date" in self.config
            and datetime.fromisoformat(self.config["start_date"])
        ):
            payload["startDateTime"] = start_date.strftime(r"%Y-%m-%d %H:%M:%S")

@edgarrmondragon
Copy link
Collaborator

(sorry, not sure if this is a bug report or feature request)

I would probably consider it a bug.

The workaround is fairly simple:

You mean on the tap implementation side?

@ReubenFrankel
Copy link
Contributor Author

You mean on the tap implementation side?

Yep.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants