Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TDL-25626] Fix integration test failures #72

Merged
merged 13 commits into from
May 8, 2024

Conversation

shantanu73
Copy link
Contributor

@shantanu73 shantanu73 commented Apr 22, 2024

Description of change

  1. Fixed All fields test.
  2. Fixed Automatic fields test.
  3. Fixed Bookmarking test.
  4. Fixed Start date test.
  5. Fixed Pagination test.
  6. Fixed Interrupted sync test.
  7. X-fail Parent Child test.

Manual QA steps

  • Ran tap-tester locally
  • Ran tap-tester for customer credentials and verified that all tests are working fine

Risks

  • Low risk

Rollback steps

  • revert this branch

@rdeshmukh15
Copy link
Contributor

Have you verified whether the data is truly unavailable by retroactively examining the start_date for all the untestable streams?

1. Added an earlier start date to include more testable streams.
2. Added message to remove code to X-fail parent child integration test once data is available for testing.
@shantanu73
Copy link
Contributor Author

Have you verified whether the data is truly unavailable by retroactively examining the start_date for all the untestable streams?

After checking records dating back to 2010 for the start date, no data was found. Consequently, the pertinent streams are being labeled as untestable.

@shantanu73 shantanu73 requested a review from sgandhi1311 May 7, 2024 06:00
@@ -51,6 +63,22 @@ def calculated_states_by_stream(self, current_state):
return stream_to_calculated_state

def test_run(self):
# Created card for untestable/unstable streams.
# FIX CARD: https://jira.talendforge.org/browse/TDL-17035
# The stream: "conversation_parts" is child stream and bookmark is being written of parent stream. Thus, skipping the stream
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we are writing the bookmarks for the child over here -

state = singer.write_bookmark(state,

Can you please verify once?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since child streams use the bookmark set by parents stream, thus we don't need to test child stream bookmarking.
I'll update the comment in the code to reflect the same message.

@shantanu73 shantanu73 merged commit 8c6bbc5 into master May 8, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants