PIPELINE-2293 Fixed thin_port_messages error for a date in which no port events are detected #109
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* update regions * remove bad eten peru anchorages * remove pipe-tools dependencies * reduce changes relative to master * switch to using Dockerfile-scheduler in Dockerfile compose * fix requirements and other docker infrastructure to run name_anchorages using Docker on Dataflow. * update numpy due to security vulnerability Co-authored-by: Nate Miller <[email protected]>
…ery and adjust the format string exp according to the amount of args
…lass in py8, shard port_state by last_timestamp
…ot be created directly
…ks superficially plausible
…am[gcp] to authenticate and remove numpy reference that comes already in the DF SDK 2.40.0
Improve memory efficiency
Moves to py3.8
…sting overrides and those Hannah commited to Master
…nd labes of output tables
Several changes to update the read/write transfors and descriptions and labels
…iming out queries
Split read transform to avoid getting timeout
…lways reported oldest seg_id. Fixed by updating seg_id for each message
Pipe-v3: Adds support for AB-2.49
Fix seg_id in port_visits events
…h the implementation
Remove unused technical fields in port_visits
… and trip_end should not be the same
…dds abstractions in some places
Voyages from BigQuery to Apache Beam
Feature/pipeline 1031
Fixes the voyages trip_id and vessel_id description column
Adds voyages calculation using voyages simplified BQ queries
Update voyages table description to reflect open voyages usage
Relocates the images of the project under new path
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
https://globalfishingwatch.atlassian.net/browse/PIPELINE-2293