Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move staging to prod #74

Merged
merged 45 commits into from
Sep 9, 2024
Merged

Move staging to prod #74

merged 45 commits into from
Sep 9, 2024

Conversation

Mara3l
Copy link
Collaborator

@Mara3l Mara3l commented Sep 9, 2024

No description provided.

jaceksan added 30 commits May 20, 2024 18:15
My laptop is now 24.04 with Python 3.12 and it works with latest Jupyter.

I had to fix the notebook, breaking changes were delivered to python SDK.

I redirected the notebook to DEV organization running on top of MotherDuck.
Generates circa 100MB of parquet files in under 90 seconds
Data generator for real-time use cases
Separated from the rest of the repository
We may merge it in the future
ELT + GoodData
DuckDB + Redshift
E2E solution for real-time demo
real-time: unify config with ENV vars
real-time: change S3 bucket name
make GoodData part work
Use the correct S3 and Redshift
Set all env variables correctly
realtime - do not generate duplicate fact IDs
new data folder structure reflecting full refresh and incremental tables.
realtime - full-refresh/incremental
@jaceksan jaceksan deployed to staging_cloud December 28, 2024 04:38 — with GitHub Actions Active
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants