Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clashing DuckDB database access #10

Open
EJOOSTEROP opened this issue Apr 18, 2023 · 0 comments
Open

Clashing DuckDB database access #10

EJOOSTEROP opened this issue Apr 18, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@EJOOSTEROP
Copy link
Owner

In at least the following scenarios the DuckDB database file cannot be read:

  1. When an ELT pipeline is running, Superset cannot access the database at the same time and all the graphs on the dashboard fail. Workaround: wait for the ELT pipeline to complete.
  2. When a Superset dashboard contains multiple graphs, at most one will be shown when looking at the dashboard. The others have error messages. Workaround: manually refresh each graph in the Superset UI.
  3. When multiple ELT pipelines run at the same time, some will fail. Workaround: re-run the failed jobs.

This is understood to be at least a partially fixable issue (have Superset open the database file with read-only privileges). Though I don't know how at the moment.

There is unlikely to be a DuckDB fix to avoid ELT clashes (as ELT needs write access to the database file).

@EJOOSTEROP EJOOSTEROP added the bug Something isn't working label Apr 18, 2023
@EJOOSTEROP EJOOSTEROP pinned this issue Apr 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant