Error - dagster_dbt.errors.DagsterDbtCliRuntimeError: The dbt CLI process with command dbt parse --quiet failed with exit code 1. Check the stdout in the Dagster compute logs for the full information about the error.

[aj211191]

Hi All,
I am very new to dagster and trying to orchestrate dbt. I get the error below. I did run 'dbt debug' and 'dbt run' commands and they ran successfully. Also ran 'dbt parse --quiet' which was also successful. Tried chatgpt, but also was not able to debug this. Any help is appreciated.

**dagster._core.errors.DagsterUserCodeLoadError: Error occurred during the loading of Dagster definitions in
executable_path=..\AppData\Local\Programs\Python\Python311\python.exe, module_name=dbt_dagster_project.definitions, working_directory=..\dbt_dagster_project**

  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_grpc\server.py", line 421, in __init__
    self._loaded_repositories: Optional[LoadedRepositories] = LoadedRepositories(
                                                              ^^^^^^^^^^^^^^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_grpc\server.py", line 244, in __init__
    with user_code_error_boundary(
  File "..\AppData\Local\Programs\Python\Python311\Lib\contextlib.py", line 155, in __exit__
    self.gen.throw(typ, value, traceback)
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_core\errors.py", line 297, in user_code_error_boundary
    raise new_error from e

**The above exception was caused by the following exception:
dagster_dbt.errors.DagsterDbtCliRuntimeError: The dbt CLI process with command

`dbt parse --quiet`

failed with exit code `1`. Check the stdout in the Dagster compute logs for the full information about the error.**

  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_core\errors.py", line 287, in user_code_error_boundary
    yield
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_grpc\server.py", line 255, in __init__
    loadable_targets = get_loadable_targets(
                       ^^^^^^^^^^^^^^^^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_grpc\utils.py", line 50, in get_loadable_targets
    else loadable_targets_from_python_module(module_name, working_directory)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_core\workspace\autodiscovery.py", line 30, in loadable_targets_from_python_module
    module = load_python_module(
             ^^^^^^^^^^^^^^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_core\code_pointer.py", line 134, in load_python_module
    return importlib.import_module(module_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\importlib\__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1149, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "..\Desktop\dbtprc\dbt_dagster_project\dbt_dagster_project\definitions.py", line 3, in <module>
    from .assets import dbtjaffle_dbt_assets
  File "..\Desktop\dbtprc\dbt_dagster_project\dbt_dagster_project\assets.py", line 4, in <module>
    from .project import dbtjaffle_project
  File "..\Desktop\dbtprc\dbt_dagster_project\dbt_dagster_project\project.py", line 9, in <module>
    dbtjaffle_project.prepare_if_dev()
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\dbt_project.py", line 295, in prepare_if_dev
    self.preparer.prepare_if_dev(self)
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\dbt_project.py", line 78, in prepare_if_dev
    self.prepare(project)
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\dbt_project.py", line 106, in prepare
    run_with_concurrent_update_guard(
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster\_utils\__init__.py", line 837, in run_with_concurrent_update_guard
    update_fn(**kwargs)
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\dbt_project.py", line 130, in _prepare_manifest
    .wait()
     ^^^^^^
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\core\dbt_cli_invocation.py", line 204, in wait
    list(self.stream_raw_events())
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\core\dbt_cli_invocation.py", line 367, in stream_raw_events
    self._raise_on_error()
  File "..\AppData\Local\Programs\Python\Python311\Lib\site-packages\dagster_dbt\core\dbt_cli_invocation.py", line 460, in _raise_on_error
    raise error

[garethbrickman]

Is there any additional logging in your terminal before the error you posted? Like right after you run dagster dev copy everything thereafter.

Another possible gotcha to verify is if dbt Cloud CLI is installed instead of the dbt Core CLI: #20205 (comment)

[aj211191]

Thank you Gareth!
I do see an error - Encountered an error loading configuration: dbt_cloud.yml credentials file for dbt Cloud not found. Download your credentials file from dbt Cloud to ..\.dbt. . Do I need to uninstall dbt Cloud CLI?

[garethbrickman]

For compatibility, both the dbt Cloud CLI and dbt Core are invoked by running dbt. This can create path conflicts if your operating system selects one over the other based on your $PATH environment variable (settings).

If you have dbt Core installed locally, either:

1. Install using the pip3 install dbt pip command.
2. Install natively, ensuring you either deactivate the virtual environment containing dbt Core or create an alias for the dbt Cloud CLI.
3. (Advanced users) Install natively, but modify the $PATH environment variable to correctly point to the dbt Cloud CLI binary to use both dbt Cloud CLI and dbt Core together.

You can always uninstall the dbt Cloud CLI to return to using dbt Core.