From 4cc5726eb98d9685ee2656e66834ba99afb1cd34 Mon Sep 17 00:00:00 2001 From: colton Date: Fri, 20 Dec 2024 10:03:50 -0500 Subject: [PATCH] [docs] add note of defer_table_reflect to dlt docs (#26628) ## Summary & Motivation - A community member pointed out that by setting this you can reduce the reads on your database when the Dagster daemon polls to refresh definitions image Closes https://github.com/dagster-io/dagster/issues/26627 ## How I Tested These Changes ## Changelog NOCHANGELOG --- docs/content/integrations/embedded-elt/dlt.mdx | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/content/integrations/embedded-elt/dlt.mdx b/docs/content/integrations/embedded-elt/dlt.mdx index fb9f62066834b..b81e9c551b53f 100644 --- a/docs/content/integrations/embedded-elt/dlt.mdx +++ b/docs/content/integrations/embedded-elt/dlt.mdx @@ -183,6 +183,16 @@ The In the same file containing your Dagster assets, you can create an instance of your by doing something like the following: + + If you are using the{" "} + + sql_database + {" "} + source, consider setting defer_table_reflect=True to reduce + database reads. By default, the Dagster daemon will refresh definitions + roughly every minute, which will query the database for resource definitions. + + ```python from dagster import AssetExecutionContext, Definitions from dagster_embedded_elt.dlt import DagsterDltResource, dlt_assets