From b7315560fb36b02a04e4f005d723a719d5f1f09d Mon Sep 17 00:00:00 2001 From: nikki everett Date: Thu, 19 Dec 2024 14:20:32 -0600 Subject: [PATCH] more links Signed-off-by: nikki everett --- .../deployment/deployment-types/serverless/security.md | 4 ++-- .../docs/guides/build/connect-to-external-systems/apis.md | 2 +- .../guides/build/connect-to-external-systems/databases.md | 4 ++-- .../assets-concepts/asset-factories-with-deps.md | 2 +- .../assets-concepts/asset-factories.md | 4 ++-- .../assets-concepts/configuring-assets.md | 2 +- .../docs/guides/build/create-asset-pipelines/data-assets.md | 2 +- .../docs/guides/build/create-asset-pipelines/metadata.md | 2 +- .../build/integrate-with-external-systems/ingesting-data.md | 2 +- docs/docs-beta/docs/guides/operate/io-managers.md | 6 +++--- .../docs-beta/docs/guides/test/unit-tests-assets-and-ops.md | 2 +- 11 files changed, 16 insertions(+), 16 deletions(-) diff --git a/docs/docs-beta/docs/dagster-plus/deployment/deployment-types/serverless/security.md b/docs/docs-beta/docs/dagster-plus/deployment/deployment-types/serverless/security.md index 1996c5fd07abf..bea47ec364c65 100644 --- a/docs/docs-beta/docs/dagster-plus/deployment/deployment-types/serverless/security.md +++ b/docs/docs-beta/docs/dagster-plus/deployment/deployment-types/serverless/security.md @@ -22,11 +22,11 @@ The default I/O manager cannot be used if you are a Serverless user who: - Are otherwise working with data subject to GDPR or other such regulations ::: -In Serverless, code that uses the default [I/O manager](/guides/build/configure/io-managers) is automatically adjusted to save data in Dagster+ managed storage. This automatic change is useful because the Serverless filesystem is ephemeral, which means the default I/O manager wouldn't work as expected. +In Serverless, code that uses the default [I/O manager](/guides/build/connect-to-external-systems/io-managers) is automatically adjusted to save data in Dagster+ managed storage. This automatic change is useful because the Serverless filesystem is ephemeral, which means the default I/O manager wouldn't work as expected. However, this automatic change also means potentially sensitive data could be **stored** and not just processed or orchestrated by Dagster+. -To prevent this, you can use [another I/O manager](/guides/build/configure/io-managers#built-in) that stores data in your infrastructure or [adapt your code to avoid using an I/O manager](/guides/build/configure/io-managers#before-you-begin). +To prevent this, you can use [another I/O manager](/guides/build/connect-to-external-systems/io-managers#built-in) that stores data in your infrastructure or [adapt your code to avoid using an I/O manager](/guides/build/connect-to-external-systems/io-managers#before-you-begin). :::note You must have [boto3](https://pypi.org/project/boto3/) or `dagster-cloud[serverless]` installed as a project dependency otherwise the Dagster+ managed storage can fail and silently fall back to using the default I/O manager. diff --git a/docs/docs-beta/docs/guides/build/connect-to-external-systems/apis.md b/docs/docs-beta/docs/guides/build/connect-to-external-systems/apis.md index 9e6572d468b0a..ef82c10c910ad 100644 --- a/docs/docs-beta/docs/guides/build/connect-to-external-systems/apis.md +++ b/docs/docs-beta/docs/guides/build/connect-to-external-systems/apis.md @@ -11,7 +11,7 @@ When building a data pipeline, you'll likely need to connect to several external To follow the steps in this guide, you'll need: - Familiarity with [Assets](/guides/build/create-asset-pipelines/assets-concepts/index.mdx -- Familiarity with [Resources](/guides/build/configure/resources) +- Familiarity with [Resources](/guides/build/connect-to-external-systems/resources) - To install the `requests` library: ```bash pip install requests diff --git a/docs/docs-beta/docs/guides/build/connect-to-external-systems/databases.md b/docs/docs-beta/docs/guides/build/connect-to-external-systems/databases.md index 3ec3d85a520e0..2e44ed9466cc6 100644 --- a/docs/docs-beta/docs/guides/build/connect-to-external-systems/databases.md +++ b/docs/docs-beta/docs/guides/build/connect-to-external-systems/databases.md @@ -57,5 +57,5 @@ You can also fetch environment variables using the `os` library. Dagster treats ## Next steps -- Explore how to use resources for [Connecting to APIs](/guides/build/configure/apis) -- Go deeper into [Understanding Resources](/guides/build/configure/resources) \ No newline at end of file +- Explore how to use resources for [Connecting to APIs](/guides/build/connect-to-external-systems/apis) +- Go deeper into [Understanding Resources](/guides/build/connect-to-external-systems/resources) \ No newline at end of file diff --git a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories-with-deps.md b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories-with-deps.md index 136960c128e9b..54f929b528565 100644 --- a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories-with-deps.md +++ b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories-with-deps.md @@ -13,7 +13,7 @@ Using an asset factory reduces complexity and creates a pluggable entry point to
Prerequisites -This guide builds upon the concepts in the [asset factories](/guides/build/configure/asset-factories) tutorial. +This guide builds upon the concepts in the [asset factories](/guides/build/connect-to-external-systems/asset-factories) tutorial.
--- diff --git a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories.md b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories.md index 0749298124ee3..c6a0f87bdc330 100644 --- a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories.md +++ b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/asset-factories.md @@ -19,8 +19,8 @@ The asset factory pattern can solve both of these problems. To follow the steps in this guide, you'll need: - Familiarity with: - - [Assets](/guides/build/create-asset-pipelinea/data-assets) - - [Resources](/guides/build/configure/resources) + - [Assets](/guides/build/create-asset-pipelines/data-assets) + - [Resources](/guides/build/connect-to-external-systems/resources) - SQL, YAML and Amazon Web Services (AWS) S3 - [Pydantic](https://docs.pydantic.dev/latest/) and [Jinja2](https://jinja.palletsprojects.com/en/3.1.x/) - A Python virtual environment with the following dependencies installed: diff --git a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/configuring-assets.md b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/configuring-assets.md index 47d3d023cc73b..23d425b0574be 100644 --- a/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/configuring-assets.md +++ b/docs/docs-beta/docs/guides/build/create-asset-pipelines/assets-concepts/configuring-assets.md @@ -45,4 +45,4 @@ This will open the Launchpad, where you can scaffold the config, customize its v ## Next steps - Learn more about Dagster [assets](/guides/build/create-asset-pipelines/assets-concepts/index.mdx -- Connect to external [APIs](/guides/build/configure/apis) and [databases](/guides/build/configure/databases) with resources +- Connect to external [APIs](/guides/build/connect-to-external-systems/apis) and [databases](/guides/build/connect-to-external-systems/databases) with resources diff --git a/docs/docs-beta/docs/guides/build/create-asset-pipelines/data-assets.md b/docs/docs-beta/docs/guides/build/create-asset-pipelines/data-assets.md index f587aff932527..9601d9623159b 100644 --- a/docs/docs-beta/docs/guides/build/create-asset-pipelines/data-assets.md +++ b/docs/docs-beta/docs/guides/build/create-asset-pipelines/data-assets.md @@ -73,4 +73,4 @@ flowchart LR - Learn to create [dependencies between assets](/guides/build/create-asset-pipelines/assets-concepts/asset-dependencies) - Enrich Dagster's built-in data catalog with [asset metadata](/guides/build/create-asset-pipelines/metadata) -- Learn to use a [factory pattern](/guides/build/configure/asset-factories) to create multiple, similar assets +- Learn to use a [factory pattern](/guides/build/connect-to-external-systems/asset-factories) to create multiple, similar assets diff --git a/docs/docs-beta/docs/guides/build/create-asset-pipelines/metadata.md b/docs/docs-beta/docs/guides/build/create-asset-pipelines/metadata.md index ea82cb5cdc16d..fb1ed4e455e59 100644 --- a/docs/docs-beta/docs/guides/build/create-asset-pipelines/metadata.md +++ b/docs/docs-beta/docs/guides/build/create-asset-pipelines/metadata.md @@ -134,7 +134,7 @@ Dagster can automatically attach code references to assets during local developm ### Customizing code references \{#custom-references} -If you want to customize how code references are attached - such as when you are building [domain-specific languages with asset factories](/guides/build/configure/asset-factories) - you can manually add the `dagster/code_references` metadata to asset definitions: +If you want to customize how code references are attached - such as when you are building [domain-specific languages with asset factories](/guides/build/connect-to-external-systems/asset-factories) - you can manually add the `dagster/code_references` metadata to asset definitions: diff --git a/docs/docs-beta/docs/guides/build/integrate-with-external-systems/ingesting-data.md b/docs/docs-beta/docs/guides/build/integrate-with-external-systems/ingesting-data.md index a64f0525df8ac..837c4e9c46be3 100644 --- a/docs/docs-beta/docs/guides/build/integrate-with-external-systems/ingesting-data.md +++ b/docs/docs-beta/docs/guides/build/integrate-with-external-systems/ingesting-data.md @@ -48,5 +48,5 @@ For example, imagine there's a CSV file of counties on the internet and you want ## Next steps -- Transform data using [Dagster's dbt integration](/guides/build/integrate/transform-dbt) +- Transform data using [Dagster's dbt integration](/guides/build/integrate-with-external-systems/transform-dbt) - Use asset checks [to test data quality](/guides/test/asset-checks) and [freshness](/guides/test/data-freshness-testing) \ No newline at end of file diff --git a/docs/docs-beta/docs/guides/operate/io-managers.md b/docs/docs-beta/docs/guides/operate/io-managers.md index c9caecd47e914..c3f41fa5e7abc 100644 --- a/docs/docs-beta/docs/guides/operate/io-managers.md +++ b/docs/docs-beta/docs/guides/operate/io-managers.md @@ -18,7 +18,7 @@ For assets that follow this pattern, an I/O manager can streamline the code that To follow the steps in this guide, you'll need familiarity with: - [Assets](/guides/build/create-asset-pipelines/assets-concepts/index.mdx -- [Resources](/guides/build/configure/resources) +- [Resources](/guides/build/connect-to-external-systems/resources) ## Before you begin @@ -82,5 +82,5 @@ Dagster offers built-in library implementations for I/O managers for popular dat ## Next steps -- Learn to [connect databases](/guides/build/configure/databases) with resources -- Learn to [connect APIs](/guides/build/configure/apis) with resources \ No newline at end of file +- Learn to [connect databases](/guides/build/connect-to-external-systems/databases) with resources +- Learn to [connect APIs](/guides/build/connect-to-external-systems/apis) with resources \ No newline at end of file diff --git a/docs/docs-beta/docs/guides/test/unit-tests-assets-and-ops.md b/docs/docs-beta/docs/guides/test/unit-tests-assets-and-ops.md index 3ee85fc1cd0d4..951e6c1097f31 100644 --- a/docs/docs-beta/docs/guides/test/unit-tests-assets-and-ops.md +++ b/docs/docs-beta/docs/guides/test/unit-tests-assets-and-ops.md @@ -108,4 +108,4 @@ If an asset or op has multiple parameters, it's recommended to use keyword argum - Learn more about assets in [Understanding Assets](/guides/build/create-asset-pipelines/assets-concepts/index.mdx - Learn more about ops in [Understanding Ops](/guides/build/ops-jobs) -- Learn more about resources in [Resources](/guides/build/configure/resources) \ No newline at end of file +- Learn more about resources in [Resources](/guides/build/connect-to-external-systems/resources) \ No newline at end of file