diff --git a/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte-cloud.md b/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte-cloud.md index e4e6233e428b8..30b5ca31ba6f2 100644 --- a/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte-cloud.md +++ b/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte-cloud.md @@ -15,6 +15,8 @@ categories: enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/airbyte.svg --- This guide provides instructions for using Dagster with Airbyte Cloud using the `dagster-airbyte` library. Your Airbyte Cloud connection tables can be represented as assets in the Dagster asset graph, allowing you to track lineage and dependencies between Airbyte Cloud assets and data assets you are already modeling in Dagster. You can also use Dagster to orchestrate Airbyte Cloud connections, allowing you to trigger syncs for these on a cadence or based on upstream data changes. diff --git a/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte.md b/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte.md index 36e160f2986d9..5e11a530946b2 100644 --- a/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte.md +++ b/docs/docs-beta/docs/integrations/libraries/airbyte/airbyte.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-airbyte docslink: https://docs.dagster.io/integrations/airbyte partnerlink: https://airbyte.com/tutorials/orchestrate-data-ingestion-and-transformation-pipelines -logo: /integrations/airbyte.svg categories: - ETL enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/airbyte.svg --- - - Using this integration, you can trigger Airbyte syncs and orchestrate your Airbyte connections from within Dagster, making it easy to chain an Airbyte sync with upstream or downstream steps in your workflow. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/athena.md b/docs/docs-beta/docs/integrations/libraries/aws/athena.md index f28c6a5a8fae3..c324e11ee0b58 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/athena.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/athena.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-athena.svg categories: - Storage enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/aws-athena.svg --- - - This integration allows you to connect to AWS Athena, a serverless interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Using this integration, you can issue queries to Athena, fetch results, and handle query execution states within your Dagster pipelines. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/cloudwatch.md b/docs/docs-beta/docs/integrations/libraries/aws/cloudwatch.md index 8f27e767cd512..8465ce361faa2 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/cloudwatch.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/cloudwatch.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-cloudwatch.svg categories: - Monitoring enabledBy: enables: tags: [dagster-supported, monitoring] +sidebar_custom_props: + logo: images/integrations/aws-cloudwatch.svg --- - - This integration allows you to send Dagster logs to AWS CloudWatch, enabling centralized logging and monitoring of your Dagster jobs. By using AWS CloudWatch, you can take advantage of its powerful log management features, such as real-time log monitoring, log retention policies, and alerting capabilities. Using this integration, you can configure your Dagster jobs to log directly to AWS CloudWatch, making it easier to track and debug your workflows. This is particularly useful for production environments where centralized logging is essential for maintaining observability and operational efficiency. diff --git a/docs/docs-beta/docs/integrations/libraries/aws/ecr.md b/docs/docs-beta/docs/integrations/libraries/aws/ecr.md index a3b2487794a0b..1abecf6c20489 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/ecr.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/ecr.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-ecr.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/aws-ecr.svg --- - - This integration allows you to connect to AWS Elastic Container Registry (ECR). It provides resources to interact with AWS ECR, enabling you to manage your container images. Using this integration, you can seamlessly integrate AWS ECR into your Dagster pipelines, making it easier to manage and deploy containerized applications. diff --git a/docs/docs-beta/docs/integrations/libraries/aws/emr.md b/docs/docs-beta/docs/integrations/libraries/aws/emr.md index db5ba4e4bc91d..bb7fc5164eaf5 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/emr.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/emr.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-emr.svg categories: - Compute enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/aws-emr.svg --- - - The `dagster-aws` integration provides ways orchestrating data pipelines that leverage AWS services, including AWS EMR (Elastic MapReduce). This integration allows you to run and scale big data workloads using open source tools such as Apache Spark, Hive, Presto, and more. Using this integration, you can: diff --git a/docs/docs-beta/docs/integrations/libraries/aws/glue.md b/docs/docs-beta/docs/integrations/libraries/aws/glue.md index 629df3adc218d..0b536a97dc46b 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/glue.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/glue.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/aws-glue.svg --- - - The `dagster-aws` integration library provides the `PipesGlueClient` resource, enabling you to launch AWS Glue jobs directly from Dagster assets and ops. This integration allows you to pass parameters to Glue code while Dagster receives real-time events, such as logs, asset checks, and asset materializations, from the initiated jobs. With minimal code changes required on the job side, this integration is both efficient and easy to implement. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/index.md b/docs/docs-beta/docs/integrations/libraries/aws/index.md index a95102a5e87c8..46c2458c73ef3 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/index.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/index.md @@ -1,7 +1,9 @@ --- title: AWS +sidebar_custom_props: + logo: images/integrations/aws.svg --- import DocCardList from '@theme/DocCardList'; - \ No newline at end of file + diff --git a/docs/docs-beta/docs/integrations/libraries/aws/lambda.md b/docs/docs-beta/docs/integrations/libraries/aws/lambda.md index 5ec9c7c9c64ad..24c0708e0eca9 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/lambda.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/lambda.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/aws-lambda.svg --- - - Using this integration, you can leverage AWS Lambda to execute external code as part of your Dagster pipelines. This is particularly useful for running serverless functions that can scale automatically and handle various workloads without the need for managing infrastructure. The `PipesLambdaClient` class allows you to invoke AWS Lambda functions and stream logs and structured metadata back to Dagster's UI and tools. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/redshift.md b/docs/docs-beta/docs/integrations/libraries/aws/redshift.md index 593516db98136..6336dc119c539 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/redshift.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/redshift.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/aws-redshift.svg --- - - Using this integration, you can connect to an AWS Redshift cluster and issue queries against it directly from your Dagster assets. This allows you to seamlessly integrate Redshift into your data pipelines, leveraging the power of Redshift's data warehousing capabilities within your Dagster workflows. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/s3.md b/docs/docs-beta/docs/integrations/libraries/aws/s3.md index 71e35378e38b1..663938f6a35f0 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/s3.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/s3.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/aws-s3.svg --- - - The AWS S3 integration allows data engineers to easily read, and write objects to the durable AWS S3 storage -- enabling engineers to a resilient storage layer when constructing their pipelines. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/secretsmanager.md b/docs/docs-beta/docs/integrations/libraries/aws/secretsmanager.md index 48b3b007bf1cd..28803f44313ce 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/secretsmanager.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/secretsmanager.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-secretsmanager.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/aws-secretsmanager.svg --- - - This integration allows you to manage, retrieve, and rotate credentials, API keys, and other secrets using [AWS Secrets Manager](https://aws.amazon.com/secrets-manager/). ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/aws/ssm.md b/docs/docs-beta/docs/integrations/libraries/aws/ssm.md index d0da33d8d7e2f..823ebe4457e62 100644 --- a/docs/docs-beta/docs/integrations/libraries/aws/ssm.md +++ b/docs/docs-beta/docs/integrations/libraries/aws/ssm.md @@ -9,16 +9,15 @@ date: 2024-06-21 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-aws docslink: partnerlink: https://aws.amazon.com/ -logo: /integrations/aws-ssm.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/aws-ssm.svg --- - - The Dagster AWS Systems Manager (SSM) Parameter Store integration allows you to manage and retrieve parameters stored in AWS SSM Parameter Store directly within your Dagster pipelines. This integration provides resources to fetch parameters by name, tags, or paths, and optionally set them as environment variables for your operations. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/azure-adls2.md b/docs/docs-beta/docs/integrations/libraries/azure-adls2.md index 780b800aa62dc..74dbe6c001e84 100644 --- a/docs/docs-beta/docs/integrations/libraries/azure-adls2.md +++ b/docs/docs-beta/docs/integrations/libraries/azure-adls2.md @@ -1,9 +1,8 @@ --- layout: Integration status: published -name: Azure Data Lake Storage Gen 2 (ADLS2) -title: Dagster & Azure Data Lake Storage Gen 2 (ADLS2) -sidebar_label: Azure Data Lake Storage Gen 2 (ADLS2) +title: Dagster & Azure Data Lake Storage Gen 2 +sidebar_label: Azure Data Lake Storage Gen 2 excerpt: Get utilities for ADLS2 and Blob Storage. date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-azure @@ -15,10 +14,10 @@ categories: enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/azure.svg --- - - Dagster helps you use Azure Storage Accounts as part of your data pipeline. Azure Data Lake Storage Gen 2 (ADLS2) is our primary focus but we also provide utilities for Azure Blob Storage. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/census.md b/docs/docs-beta/docs/integrations/libraries/census.md index 1c3e4f8e2c903..9b694b92215b8 100644 --- a/docs/docs-beta/docs/integrations/libraries/census.md +++ b/docs/docs-beta/docs/integrations/libraries/census.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [community-supported, etl] +sidebar_custom_props: + logo: images/integrations/census.svg --- - - With the `dagster-census` integration you can execute a Census sync and poll until that sync completes, raising an error if it's unsuccessful. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/cube.md b/docs/docs-beta/docs/integrations/libraries/cube.md index e1e976090adf0..ea5ca9aae4bd7 100644 --- a/docs/docs-beta/docs/integrations/libraries/cube.md +++ b/docs/docs-beta/docs/integrations/libraries/cube.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [community-supported] +sidebar_custom_props: + logo: images/integrations/cube.svg --- - - With the `dagster_cube` integration you can setup Cube and Dagster to work together so that Dagster can push changes from upstream data sources to Cube using its integration API. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/databricks.md b/docs/docs-beta/docs/integrations/libraries/databricks.md index ff4736c3c0c4e..ea5f5fc13198e 100644 --- a/docs/docs-beta/docs/integrations/libraries/databricks.md +++ b/docs/docs-beta/docs/integrations/libraries/databricks.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/databricks.svg --- - - The `dagster-databricks` integration library provides the `PipesDatabricksClient` resource, enabling you to launch Databricks jobs directly from Dagster assets and ops. This integration allows you to pass parameters to Databricks code while Dagster receives real-time events, such as logs, asset checks, and asset materializations, from the initiated jobs. With minimal code changes required on the job side, this integration is both efficient and easy to implement. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/datadog.md b/docs/docs-beta/docs/integrations/libraries/datadog.md index 4f2e867eb2fd7..8af2a2bd1b9b6 100644 --- a/docs/docs-beta/docs/integrations/libraries/datadog.md +++ b/docs/docs-beta/docs/integrations/libraries/datadog.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, monitoring] +sidebar_custom_props: + logo: images/integrations/datadog.svg --- - - While Dagster provides comprehensive monitoring and observability of the pipelines it orchestrates, many teams look to centralize all their monitoring across apps, processes and infrastructure using Datadog's 'Cloud Monitoring as a Service'. The `dagster-datadog` integration allows you to publish metrics to Datadog from within Dagster ops. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/dbt-cloud.md b/docs/docs-beta/docs/integrations/libraries/dbt-cloud.md index 80c07e9990d41..16eb2510eb16e 100644 --- a/docs/docs-beta/docs/integrations/libraries/dbt-cloud.md +++ b/docs/docs-beta/docs/integrations/libraries/dbt-cloud.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-dbt#assets-dbt-cloud docslink: https://docs.dagster.io/integrations/dbt_cloud partnerlink: -logo: /integrations/dbt.svg categories: - ETL enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/dbt.svg --- - - Dagster allows you to run dbt Cloud jobs alongside other technologies. You can schedule them to run as a step in a larger pipeline and manage them as a data asset. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/dbt/index.md b/docs/docs-beta/docs/integrations/libraries/dbt/index.md index 177dc9f4e45f3..0a2fed2ce085f 100644 --- a/docs/docs-beta/docs/integrations/libraries/dbt/index.md +++ b/docs/docs-beta/docs/integrations/libraries/dbt/index.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/dbt.svg --- - - Dagster orchestrates dbt alongside other technologies, so you can schedule dbt with Spark, Python, etc. in a single data pipeline. Dagster assets understand dbt at the level of individual dbt models. This means that you can: diff --git a/docs/docs-beta/docs/integrations/libraries/deltalake.md b/docs/docs-beta/docs/integrations/libraries/deltalake.md index 3a3fc20373fef..b80bcf85a2451 100644 --- a/docs/docs-beta/docs/integrations/libraries/deltalake.md +++ b/docs/docs-beta/docs/integrations/libraries/deltalake.md @@ -10,16 +10,15 @@ communityIntegration: true apireflink: https://delta-io.github.io/delta-rs/integrations/delta-lake-dagster/ docslink: partnerlink: https://delta.io/ -logo: /integrations/DeltaLake.svg categories: - Storage enabledBy: enables: tags: [community-supported, storage] +sidebar_custom_props: + logo: images/integrations/deltalake.svg --- - - Delta Lake is a great storage format for Dagster workflows. With this integration, you can use the Delta Lake I/O Manager to read and write your Dagster assets. Here are some of the benefits that Delta Lake provides Dagster users: diff --git a/docs/docs-beta/docs/integrations/libraries/dlt.md b/docs/docs-beta/docs/integrations/libraries/dlt.md index 19c54360eea56..cc5875a483874 100644 --- a/docs/docs-beta/docs/integrations/libraries/dlt.md +++ b/docs/docs-beta/docs/integrations/libraries/dlt.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/dlthub.jpeg --- - - This integration allows you to use [dlt](https://dlthub.com/) to easily ingest and replicate data between systems through Dagster. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/docker.md b/docs/docs-beta/docs/integrations/libraries/docker.md index 6a65e2818cee9..2948cd978db18 100644 --- a/docs/docs-beta/docs/integrations/libraries/docker.md +++ b/docs/docs-beta/docs/integrations/libraries/docker.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/docker.svg --- - - The `dagster-docker` integration library provides the `PipesDockerClient` resource, enabling you to launch Docker containers and execute external code directly from Dagster assets and ops. This integration allows you to pass parameters to Docker containers while Dagster receives real-time events, such as logs, asset checks, and asset materializations, from the initiated jobs. With minimal code changes required on the job side, this integration is both efficient and easy to implement. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/duckdb.md b/docs/docs-beta/docs/integrations/libraries/duckdb.md index a5ea4fd28d53f..ab9c673d0a0aa 100644 --- a/docs/docs-beta/docs/integrations/libraries/duckdb.md +++ b/docs/docs-beta/docs/integrations/libraries/duckdb.md @@ -9,15 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-duckdb docslink: https://dagster.io/blog/duckdb-data-lake partnerlink: https://duckdb.org/ -logo: /integrations/Duckdb.svg categories: - Storage enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/duckdb.svg --- -{/* This library provides an integration with the DuckDB database, and allows for an out-of-the-box [I/O Manager](/concepts/io-management/io-managers) so that you can make DuckDB your storage of choice. */} This library provides an integration with the DuckDB database, and allows for an out-of-the-box [I/O Manager](/todo) so that you can make DuckDB your storage of choice. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/fivetran.md b/docs/docs-beta/docs/integrations/libraries/fivetran.md index c3b6261e9188e..f130cebfc6e2a 100644 --- a/docs/docs-beta/docs/integrations/libraries/fivetran.md +++ b/docs/docs-beta/docs/integrations/libraries/fivetran.md @@ -15,6 +15,8 @@ categories: enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/fivetran.svg --- This guide provides instructions for using Dagster with Fivetran using the `dagster-fivetran` library. Your Fivetran connector tables can be represented as assets in the Dagster asset graph, allowing you to track lineage and dependencies between Fivetran assets and data assets you are already modeling in Dagster. You can also use Dagster to orchestrate Fivetran connectors, allowing you to trigger syncs for these on a cadence or based on upstream data changes. diff --git a/docs/docs-beta/docs/integrations/libraries/gcp/bigquery.md b/docs/docs-beta/docs/integrations/libraries/gcp/bigquery.md index 986a7f4070de2..0a1057674398b 100644 --- a/docs/docs-beta/docs/integrations/libraries/gcp/bigquery.md +++ b/docs/docs-beta/docs/integrations/libraries/gcp/bigquery.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-gcp docslink: partnerlink: -logo: /integrations/gcp-bigquery.svg categories: - Storage enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/gcp-bigquery.svg --- - - The Google Cloud Platform BigQuery integration allows data engineers to easily query and store data in the BigQuery data warehouse through the use of the `BigQueryResource`. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/gcp/dataproc.md b/docs/docs-beta/docs/integrations/libraries/gcp/dataproc.md index dc168778f798b..3fe679d2fd2b9 100644 --- a/docs/docs-beta/docs/integrations/libraries/gcp/dataproc.md +++ b/docs/docs-beta/docs/integrations/libraries/gcp/dataproc.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-gcp docslink: partnerlink: -logo: /integrations/gcp-dataproc.svg categories: - Compute enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/gcp-dataproc.svg --- - - Using this integration, you can manage and interact with Google Cloud Platform's Dataproc service directly from Dagster. This integration allows you to create, manage, and delete Dataproc clusters, and submit and monitor jobs on these clusters. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/gcp/gcs.md b/docs/docs-beta/docs/integrations/libraries/gcp/gcs.md index 5969fe8f89368..8473db090a3cf 100644 --- a/docs/docs-beta/docs/integrations/libraries/gcp/gcs.md +++ b/docs/docs-beta/docs/integrations/libraries/gcp/gcs.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-gcp docslink: partnerlink: -logo: /integrations/gcp-gcs.svg categories: - Storage enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/gcp-gcs.svg --- - - This integration allows you to interact with Google Cloud Storage (GCS) using Dagster. It provides resources, I/O Managers, and utilities to manage and store data in GCS, making it easier to integrate GCS into your data pipelines. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/gcp/index.md b/docs/docs-beta/docs/integrations/libraries/gcp/index.md index a9b2ad3343cd3..da7a2e9e41656 100644 --- a/docs/docs-beta/docs/integrations/libraries/gcp/index.md +++ b/docs/docs-beta/docs/integrations/libraries/gcp/index.md @@ -1,5 +1,7 @@ --- title: GCP +sidebar_custom_props: + logo: images/integrations/gcp.svg --- import DocCardList from '@theme/DocCardList'; diff --git a/docs/docs-beta/docs/integrations/libraries/github.md b/docs/docs-beta/docs/integrations/libraries/github.md index 8d4176eb8e940..9665e3e33226c 100644 --- a/docs/docs-beta/docs/integrations/libraries/github.md +++ b/docs/docs-beta/docs/integrations/libraries/github.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-github docslink: partnerlink: https://github.com/ -logo: /integrations/Github.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/github.svg --- - - This library provides an integration with _[GitHub Apps](https://docs.github.com/en/developers/apps/getting-started-with-apps/about-apps)_ by providing a thin wrapper on the GitHub v4 GraphQL API. This allows for automating operations within your GitHub repositories and with the tighter permissions scopes that GitHub Apps allow for vs using a personal token. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/hashicorp.md b/docs/docs-beta/docs/integrations/libraries/hashicorp.md index 5d65ae6106959..723964aafc9d4 100644 --- a/docs/docs-beta/docs/integrations/libraries/hashicorp.md +++ b/docs/docs-beta/docs/integrations/libraries/hashicorp.md @@ -16,10 +16,10 @@ categories: enabledBy: enables: tags: [community-supported] +sidebar_custom_props: + logo: images/integrations/hashicorp.svg --- - - Package for integrating HashiCorp Vault into Dagster so that you can securely manage tokens and passwords. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/hightouch.md b/docs/docs-beta/docs/integrations/libraries/hightouch.md index eea47836e2390..e1a9cc04ae292 100644 --- a/docs/docs-beta/docs/integrations/libraries/hightouch.md +++ b/docs/docs-beta/docs/integrations/libraries/hightouch.md @@ -15,10 +15,10 @@ categories: enabledBy: enables: tags: [community-supported, etl] +sidebar_custom_props: + logo: images/integrations/hightouch.svg --- - - With this integration you can trigger Hightouch syncs and monitor them from within Dagster. Fine-tune when Hightouch syncs kick-off, visualize their dependencies, and monitor the steps in your data activation workflow. This native integration helps your team more effectively orchestrate the last mile of data analytics—bringing that data from the warehouse back into the SaaS tools your business teams live in. With the `dagster-hightouch` integration, Hightouch users have more granular and sophisticated control over when data gets activated. diff --git a/docs/docs-beta/docs/integrations/libraries/index.md b/docs/docs-beta/docs/integrations/libraries/index.md index 99a53949d12af..d95e8d26f5ca4 100644 --- a/docs/docs-beta/docs/integrations/libraries/index.md +++ b/docs/docs-beta/docs/integrations/libraries/index.md @@ -1,10 +1,12 @@ --- title: Libraries sidebar_class_name: hidden +sidebar_custom_props: + logo: images/integrations/dagster.svg --- You can integrate Dagster with external services using our libraries and libraries supported by the community. import DocCardList from '@theme/DocCardList'; - \ No newline at end of file + diff --git a/docs/docs-beta/docs/integrations/libraries/jupyter.md b/docs/docs-beta/docs/integrations/libraries/jupyter.md index c24ab32e1f1d5..74dd9c7c9080c 100644 --- a/docs/docs-beta/docs/integrations/libraries/jupyter.md +++ b/docs/docs-beta/docs/integrations/libraries/jupyter.md @@ -9,13 +9,14 @@ date: 2022-11-07 apireflink: docslink: https://docs.dagster.io/integrations/dagstermill partnerlink: -logo: /integrations/Jupyter.svg enabledBy: - dagster-dagstermill categories: - Compute enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/jupyter.svg --- ### About Jupyter diff --git a/docs/docs-beta/docs/integrations/libraries/kubernetes.md b/docs/docs-beta/docs/integrations/libraries/kubernetes.md index bdff728e10bbf..55d9c82853ffa 100644 --- a/docs/docs-beta/docs/integrations/libraries/kubernetes.md +++ b/docs/docs-beta/docs/integrations/libraries/kubernetes.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-k8s docslink: https://docs.dagster.io/concepts/dagster-pipes/kubernetes partnerlink: https://kubernetes.io/ -logo: /integrations/Kubernetes.svg categories: - Compute enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/kubernetes.svg --- - - The `dagster-k8s` integration library provides the `PipesK8sClient` resource, enabling you to launch Kubernetes pods and execute external code directly from Dagster assets and ops. This integration allows you to pass parameters to Kubernetes pods while Dagster receives real-time events, such as logs, asset checks, and asset materializations, from the initiated jobs. With minimal code changes required on the job side, this integration is both efficient and easy to implement. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/lakefs.md b/docs/docs-beta/docs/integrations/libraries/lakefs.md index 64f3510405c21..29ebf72fd01da 100644 --- a/docs/docs-beta/docs/integrations/libraries/lakefs.md +++ b/docs/docs-beta/docs/integrations/libraries/lakefs.md @@ -10,16 +10,15 @@ communityIntegration: true apireflink: https://pydocs.lakefs.io/ docslink: partnerlink: https://lakefs.io/ -logo: /integrations/lakefs.svg categories: - Storage enabledBy: enables: tags: [community-supported, storage] +sidebar_custom_props: + logo: images/integrations/lakefs.svg --- - - By integrating with lakeFS, a big data scale version control system, you can leverage the versioning capabilities of lakeFS to track changes to your data. This integration allows you to have a complete lineage of your data, from the initial raw data to the transformed and processed data, making it easier to understand and reproduce data transformations. With lakeFS and Dagster integration, you can ensure that data flowing through your Dagster jobs is easily reproducible. lakeFS provides a consistent view of your data across different versions, allowing you to troubleshoot pipeline runs and ensure consistent results. diff --git a/docs/docs-beta/docs/integrations/libraries/looker.md b/docs/docs-beta/docs/integrations/libraries/looker.md index 4cff5bf5fddcd..226963a31efe8 100644 --- a/docs/docs-beta/docs/integrations/libraries/looker.md +++ b/docs/docs-beta/docs/integrations/libraries/looker.md @@ -10,16 +10,15 @@ apireflink: docslink: https://docs.dagster.io/_apidocs/libraries/dagster-looker partnerlink: https://www.looker.com/ communityIntegration: true -logo: /integrations/looker.svg categories: - BI enabledBy: enables: tags: [dagster-supported, bi] +sidebar_custom_props: + logo: images/integrations/looker.svg --- - - Dagster allows you to represent your Looker project as assets, alongside other your other technologies like dbt and Sling. This allows you to see how your Looker assets are connected to your other data assets, and how changes to other data assets might impact your Looker project. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/meltano.md b/docs/docs-beta/docs/integrations/libraries/meltano.md index c78e518e8ca24..fb80c4e7ed7c5 100644 --- a/docs/docs-beta/docs/integrations/libraries/meltano.md +++ b/docs/docs-beta/docs/integrations/libraries/meltano.md @@ -9,17 +9,16 @@ date: 2023-03-25 apireflink: docslink: https://github.com/quantile-development/dagster-meltano#readme partnerlink: https://meltano.com/ -logo: /integrations/Meltano.svg categories: - ETL communityIntegration: true enabledBy: enables: tags: [community-supported, etl] +sidebar_custom_props: + logo: images/integrations/meltano.svg --- - - The `dagster-meltano` library allows you to run Meltano using Dagster. Design and configure ingestion jobs using the popular [Singer.io](https://singer.io) specification. **Note** that this integration can also be [managed from the Meltano platform](https://hub.meltano.com/utilities/dagster/) using `meltano add utility dagster` and configured using `meltano config dagster set --interactive`. diff --git a/docs/docs-beta/docs/integrations/libraries/microsoft-teams.md b/docs/docs-beta/docs/integrations/libraries/microsoft-teams.md index 183b9f3d54cab..c86e0db107713 100644 --- a/docs/docs-beta/docs/integrations/libraries/microsoft-teams.md +++ b/docs/docs-beta/docs/integrations/libraries/microsoft-teams.md @@ -9,12 +9,13 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-msteams docslink: partnerlink: https://www.microsoft.com/en-us/microsoft-teams/group-chat-software -logo: /integrations/Microsoft Teams.svg categories: - Alerting enabledBy: enables: tags: [dagster-supported, alerting] +sidebar_custom_props: + logo: images/integrations/microsoft_teams.svg --- By configuring this resource, you can post messages to MS Teams from any Dagster op or asset. diff --git a/docs/docs-beta/docs/integrations/libraries/open-metadata.md b/docs/docs-beta/docs/integrations/libraries/open-metadata.md index 65c6c5077fd86..84d0c06e1dffb 100644 --- a/docs/docs-beta/docs/integrations/libraries/open-metadata.md +++ b/docs/docs-beta/docs/integrations/libraries/open-metadata.md @@ -10,16 +10,15 @@ apireflink: docslink: https://docs.open-metadata.org/connectors/pipeline/dagster partnerlink: https://open-metadata.org/ communityIntegration: true -logo: /integrations/OpenMetadata.svg categories: - Metadata enabledBy: enables: tags: [community-supported, metadata] +sidebar_custom_props: + logo: images/integrations/openmetadata.svg --- - - With this integration you can create a Open Metadata service to ingest metadata produced by the Dagster application. View the Ingestion Pipeline running from the Open Metadata Service Page. ### About Open Metadata diff --git a/docs/docs-beta/docs/integrations/libraries/openai.md b/docs/docs-beta/docs/integrations/libraries/openai.md index 532e21a9018eb..daca3b24fc587 100644 --- a/docs/docs-beta/docs/integrations/libraries/openai.md +++ b/docs/docs-beta/docs/integrations/libraries/openai.md @@ -9,16 +9,15 @@ date: 2024-03-12 apireflink: https://platform.openai.com/docs/introduction docslink: https://docs.dagster.io/integrations/openai partnerlink: -logo: /integrations/openai.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/openai.svg --- - - The `dagster-openai` library allows you to easily interact with the OpenAI REST API using the OpenAI Python API to build AI steps into your Dagster pipelines. You can also log OpenAI API usage metadata in Dagster Insights, giving you detailed observability on API call credit consumption. When paired with Dagster assets, the resource automatically logs OpenAI usage metadata in asset metadata. diff --git a/docs/docs-beta/docs/integrations/libraries/pagerduty.md b/docs/docs-beta/docs/integrations/libraries/pagerduty.md index 4c3b577b03fcc..418267741f2de 100644 --- a/docs/docs-beta/docs/integrations/libraries/pagerduty.md +++ b/docs/docs-beta/docs/integrations/libraries/pagerduty.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-pagerduty docslink: partnerlink: https://www.pagerduty.com/ -logo: /integrations/PagerDuty.svg categories: - Alerting enabledBy: enables: tags: [dagster-supported, alerting] +sidebar_custom_props: + logo: images/integrations/pagerduty.svg --- - - This library provides an integration between Dagster and PagerDuty to support creating alerts from your Dagster code. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/pandas.md b/docs/docs-beta/docs/integrations/libraries/pandas.md index 6f7ea38111aac..ee39cb012da9e 100644 --- a/docs/docs-beta/docs/integrations/libraries/pandas.md +++ b/docs/docs-beta/docs/integrations/libraries/pandas.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-pandas docslink: https://docs.dagster.io/integrations/pandas partnerlink: https://pandas.pydata.org/ -logo: /integrations/Pandas.svg categories: - Metadata enabledBy: enables: tags: [dagster-supported, metadata] +sidebar_custom_props: + logo: images/integrations/pandas.svg --- - - Perform data validation, emit summary statistics, and enable reliable DataFrame serialization/deserialization. The dagster_pandas library provides you with the utilities for implementing validation on Pandas DataFrames. The Dagster type system generates documentation of your DataFrame constraints and makes it accessible in the Dagster UI. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/pandera.md b/docs/docs-beta/docs/integrations/libraries/pandera.md index 1549013311feb..002a9c4df1146 100644 --- a/docs/docs-beta/docs/integrations/libraries/pandera.md +++ b/docs/docs-beta/docs/integrations/libraries/pandera.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-pandera docslink: https://docs.dagster.io/integrations/pandera partnerlink: https://pandera.readthedocs.io/en/stable/ -logo: /integrations/Pandera.svg categories: - Metadata enabledBy: enables: tags: [dagster-supported, metadata] +sidebar_custom_props: + logo: images/integrations/pandera.svg --- - - The `dagster-pandera` integration library provides an API for generating Dagster Types from [Pandera DataFrame schemas](https://pandera.readthedocs.io/en/stable/dataframe_schemas.html). Like all Dagster types, Dagster-Pandera-generated types can be used to annotate op inputs and outputs. This provides runtime type-checking with rich error reporting and allows Dagster UI to display information about a DataFrame's structure. diff --git a/docs/docs-beta/docs/integrations/libraries/prometheus.md b/docs/docs-beta/docs/integrations/libraries/prometheus.md index e90e0fe7fb10b..b5a179f0b0228 100644 --- a/docs/docs-beta/docs/integrations/libraries/prometheus.md +++ b/docs/docs-beta/docs/integrations/libraries/prometheus.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-prometheus docslink: https://prometheus.io/ partnerlink: -logo: /integrations/Prometheus.svg categories: - Monitoring enabledBy: enables: tags: [dagster-supported, monitoring] +sidebar_custom_props: + logo: images/integrations/prometheus.svg --- - - This integration allows you to push metrics to the Prometheus gateway from within a Dagster pipeline. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/sdf.md b/docs/docs-beta/docs/integrations/libraries/sdf.md index a155f37bfa613..48957aff13640 100644 --- a/docs/docs-beta/docs/integrations/libraries/sdf.md +++ b/docs/docs-beta/docs/integrations/libraries/sdf.md @@ -10,16 +10,15 @@ apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-sdf docslink: https://docs.sdf.com/integrations/dagster/getting-started partnerlink: https://www.sdf.com/ communityIntegration: true -logo: /integrations/sdf.jpeg categories: - ETL enabledBy: enables: tags: [community-supported, etl] +sidebar_custom_props: + logo: images/integrations/sdf.jpeg --- - - SDF can integrate seamlessly with your existing Dagster projects, providing the best-in-class transformation layer while enabling you to schedule, orchestrate, and monitor your dags in Dagster. When it comes time to materialize your Dagster assets, you can be confident that SDF has successfully compiled your workspace, making it safe to execute locally or against your cloud data warehouse. diff --git a/docs/docs-beta/docs/integrations/libraries/secoda.md b/docs/docs-beta/docs/integrations/libraries/secoda.md index 3ec41ce364776..c40311a671cdc 100644 --- a/docs/docs-beta/docs/integrations/libraries/secoda.md +++ b/docs/docs-beta/docs/integrations/libraries/secoda.md @@ -10,16 +10,15 @@ apireflink: docslink: https://www.secoda.co/automations/automated-documentation-for-new-integrations-in-dagster partnerlink: https://www.secoda.co/integrations/dagster communityIntegration: true -logo: /integrations/Secoda.svg categories: - Metadata enabledBy: enables: tags: [community-supported, metadata] +sidebar_custom_props: + logo: images/integrations/secoda.svg --- - - Connect Dagster to Secoda and see metadata related to your Dagster assets, asset groups and jobs right in Secoda. Simplify your team's access, and remove the need to switch between tools. When you connect Dagster to Secoda, you can use Secoda's tools to add further context to your Dagster assets and jobs. Help your team understand metadata from Dagster by adding context in Secoda, like creating Documents, defining Metrics, and adding Tags. diff --git a/docs/docs-beta/docs/integrations/libraries/shell.md b/docs/docs-beta/docs/integrations/libraries/shell.md index 6b69731c6aeea..c5c4ede1c9ad8 100644 --- a/docs/docs-beta/docs/integrations/libraries/shell.md +++ b/docs/docs-beta/docs/integrations/libraries/shell.md @@ -9,16 +9,15 @@ date: 2024-08-20 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-shell docslink: partnerlink: -logo: /integrations/Shell.svg categories: - Compute enabledBy: enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/shell.svg --- - - Dagster comes with a native `PipesSubprocessClient` resource that enables you to launch shell commands directly from Dagster assets and ops. This integration allows you to pass parameters to external shell scripts while Dagster receives real-time events, such as logs, asset checks, and asset materializations, from the initiated external execution. With minimal code changes required on the job side, this integration is both efficient and easy to implement. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/slack.md b/docs/docs-beta/docs/integrations/libraries/slack.md index 3c5d3b0253ec9..179a45798231a 100644 --- a/docs/docs-beta/docs/integrations/libraries/slack.md +++ b/docs/docs-beta/docs/integrations/libraries/slack.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-slack docslink: partnerlink: https://slack.com/ -logo: /integrations/Slack.svg categories: - Alerting enabledBy: enables: tags: [dagster-supported, alerting] +sidebar_custom_props: + logo: images/integrations/slack.svg --- - - This library provides an integration with Slack to support posting messages in your company's Slack workspace. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/sling.md b/docs/docs-beta/docs/integrations/libraries/sling.md index 58cceb2bac261..cb4a85abbd7e4 100644 --- a/docs/docs-beta/docs/integrations/libraries/sling.md +++ b/docs/docs-beta/docs/integrations/libraries/sling.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-embedded-elt docslink: https://docs.dagster.io/integrations/embedded-elt/sling partnerlink: https://slingdata.io/ -logo: /integrations/sling.png categories: - ETL enabledBy: enables: tags: [dagster-supported, etl] +sidebar_custom_props: + logo: images/integrations/sling.png --- - - This integration allows you to use [Sling](https://slingdata.io/) to extract and load data from popular data sources to destinations with high performance and ease. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/snowflake.md b/docs/docs-beta/docs/integrations/libraries/snowflake.md index 3e3f45986ff76..caa16d3cca636 100644 --- a/docs/docs-beta/docs/integrations/libraries/snowflake.md +++ b/docs/docs-beta/docs/integrations/libraries/snowflake.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-snowflake docslink: https://docs.dagster.io/integrations/snowflake partnerlink: https://www.snowflake.com/en/ -logo: /integrations/Snowflake.svg categories: - Storage enabledBy: enables: tags: [dagster-supported, storage] +sidebar_custom_props: + logo: images/integrations/snowflake.svg --- - - This library provides an integration with the Snowflake data warehouse. Connect to Snowflake as a resource, then use the integration-provided functions to construct an op to establish connections and execute Snowflake queries. Read and write natively to Snowflake from Dagster assets. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/spark.md b/docs/docs-beta/docs/integrations/libraries/spark.md index e14f63f73a10a..803b61767b2a5 100644 --- a/docs/docs-beta/docs/integrations/libraries/spark.md +++ b/docs/docs-beta/docs/integrations/libraries/spark.md @@ -9,17 +9,16 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-spark docslink: https://docs.dagster.io/integrations/spark partnerlink: -logo: /integrations/Spark.svg categories: - Compute enabledBy: - dagster-pyspark enables: tags: [dagster-supported, compute] +sidebar_custom_props: + logo: images/integrations/spark.svg --- - - Spark jobs typically execute on infrastructure that's specialized for Spark. Spark applications are typically not containerized or executed on Kubernetes. Running Spark code often requires submitting code to a Databricks or EMR cluster. `dagster-pyspark` provides a Spark class with methods for configuration and constructing the `spark-submit` command for a Spark job. diff --git a/docs/docs-beta/docs/integrations/libraries/ssh-sftp.md b/docs/docs-beta/docs/integrations/libraries/ssh-sftp.md index be2314fa07cbb..7cc53cbaf089a 100644 --- a/docs/docs-beta/docs/integrations/libraries/ssh-sftp.md +++ b/docs/docs-beta/docs/integrations/libraries/ssh-sftp.md @@ -9,16 +9,15 @@ date: 2022-11-07 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-ssh docslink: partnerlink: https://www.ssh.com/academy/ssh/protocol -logo: /integrations/SSH.svg categories: - Other enabledBy: enables: tags: [dagster-supported] +sidebar_custom_props: + logo: images/integrations/ssh.svg --- - - This integration provides a resource for SSH remote execution using [Paramiko](https://github.com/paramiko/paramiko). It allows you to establish secure connections to networked resources and execute commands remotely. The integration also provides an SFTP client for secure file transfers between the local and remote systems. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/twilio.md b/docs/docs-beta/docs/integrations/libraries/twilio.md index 4584fdb550781..ae253b37a23be 100644 --- a/docs/docs-beta/docs/integrations/libraries/twilio.md +++ b/docs/docs-beta/docs/integrations/libraries/twilio.md @@ -9,16 +9,15 @@ date: 2024-08-30 apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-twilio docslink: partnerlink: https://www.twilio.com/ -logo: /integrations/Twilio.svg categories: - Alerting enabledBy: enables: tags: [dagster-supported, alerting] +sidebar_custom_props: + logo: images/integrations/twilio.svg --- - - Use your Twilio `Account SID` and `Auth Token` to build Twilio tasks right into your Dagster pipeline. ### Installation diff --git a/docs/docs-beta/docs/integrations/libraries/wandb.md b/docs/docs-beta/docs/integrations/libraries/wandb.md index 363950d2fa10e..5e87ce81ea1d8 100644 --- a/docs/docs-beta/docs/integrations/libraries/wandb.md +++ b/docs/docs-beta/docs/integrations/libraries/wandb.md @@ -10,16 +10,15 @@ apireflink: https://docs.dagster.io/_apidocs/libraries/dagster-wandb docslink: https://docs.wandb.ai/guides/integrations/dagster partnerlink: https://wandb.ai/ communityIntegration: True -logo: /integrations/WandB.svg categories: - Other enabledBy: enables: tags: [community-supported] +sidebar_custom_props: + logo: images/integrations/wandb.svg --- - - Use Dagster and Weights & Biases (W&B) to orchestrate your MLOps pipelines and maintain ML assets. The integration with W&B makes it easy within Dagster to: - use and create W&B Artifacts diff --git a/docs/docs-beta/src/theme/DocCard/index.tsx b/docs/docs-beta/src/theme/DocCard/index.tsx new file mode 100644 index 0000000000000..8d11c7c7a57f6 --- /dev/null +++ b/docs/docs-beta/src/theme/DocCard/index.tsx @@ -0,0 +1,136 @@ +import React, {type ReactNode} from 'react'; +import clsx from 'clsx'; +import Link from '@docusaurus/Link'; +import { + useDocById, + findFirstSidebarItemLink, +} from '@docusaurus/plugin-content-docs/client'; +import {usePluralForm} from '@docusaurus/theme-common'; +import isInternalUrl from '@docusaurus/isInternalUrl'; +import {translate} from '@docusaurus/Translate'; + +import type {Props} from '@theme/DocCard'; +import Heading from '@theme/Heading'; +import type { + PropSidebarItemCategory, + PropSidebarItemLink, +} from '@docusaurus/plugin-content-docs'; + +import styles from './styles.module.css'; +import useBaseUrl from '@docusaurus/useBaseUrl'; + +// TODO - text for folders +// TODO - indicator for "community supported" integration + +function useCategoryItemsPlural() { + const {selectMessage} = usePluralForm(); + return (count: number) => + selectMessage( + count, + translate( + { + message: '1 item|{count} items', + id: 'theme.docs.DocCard.categoryDescription.plurals', + description: + 'The default description for a category card in the generated index about how many items this category includes', + }, + {count}, + ), + ); +} + +function CardContainer({href, children}: {href: string; children: ReactNode}): ReactNode { + return ( + + {children} + + ); +} + + +function truncate(text: string, max: number) { + return text.length > max ? text.slice(0, max).split(' ').slice(0, -1).join(' ') + ' ...' : text; +} + +function CardLayout({ + href, + logo, + title, + description, +}: { + href: string; + title: string; + logo?: string; + description?: string; +}): ReactNode { + const logoUrl = logo || 'images/integrations/placeholder_64x64.svg'; + + return ( + +
+
+ +
+
+ + {title} + + {description && ( +

+ {description} +

+ )} +
+
+ + ); +} + + +function CardCategory({item}: {item: PropSidebarItemCategory}): ReactNode { + const href = findFirstSidebarItemLink(item); + const categoryItemsPlural = useCategoryItemsPlural(); + + // Unexpected: categories that don't have a link have been filtered upfront + if (!href) { + return null; + } + + const logo: string | null = item?.customProps?.logo || null; + + return ( + + ); +} + +function CardLink({item}: {item: PropSidebarItemLink}): ReactNode { + // https://github.com/facebook/docusaurus/discussions/10476 + //const icon = item?.customProps?.myEmoji ?? (isInternalUrl(item.href) ? '📄️' : '🔗'); + const logo: string | null = item?.customProps?.logo || null; + const doc = useDocById(item.docId ?? undefined); + + return ( + + ); +} + +export default function DocCard({item}: Props): ReactNode { + switch (item.type) { + case 'link': + return ; + case 'category': + return ; + default: + throw new Error(`unknown item type ${JSON.stringify(item)}`); + } +} diff --git a/docs/docs-beta/src/theme/DocCard/styles.module.css b/docs/docs-beta/src/theme/DocCard/styles.module.css new file mode 100644 index 0000000000000..f63df806f8e8c --- /dev/null +++ b/docs/docs-beta/src/theme/DocCard/styles.module.css @@ -0,0 +1,39 @@ +.cardContainer { + --ifm-link-color: var(--ifm-color-emphasis-800); + --ifm-link-hover-color: var(--ifm-color-emphasis-700); + --ifm-link-hover-decoration: none; + + box-shadow: 0 1.5px 3px 0 rgb(0 0 0 / 15%); + border: 1px solid var(--ifm-color-emphasis-200); + transition: all var(--ifm-transition-fast) ease; + transition-property: border, box-shadow; + padding: 1rem !important; +} + +.cardContainer h2 { + margin-bottom: 0.5rem; +} + +.cardContainer:hover { + border-color: var(--ifm-color-primary); + box-shadow: 0 3px 6px 0 rgb(0 0 0 / 20%); +} + +.cardContainer *:last-child { + margin-bottom: 0; +} + +.cardTitle { + font-size: 1.25rem; + line-height: 1.5rem; + font-weight: 400; +} + +.cardDescription { + font-size: 1.0rem; + line-height: 1.5rem; + display: -webkit-box; + -webkit-line-clamp: 3; + -webkit-box-orient: vertical; + overflow: hidden; +} diff --git a/docs/docs-beta/static/images/integrations/Azure.svg b/docs/docs-beta/static/images/integrations/Azure.svg new file mode 100644 index 0000000000000..64507b1ee9113 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Azure.svg @@ -0,0 +1,23 @@ + + + + + + + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Celery.svg b/docs/docs-beta/static/images/integrations/Celery.svg new file mode 100644 index 0000000000000..c430253d70680 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Celery.svg @@ -0,0 +1,8 @@ + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Census.svg b/docs/docs-beta/static/images/integrations/Census.svg new file mode 100644 index 0000000000000..dd2e60424fbd4 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Census.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Dask.svg b/docs/docs-beta/static/images/integrations/Dask.svg new file mode 100644 index 0000000000000..9f22f02824872 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Dask.svg @@ -0,0 +1,5 @@ + + + + + diff --git a/docs/docs-beta/static/images/integrations/Databricks.svg b/docs/docs-beta/static/images/integrations/Databricks.svg new file mode 100644 index 0000000000000..126d93866037c --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Databricks.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Datadog.svg b/docs/docs-beta/static/images/integrations/Datadog.svg new file mode 100644 index 0000000000000..a7599265c772d --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Datadog.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/DeltaLake.svg b/docs/docs-beta/static/images/integrations/DeltaLake.svg new file mode 100644 index 0000000000000..51f4303c20578 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/DeltaLake.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Docker.svg b/docs/docs-beta/static/images/integrations/Docker.svg new file mode 100644 index 0000000000000..d13dc6dd1f41e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Docker.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Duckdb.svg b/docs/docs-beta/static/images/integrations/Duckdb.svg new file mode 100644 index 0000000000000..3d43a9377f9c0 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Duckdb.svg @@ -0,0 +1,5 @@ + + + + + diff --git a/docs/docs-beta/static/images/integrations/Fivetran.svg b/docs/docs-beta/static/images/integrations/Fivetran.svg new file mode 100644 index 0000000000000..ea0357b82a75c --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Fivetran.svg @@ -0,0 +1,7 @@ + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Github.svg b/docs/docs-beta/static/images/integrations/Github.svg new file mode 100644 index 0000000000000..f097c84ea863f --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Github.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Hashicorp.svg b/docs/docs-beta/static/images/integrations/Hashicorp.svg new file mode 100644 index 0000000000000..16fe571c63fea --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Hashicorp.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Hex.svg b/docs/docs-beta/static/images/integrations/Hex.svg new file mode 100644 index 0000000000000..bc6025d54c976 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Hex.svg @@ -0,0 +1,10 @@ + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Hightouch.svg b/docs/docs-beta/static/images/integrations/Hightouch.svg new file mode 100644 index 0000000000000..b7bf3ef24f315 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Hightouch.svg @@ -0,0 +1,11 @@ + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Jupyter.svg b/docs/docs-beta/static/images/integrations/Jupyter.svg new file mode 100644 index 0000000000000..55699db9b7af7 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Jupyter.svg @@ -0,0 +1,21 @@ + + + + + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Kubernetes.svg b/docs/docs-beta/static/images/integrations/Kubernetes.svg new file mode 100644 index 0000000000000..c021d4efb1460 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Kubernetes.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/MLflow.svg b/docs/docs-beta/static/images/integrations/MLflow.svg new file mode 100644 index 0000000000000..26de5f1dffeca --- /dev/null +++ b/docs/docs-beta/static/images/integrations/MLflow.svg @@ -0,0 +1,4 @@ + + + + diff --git a/docs/docs-beta/static/images/integrations/Meltano.svg b/docs/docs-beta/static/images/integrations/Meltano.svg new file mode 100644 index 0000000000000..1df5797c01fd5 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Meltano.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/MySQL.svg b/docs/docs-beta/static/images/integrations/MySQL.svg new file mode 100644 index 0000000000000..ed8a1fab5c386 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/MySQL.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Noteable.svg b/docs/docs-beta/static/images/integrations/Noteable.svg new file mode 100644 index 0000000000000..4fc7a643d6217 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Noteable.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/OpenMetadata.svg b/docs/docs-beta/static/images/integrations/OpenMetadata.svg new file mode 100644 index 0000000000000..e38e1ffe7449c --- /dev/null +++ b/docs/docs-beta/static/images/integrations/OpenMetadata.svg @@ -0,0 +1,16 @@ + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/PagerDuty.svg b/docs/docs-beta/static/images/integrations/PagerDuty.svg new file mode 100644 index 0000000000000..ab253b5f35665 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/PagerDuty.svg @@ -0,0 +1,4 @@ + + + + diff --git a/docs/docs-beta/static/images/integrations/Pandas.svg b/docs/docs-beta/static/images/integrations/Pandas.svg new file mode 100644 index 0000000000000..be1078ae91f09 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Pandas.svg @@ -0,0 +1,10 @@ + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Pandera.svg b/docs/docs-beta/static/images/integrations/Pandera.svg new file mode 100644 index 0000000000000..72fdbe49f2b9e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Pandera.svg @@ -0,0 +1,5 @@ + + + + + diff --git a/docs/docs-beta/static/images/integrations/Papermill.svg b/docs/docs-beta/static/images/integrations/Papermill.svg new file mode 100644 index 0000000000000..d5c53bbf32877 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Papermill.svg @@ -0,0 +1,16 @@ + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Papertrail.svg b/docs/docs-beta/static/images/integrations/Papertrail.svg new file mode 100644 index 0000000000000..2a6a348996175 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Papertrail.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Plural.svg b/docs/docs-beta/static/images/integrations/Plural.svg new file mode 100644 index 0000000000000..737b25f9b73b3 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Plural.svg @@ -0,0 +1,5 @@ + + + + + diff --git a/docs/docs-beta/static/images/integrations/PostgreSQL.svg b/docs/docs-beta/static/images/integrations/PostgreSQL.svg new file mode 100644 index 0000000000000..9fbf44b145a38 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/PostgreSQL.svg @@ -0,0 +1,9 @@ + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Postgresql_elephant.svg b/docs/docs-beta/static/images/integrations/Postgresql_elephant.svg new file mode 100644 index 0000000000000..d98e3659c3951 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Postgresql_elephant.svg @@ -0,0 +1,22 @@ + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/Prometheus.svg b/docs/docs-beta/static/images/integrations/Prometheus.svg new file mode 100644 index 0000000000000..06788668e781d --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Prometheus.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/PySpark.svg b/docs/docs-beta/static/images/integrations/PySpark.svg new file mode 100644 index 0000000000000..d840fd91d1876 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/PySpark.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/SSH.svg b/docs/docs-beta/static/images/integrations/SSH.svg new file mode 100644 index 0000000000000..f3f93bcea9305 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/SSH.svg @@ -0,0 +1,12 @@ + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Secoda.svg b/docs/docs-beta/static/images/integrations/Secoda.svg new file mode 100644 index 0000000000000..93f06a47ef9cf --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Secoda.svg @@ -0,0 +1,6 @@ + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Shell.svg b/docs/docs-beta/static/images/integrations/Shell.svg new file mode 100644 index 0000000000000..c9de2c3db72f8 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Shell.svg @@ -0,0 +1,4 @@ + + + + diff --git a/docs/docs-beta/static/images/integrations/Slack.svg b/docs/docs-beta/static/images/integrations/Slack.svg new file mode 100644 index 0000000000000..f0a53ef284a47 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Slack.svg @@ -0,0 +1,6 @@ + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Snowflake.svg b/docs/docs-beta/static/images/integrations/Snowflake.svg new file mode 100644 index 0000000000000..da87f43f96082 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Snowflake.svg @@ -0,0 +1,9 @@ + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/Spark.svg b/docs/docs-beta/static/images/integrations/Spark.svg new file mode 100644 index 0000000000000..d840fd91d1876 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Spark.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/Twilio.svg b/docs/docs-beta/static/images/integrations/Twilio.svg new file mode 100644 index 0000000000000..b7a2285a00ed6 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/Twilio.svg @@ -0,0 +1,7 @@ + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/WandB.svg b/docs/docs-beta/static/images/integrations/WandB.svg new file mode 100644 index 0000000000000..7214be268dd14 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/WandB.svg @@ -0,0 +1,14 @@ + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/airbyte.svg b/docs/docs-beta/static/images/integrations/airbyte.svg new file mode 100644 index 0000000000000..0a02d6172bafd --- /dev/null +++ b/docs/docs-beta/static/images/integrations/airbyte.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/airflow.svg b/docs/docs-beta/static/images/integrations/airflow.svg new file mode 100644 index 0000000000000..fe9e8ed01505a --- /dev/null +++ b/docs/docs-beta/static/images/integrations/airflow.svg @@ -0,0 +1,11 @@ + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/aws-athena.svg b/docs/docs-beta/static/images/integrations/aws-athena.svg new file mode 100644 index 0000000000000..d32408304360a --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-athena.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_Amazon-Athena_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-cloudwatch.svg b/docs/docs-beta/static/images/integrations/aws-cloudwatch.svg new file mode 100644 index 0000000000000..5445f0d324611 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-cloudwatch.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_Amazon-CloudWatch_64 + Created with Sketch. + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/aws-ecr.svg b/docs/docs-beta/static/images/integrations/aws-ecr.svg new file mode 100644 index 0000000000000..22833580a6a4a --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-ecr.svg @@ -0,0 +1,18 @@ + + + + Icon-Architecture/64/Arch_Amazon-Elastic-Container-Registry_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-ecs.svg b/docs/docs-beta/static/images/integrations/aws-ecs.svg new file mode 100644 index 0000000000000..5257468d0f877 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-ecs.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_Amazon-Elastic-Container-Service_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-emr.svg b/docs/docs-beta/static/images/integrations/aws-emr.svg new file mode 100644 index 0000000000000..a569ccb6c0204 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-emr.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_Amazon-EMR_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-glue.svg b/docs/docs-beta/static/images/integrations/aws-glue.svg new file mode 100644 index 0000000000000..ce8ac5203dc5b --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-glue.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_AWS-Glue_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-lambda.svg b/docs/docs-beta/static/images/integrations/aws-lambda.svg new file mode 100644 index 0000000000000..ce571713015b3 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-lambda.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_AWS-Lambda_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-redshift.svg b/docs/docs-beta/static/images/integrations/aws-redshift.svg new file mode 100644 index 0000000000000..f7bf37357137b --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-redshift.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_Amazon-Redshiftct_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-s3.svg b/docs/docs-beta/static/images/integrations/aws-s3.svg new file mode 100644 index 0000000000000..3e727b30f9cd8 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-s3.svg @@ -0,0 +1,17 @@ + + Icon-Architecture/64/Arch_Amazon-Simple-Storage-Service_64 + + + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-secretsmanager.svg b/docs/docs-beta/static/images/integrations/aws-secretsmanager.svg new file mode 100644 index 0000000000000..c6586d4b4cfc6 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-secretsmanager.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_AWS-Secrets-Manager_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws-ssm.svg b/docs/docs-beta/static/images/integrations/aws-ssm.svg new file mode 100644 index 0000000000000..ffc9ca525f3ec --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws-ssm.svg @@ -0,0 +1,17 @@ + + + Icon-Architecture/64/Arch_AWS-Systems-Manager_64 + Created with Sketch. + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/aws.svg b/docs/docs-beta/static/images/integrations/aws.svg new file mode 100644 index 0000000000000..94462552dbd2e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/aws.svg @@ -0,0 +1,5 @@ + + + + + diff --git a/docs/docs-beta/static/images/integrations/celery_and_docker.svg b/docs/docs-beta/static/images/integrations/celery_and_docker.svg new file mode 100644 index 0000000000000..797445fee12f3 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/celery_and_docker.svg @@ -0,0 +1,9 @@ + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/cube.svg b/docs/docs-beta/static/images/integrations/cube.svg new file mode 100644 index 0000000000000..683261a5191d9 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/cube.svg @@ -0,0 +1 @@ + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/dagster.svg b/docs/docs-beta/static/images/integrations/dagster.svg new file mode 100644 index 0000000000000..d2ae628553a7d --- /dev/null +++ b/docs/docs-beta/static/images/integrations/dagster.svg @@ -0,0 +1,11 @@ + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/dbt.svg b/docs/docs-beta/static/images/integrations/dbt.svg new file mode 100644 index 0000000000000..68af21f4529cb --- /dev/null +++ b/docs/docs-beta/static/images/integrations/dbt.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/dlthub.jpeg b/docs/docs-beta/static/images/integrations/dlthub.jpeg new file mode 100644 index 0000000000000..f5c839d76db6a Binary files /dev/null and b/docs/docs-beta/static/images/integrations/dlthub.jpeg differ diff --git a/docs/docs-beta/static/images/integrations/duckdb_pandas.svg b/docs/docs-beta/static/images/integrations/duckdb_pandas.svg new file mode 100644 index 0000000000000..08cb3095af8b2 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/duckdb_pandas.svg @@ -0,0 +1,20 @@ + + + + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/duckdb_polars.svg b/docs/docs-beta/static/images/integrations/duckdb_polars.svg new file mode 100644 index 0000000000000..c29c7a930b664 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/duckdb_polars.svg @@ -0,0 +1,52 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/duckdb_pyspark.svg b/docs/docs-beta/static/images/integrations/duckdb_pyspark.svg new file mode 100644 index 0000000000000..e242e8f86017d --- /dev/null +++ b/docs/docs-beta/static/images/integrations/duckdb_pyspark.svg @@ -0,0 +1,13 @@ + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/gcp-bigquery.svg b/docs/docs-beta/static/images/integrations/gcp-bigquery.svg new file mode 100644 index 0000000000000..4ee5458647f26 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/gcp-bigquery.svg @@ -0,0 +1 @@ + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/gcp-dataproc.svg b/docs/docs-beta/static/images/integrations/gcp-dataproc.svg new file mode 100644 index 0000000000000..df09bd251cf10 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/gcp-dataproc.svg @@ -0,0 +1 @@ +Icon_24px_DataProc_Color \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/gcp-gcs.svg b/docs/docs-beta/static/images/integrations/gcp-gcs.svg new file mode 100644 index 0000000000000..59db35d960aca --- /dev/null +++ b/docs/docs-beta/static/images/integrations/gcp-gcs.svg @@ -0,0 +1 @@ +Icon_24px_CloudStorage_Color \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/gcp.svg b/docs/docs-beta/static/images/integrations/gcp.svg new file mode 100644 index 0000000000000..4533175b6d622 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/gcp.svg @@ -0,0 +1,6 @@ + + + + + + diff --git a/docs/docs-beta/static/images/integrations/great_expectations.svg b/docs/docs-beta/static/images/integrations/great_expectations.svg new file mode 100644 index 0000000000000..5df1e2fd8f312 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/great_expectations.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/hashicorp_vault.svg b/docs/docs-beta/static/images/integrations/hashicorp_vault.svg new file mode 100644 index 0000000000000..b29ec7e42bc37 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/hashicorp_vault.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/lakefs.svg b/docs/docs-beta/static/images/integrations/lakefs.svg new file mode 100644 index 0000000000000..142cb31823a3e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/lakefs.svg @@ -0,0 +1,11 @@ + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/looker.svg b/docs/docs-beta/static/images/integrations/looker.svg new file mode 100644 index 0000000000000..88e6913629e1e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/looker.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/microsoft_teams.svg b/docs/docs-beta/static/images/integrations/microsoft_teams.svg new file mode 100644 index 0000000000000..dc2260e76cbce --- /dev/null +++ b/docs/docs-beta/static/images/integrations/microsoft_teams.svg @@ -0,0 +1,28 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/openai.svg b/docs/docs-beta/static/images/integrations/openai.svg new file mode 100644 index 0000000000000..fce9ead3046b3 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/openai.svg @@ -0,0 +1,3 @@ + + + diff --git a/docs/docs-beta/static/images/integrations/placeholder_64x64.svg b/docs/docs-beta/static/images/integrations/placeholder_64x64.svg new file mode 100644 index 0000000000000..df1d833842d4e --- /dev/null +++ b/docs/docs-beta/static/images/integrations/placeholder_64x64.svg @@ -0,0 +1 @@ + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/power_bi.svg b/docs/docs-beta/static/images/integrations/power_bi.svg new file mode 100644 index 0000000000000..d7ab0423b9f04 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/power_bi.svg @@ -0,0 +1,36 @@ + + + + PBI Logo + Created with Sketch. + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file diff --git a/docs/docs-beta/static/images/integrations/sdf.jpeg b/docs/docs-beta/static/images/integrations/sdf.jpeg new file mode 100644 index 0000000000000..d01e39aba76eb Binary files /dev/null and b/docs/docs-beta/static/images/integrations/sdf.jpeg differ diff --git a/docs/docs-beta/static/images/integrations/sigma.jpg b/docs/docs-beta/static/images/integrations/sigma.jpg new file mode 100644 index 0000000000000..8818808ab15dc Binary files /dev/null and b/docs/docs-beta/static/images/integrations/sigma.jpg differ diff --git a/docs/docs-beta/static/images/integrations/sling.png b/docs/docs-beta/static/images/integrations/sling.png new file mode 100644 index 0000000000000..70e9383b9f428 Binary files /dev/null and b/docs/docs-beta/static/images/integrations/sling.png differ diff --git a/docs/docs-beta/static/images/integrations/snowflake_and_pandas.svg b/docs/docs-beta/static/images/integrations/snowflake_and_pandas.svg new file mode 100644 index 0000000000000..78ef8d35edeb9 --- /dev/null +++ b/docs/docs-beta/static/images/integrations/snowflake_and_pandas.svg @@ -0,0 +1,17 @@ + + + + + + + + + + + + + + + + + diff --git a/docs/docs-beta/static/images/integrations/tableau.svg b/docs/docs-beta/static/images/integrations/tableau.svg new file mode 100644 index 0000000000000..cb88ef122633b --- /dev/null +++ b/docs/docs-beta/static/images/integrations/tableau.svg @@ -0,0 +1,24 @@ + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file