[dagster-aws, docs] cloudwatch message reader docs

[danielgafni]

Summary & Motivation

Adding docs for the new PipesCloudWatchMessageReader

How I Tested These Changes

[danielgafni]

• [dagster-aws] add Pipes ECS client #23568 : 4 dependent PRs (#23569 , #23949 , #23954 and 1 other)
• [dagster-aws] split dagster_aws.pipes module into a package with submodules #23509
• [dagster-aws, docs] cloudwatch message reader docs #23440 👈
• [dagster-aws] add Pipes cloudwatch message reader #23353 : 2 other dependent PRs (#23354 , #23441 )
• master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @danielgafni and the rest of your teammates on Graphite

[github-actions]

Deploy preview for dagster-docs ready!

Preview available at https://dagster-docs-itkd0pz2m-elementl.vercel.app
https://pipes-cloudwatch-message-reader-docs.dagster.dagster-docs.io

Direct link to changed pages:

• https://dagster-docs-itkd0pz2m-elementl.vercel.app
  https://pipes-cloudwatch-message-reader-docs.dagster.dagster-docs.io/concepts/dagster-pipes/aws-glue

[erinkcochran87]

Sending this back over to you. I'm looking into the comment you tagged me in, but didn't want you to wait on me for the other stuff.

[danielgafni]

@erinkcochran87 another puzzle from Sphinx - do you know why this PipesGlueClient class reference here doesn't get a proper URL? It points to the current page.

These two which seem to be created the same way work correctly (they point to API docs).

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
dagster-docs-next	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 10, 2024 2:16pm

[cmpadden]

@erinkcochran87 another puzzle from Sphinx - do you know why this PipesGlueClient class reference here doesn't get a proper URL? It points to the current page.

These two which seem to be created the same way work correctly (they point to API docs).

This is because :noindex: was provided in the Sphinx rst file, this can be resolved by updating it like so:

diff --git a/docs/sphinx/sections/api/apidocs/libraries/dagster-aws.rst b/docs/sphinx/sections/api/apidocs/libraries/dagster-aws.rst
index 0e2969447d..078144abce 100644
--- a/docs/sphinx/sections/api/apidocs/libraries/dagster-aws.rst
+++ b/docs/sphinx/sections/api/apidocs/libraries/dagster-aws.rst
@@ -119,8 +119,6 @@ Clients
 .. autoclass:: dagster_aws.pipes.PipesLambdaClient

 .. autoclass:: dagster_aws.pipes.PipesGlueClient
-   :noindex:
-   :members: run

 Legacy
 --------

[danielgafni]

Merge activity

• Aug 16, 12:10 PM EDT: Graphite rebased this pull request as part of a merge.
• Aug 16, 12:11 PM EDT: @danielgafni merged this pull request with Graphite.