Add Automation Page

[PedramNavid]

This adds a "How to Automate Pipelines" guide. The idea behind this page is that it serves as the entry point for Automation. We explain the three ways to automate, each example offers links to a How-To guide with examples for that concept, and potentially a concept page. Not every idea needs a concept page. For example, Asset Sensors may only need a Guide and Reference API documentation.

I did not include the section on Declarative Automation, but it would also fall here.

[netlify]

✅ Deploy Preview for dagsterapidocs canceled.

Name	Link
🔨 Latest commit	242a28c
🔍 Latest deploy log	https://app.netlify.com/sites/dagsterapidocs/deploys/66bece606c3ed00008a1bf32

[github-actions]

Deploy preview for dagit-core-storybook ready!

✅ Preview
https://dagit-core-storybook-1uaf0d9os-elementl.vercel.app
https://pdrm-add-automation.core-storybook.dagster-docs.io

Built with commit ff56dec.
This pull request is being automatically deployed with vercel-action

[github-actions]

Deploy preview for dagster-docs ready!

Preview available at https://dagster-docs-ihiqwnbgj-elementl.vercel.app
https://pdrm-add-automation.dagster.dagster-docs.io

Direct link to changed pages:
docs/docs-next/docs/concepts/schedules

[github-actions]

Deploy preview for dagster-docs-next ready!

✅ Preview
https://dagster-docs-next-6j2qrwrxe-elementl.vercel.app

Built with commit 242a28c.
This pull request is being automatically deployed with vercel-action

[erinkcochran87]

Overall I think this is good. I'm a little curious what the concept page for automation will look like, given how high-level this is. D'you think it may wind up being duplicative?

[erinkcochran87]

lol ty for removing this

[PedramNavid]

Overall I think this is good. I'm a little curious what the concept page for automation will look like, given how high-level this is. D'you think it may wind up being duplicative?

I was worried about that too. I've started writing it now so we'll have something to compare with.

I think the Concept/Explanation page will be more in-depth. I saw it described as 'bathtub-reading' which kind of makes sense. It will talk about things like ticks, the dagster-daemon, maybe a little history (e.g. Schedules were created during the Op era which is why they are focused around jobs and ops), some corner cases like daylight savings time, how to think about timezones.

My mental model, and I don't know how good it is, is that
--> I am working on a pipeline right now and I want to automate it, I go to this page
--> I have finished a long day of working on pipelines, and I want to relax with a beer and better understand Dagster's automation system (these people do exist!), I go to Concept Page.