Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] [pipes] - Details and customization #17188

Merged
merged 7 commits into from
Oct 13, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/content/_navigation.json
Original file line number Diff line number Diff line change
Expand Up @@ -871,6 +871,10 @@
"path": "/guides/dagster-pipes/subprocess/reference"
}
]
},
{
"title": "Details and customization",
"path": "/guides/dagster-pipes/dagster-pipes-details-and-customization"
}
]
},
Expand Down
18 changes: 10 additions & 8 deletions docs/content/guides.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,16 @@ Learn to apply [Dagster concepts](/concepts) to your work, explore experimental

---

## Dagster Pipes (Experimental)

- [Dagster Pipes](/guides/dagster-pipes) - A high-level look at Dagster Pipes, a toolkit for building integrations between Dagster and external execution environments

- [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) - Get started using Dagster Pipes with this tutorial, where you'll use a subprocess to execute code in an external environment

- [Dagster Pipes details and customization](/guides/dagster-pipes/dagster-pipes-details-and-customization) - Learn about Dagster Pipes APIs and how to compose them to create a custom solution for your data platform

---

## Migrating to Dagster

- [Migrating from Airflow to Dagster](/integrations/airflow/migrating-to-dagster) - Perform a lift-and-shift migration from Airflow to Dagster
Expand Down Expand Up @@ -76,14 +86,6 @@ Learn to apply [Dagster concepts](/concepts) to your work, explore experimental

### Experimental features

#### Dagster Pipes

- [Dagster Pipes](/guides/dagster-pipes) - A high-level look at Dagster Pipes, a toolkit for building integrations between Dagster and external execution environments

- [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) - Get started using Dagster Pipes with this tutorial, where you'll use a subprocess to execute code in an external environment

#### Other features

- [Using Custom Run Coordinators to perform run attribution](/guides/dagster/run-attribution) - A look at using a Custom Run Coordinator to perform run attribution

- [Airbyte ingestion as code](/guides/dagster/airbyte-ingestion-as-code) - Configure Airbyte connections with Dagster
Expand Down
2 changes: 2 additions & 0 deletions docs/content/guides/dagster-pipes.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -69,3 +69,5 @@ While Dagster Pipes is lightweight and flexible, there are a few limitations to
## Usage

Ready to get started with Dagster Pipes? Check out the [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) to get up and running!

If you'd prefer to create a custom solution using Dagster Pipes, check out the [Dagster Pipes details and customization guide](/guides/dagster-pipes/dagster-pipes-details-and-customization) to learn how.

This file was deleted.

Loading