[docs] [pipes] - Details and customization (#17188)

dagster-io · Oct 13, 2023 · 927984b · 927984b · github-actions · Oct 13, 2023
1 parent 8c0db52
commit 927984b
Show file tree

Hide file tree

Showing 6 changed files with 437 additions and 14 deletions.
diff --git a/docs/content/_navigation.json b/docs/content/_navigation.json
@@ -871,6 +871,10 @@
                 "path": "/guides/dagster-pipes/subprocess/reference"
               }
             ]
+          },
+          {
+            "title": "Details and customization",
+            "path": "/guides/dagster-pipes/dagster-pipes-details-and-customization"
           }
         ]
       },

diff --git a/docs/content/guides.mdx b/docs/content/guides.mdx
@@ -44,6 +44,16 @@ Learn to apply [Dagster concepts](/concepts) to your work, explore experimental
 
 ---
 
+## Dagster Pipes (Experimental)
+
+- [Dagster Pipes](/guides/dagster-pipes) - A high-level look at Dagster Pipes, a toolkit for building integrations between Dagster and external execution environments
+
+- [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) - Get started using Dagster Pipes with this tutorial, where you'll use a subprocess to execute code in an external environment
+
+- [Dagster Pipes details and customization](/guides/dagster-pipes/dagster-pipes-details-and-customization) - Learn about Dagster Pipes APIs and how to compose them to create a custom solution for your data platform
+
+---
+
 ## Migrating to Dagster
 
 - [Migrating from Airflow to Dagster](/integrations/airflow/migrating-to-dagster) - Perform a lift-and-shift migration from Airflow to Dagster
@@ -76,14 +86,6 @@ Learn to apply [Dagster concepts](/concepts) to your work, explore experimental
 
 ### Experimental features
 
-#### Dagster Pipes
-
-- [Dagster Pipes](/guides/dagster-pipes) - A high-level look at Dagster Pipes, a toolkit for building integrations between Dagster and external execution environments
-
-- [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) - Get started using Dagster Pipes with this tutorial, where you'll use a subprocess to execute code in an external environment
-
-#### Other features
-
 - [Using Custom Run Coordinators to perform run attribution](/guides/dagster/run-attribution) - A look at using a Custom Run Coordinator to perform run attribution
 
 - [Airbyte ingestion as code](/guides/dagster/airbyte-ingestion-as-code) - Configure Airbyte connections with Dagster

diff --git a/docs/content/guides/dagster-pipes.mdx b/docs/content/guides/dagster-pipes.mdx
@@ -69,3 +69,5 @@ While Dagster Pipes is lightweight and flexible, there are a few limitations to
 ## Usage
 
 Ready to get started with Dagster Pipes? Check out the [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) to get up and running!
+
+If you'd prefer to create a custom solution using Dagster Pipes, check out the [Dagster Pipes details and customization guide](/guides/dagster-pipes/dagster-pipes-details-and-customization) to learn how.
diff --git a/docs/content/guides/dagster-pipes/customizing-dagster-pipes-protocols.mdx b/docs/content/guides/dagster-pipes/customizing-dagster-pipes-protocols.mdx
-Original file line number
+Diff line change
@@ Expand Up / @@ -871,6 +871,10 @@ @@
                     "path": "/guides/dagster-pipes/subprocess/reference"
                   }
                 ]
+              },
+              {
+                "title": "Details and customization",
+                "path": "/guides/dagster-pipes/dagster-pipes-details-and-customization"
               }
             ]
           },
@@ Expand Down @@
Original file line number	Diff line number	Diff line change
Expand Up		@@ -69,3 +69,5 @@ While Dagster Pipes is lightweight and flexible, there are a few limitations to
		## Usage

		Ready to get started with Dagster Pipes? Check out the [Dagster Pipes tutorial](/guides/dagster-pipes/subprocess) to get up and running!

		If you'd prefer to create a custom solution using Dagster Pipes, check out the [Dagster Pipes details and customization guide](/guides/dagster-pipes/dagster-pipes-details-and-customization) to learn how.