Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an ML pipeline tutorial #16632

Merged
merged 48 commits into from
Jan 14, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
26322c6
Add skeleton for the machine learning tutorial
djsauble Dec 11, 2024
26af78c
Merge branch 'main' into add_an_ml_tutorial
djsauble Dec 12, 2024
5c27566
Add roughed-in instructions for setting up S3, EventBridge, and webhooks
djsauble Dec 16, 2024
07245b0
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Dec 17, 2024
bdf4aff
Add more instructions for how to configure a GPU-enabled work pool
daniel-prefect Dec 17, 2024
218a28d
Tweak instructions
daniel-prefect Dec 18, 2024
0d66477
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Dec 20, 2024
def4ba1
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Jan 7, 2025
b92875c
Update instructions to match what actually ended up working
daniel-prefect Jan 7, 2025
e22d9b8
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Jan 7, 2025
b559ce4
Include a link to the Iris dataset
daniel-prefect Jan 7, 2025
0a5487f
Fix case in expandable titles
daniel-prefect Jan 7, 2025
19348ef
Improve naming of Prefect resources
daniel-prefect Jan 7, 2025
fae0c5c
Improve wording
daniel-prefect Jan 7, 2025
2a12fe6
A few more formatting improvements
daniel-prefect Jan 7, 2025
388da26
Relocate instructions for setting up a work pool and worker
daniel-prefect Jan 7, 2025
3ed3a90
Specify where you need to go to create webhooks and automations
daniel-prefect Jan 7, 2025
a7145bb
More fixes
daniel-prefect Jan 7, 2025
d51a580
Add a mild event suppression to automations
daniel-prefect Jan 7, 2025
b3dc9e8
Update code snippets
daniel-prefect Jan 7, 2025
0d532ac
Clarify that the S3 Bucket block is for the model bucket not the data…
daniel-prefect Jan 7, 2025
f816837
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Jan 7, 2025
fd5ce04
Apply suggestions from code review
daniel-prefect Jan 8, 2025
1030df7
Clarify that the ML tutorial doesn't use the data from the web scrapi…
daniel-prefect Jan 8, 2025
9f76aec
Add a sequence diagram to show the pipeline you'll construct
daniel-prefect Jan 8, 2025
6ff3d1b
Update the model training flow to use a separate template file for th…
daniel-prefect Jan 8, 2025
07acafa
Use the correct cache policy object
daniel-prefect Jan 8, 2025
7b8b864
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Jan 8, 2025
08a9dea
Update title since the webhooks are not related to S3
daniel-prefect Jan 8, 2025
69f49ae
Straight up say that this tutorial is about using webhooks
daniel-prefect Jan 8, 2025
55c9a21
Position notes over the participant that they apply to
daniel-prefect Jan 8, 2025
1c01bef
Remove the device parameter since it isn't used
daniel-prefect Jan 8, 2025
6f07b94
Apply suggestions from code review
daniel-prefect Jan 9, 2025
e230862
Apply more suggestions from code review
daniel-prefect Jan 9, 2025
d8e50c6
Merge branch 'main' into add_an_ml_tutorial
daniel-prefect Jan 10, 2025
8fd0460
Add Terraform instructions
daniel-prefect Jan 14, 2025
5b90760
Put the manual instructions back in an expandable
daniel-prefect Jan 14, 2025
e131810
Move automations to the manual provisioning section
daniel-prefect Jan 14, 2025
5a4d3f8
Clarify that 'terraform destroy' must be run from your terminal
daniel-prefect Jan 14, 2025
68ec375
Include Terraform as an optional prerequisite
daniel-prefect Jan 14, 2025
d480eee
Adjust the section heading levels
daniel-prefect Jan 14, 2025
a20f1f9
Remove 'forever-free' verbiage
daniel-prefect Jan 14, 2025
74e3019
Remove the PREFECT_API_URL export statement as it's set by default
daniel-prefect Jan 14, 2025
ebd8b1d
Remove 'free' verbiage altogether
daniel-prefect Jan 14, 2025
1251843
Revert "Remove 'free' verbiage altogether"
daniel-prefect Jan 14, 2025
1305b05
Avoid mutable arguments
daniel-prefect Jan 14, 2025
3c8ddda
Add typed parameters
daniel-prefect Jan 14, 2025
51cf365
Use a generic work pool name
daniel-prefect Jan 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/mint.json
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,8 @@
"pages": [
"v3/tutorials/schedule",
"v3/tutorials/pipelines",
"v3/tutorials/scraping"
"v3/tutorials/scraping",
"v3/tutorials/ml"
]
},
{
Expand Down
Loading
Loading