Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[review and merge in aug 2024] remove fal related resources #5368

Merged
merged 20 commits into from
Aug 12, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 0 additions & 14 deletions website/blog/maching-learning-dbt-baton-pass.md
Original file line number Diff line number Diff line change
Expand Up @@ -145,20 +145,6 @@ This wouldn’t solve for the ML engineer and her desire to inject custom ML mod

It may be worth having python scripts live side by side dbt jobs and configurations. I can get better lineage and have one less tool to context switch to.

#### fal

- [fal](https://github.com/fal-ai/fal): Makes dbt and python interoperable. Read in a dbt model as a pandas dataframe using a [ref statement](https://github.com/fal-ai/fal/blob/b20874ab957f8eb0f65c56d82e6bb85c717de4c6/examples/write_jupyter_notebook.md#example-9-use-dbt-from-a-jupyter-notebook)!

#### How would this change my story?

**A ref statement would mean the same thing to both my ML engineer and me.**

We would work in the same dbt project for the entire workflow, not just part of it. We would align python scripts to dbt configurations for better lineage (see below).

![Screenshot of fal installation instructions](/img/blog/2022-02-18-machine-learning-dbt-baton-pass/fal-install-1.png)

![Second screenshot of fal installation instructions](/img/blog/2022-02-18-machine-learning-dbt-baton-pass/fal-install-2.png)

#### What are the tradeoffs of this tool path?

When things would go wrong, it’d still be a messy jumble to figure out how SQL changes inform python changes and vice versa. And I would need to care about which infrastructure my python code is running on. But my gut tells me the tradeoff would be worth it because there’d be less notebooks to schedule, and it’d be easier to align machine learning logic to dbt logic.
Expand Down
2 changes: 1 addition & 1 deletion website/dbt-versions.js
Original file line number Diff line number Diff line change
Expand Up @@ -169,4 +169,4 @@ exports.versionedCategories = [
"category": "Build your metrics",
"firstVersion": "1.6",
}
]
]
1 change: 0 additions & 1 deletion website/docs/docs/community-adapters.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ Community adapters are adapter plugins contributed and maintained by members of
| ------------------------------------------ | -------------------------------- | ------------------------------------- |
| [Clickhouse](/docs/core/connect-data-platform/clickhouse-setup) | [Databend Cloud](/docs/core/connect-data-platform/databend-setup) | [Doris & SelectDB](/docs/core/connect-data-platform/doris-setup) |
| [DuckDB](/docs/core/connect-data-platform/duckdb-setup) | [Exasol Analytics](/docs/core/connect-data-platform/exasol-setup) | [Extrica](/docs/core/connect-data-platform/extrica-setup) |
| [fal - Python models](/docs/core/connect-data-platform/fal-setup) | [Firebolt](/docs/core/connect-data-platform/firebolt-setup) | [Greenplum](/docs/core/connect-data-platform/greenplum-setup) |
| [Hive](/docs/core/connect-data-platform/hive-setup) | [IBM DB2](/docs/core/connect-data-platform/ibmdb2-setup) | [Impala](/docs/core/connect-data-platform/impala-setup) |
| [Infer](/docs/core/connect-data-platform/infer-setup) | [iomete](/docs/core/connect-data-platform/iomete-setup) | [MindsDB](/docs/core/connect-data-platform/mindsdb-setup) |
| [MySQL](/docs/core/connect-data-platform/mysql-setup) | [RisingWave](/docs/core/connect-data-platform/risingwave-setup) | [Rockset](/docs/core/connect-data-platform/rockset-setup) |
Expand Down
51 changes: 0 additions & 51 deletions website/docs/docs/core/connect-data-platform/fal-setup.md

This file was deleted.

84 changes: 0 additions & 84 deletions website/docs/reference/resource-configs/fal-configs.md

This file was deleted.

2 changes: 0 additions & 2 deletions website/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,6 @@ const sidebarSettings = {
"docs/core/connect-data-platform/duckdb-setup",
"docs/core/connect-data-platform/exasol-setup",
"docs/core/connect-data-platform/extrica-setup",
"docs/core/connect-data-platform/fal-setup",
"docs/core/connect-data-platform/firebolt-setup",
"docs/core/connect-data-platform/greenplum-setup",
"docs/core/connect-data-platform/ibmdb2-setup",
Expand Down Expand Up @@ -834,7 +833,6 @@ const sidebarSettings = {
"reference/resource-configs/impala-configs",
"reference/resource-configs/clickhouse-configs",
"reference/resource-configs/doris-configs",
"reference/resource-configs/fal-configs",
"reference/resource-configs/firebolt-configs",
"reference/resource-configs/greenplum-configs",
"reference/resource-configs/infer-configs",
Expand Down
10 changes: 10 additions & 0 deletions website/vercel.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,16 @@
"cleanUrls": true,
"trailingSlash": false,
"redirects": [
{
"source": "/docs/core/connect-data-platform/fal-setup",
"destination": "https://github.com/fal-ai/dbt-fal",
"permanent": true
},
{
"source": "/reference/warehouse-setups/fal-setup",
"destination": "https://github.com/fal-ai/dbt-fal",
"permanent": true
},
{
"source": "docs/cloud/secure/environment-permissions",
"destination": "docs/cloud/manage-access/environment-permissions",
Expand Down
Loading