From 618cc8c9c238684693783e1ac5f14f6793ef2910 Mon Sep 17 00:00:00 2001 From: Matt Shaver <60105315+matthewshaver@users.noreply.github.com> Date: Mon, 20 May 2024 16:19:41 -0400 Subject: [PATCH 1/3] Archiving 2022 release notes --- .../docs/dbt-versions/2022-release-notes.md | 244 ++++++++++++++++++ .../86-Dec-2022/default-thread-value.md | 15 -- .../86-Dec-2022/new-jobs-default-as-off.md | 14 - .../private-packages-clone-git-token.md | 25 -- .../dbt-databricks-unity-catalog-support.md | 13 - .../ide-features-ide-deprecation.md | 37 --- .../88-Oct-2022/cloud-integration-azure.md | 15 -- .../88-Oct-2022/new-ide-launch.md | 21 -- .../liststeps-endpoint-deprecation.md | 15 -- .../metadata-api-data-retention-limits.md | 11 - .../91-Aug-2022/ide-improvement-beta.md | 36 --- .../91-Aug-2022/support-redshift-ra3.md | 18 -- .../92-July-2022/render-lineage-feature.md | 16 -- .../release-notes/93-May-2022/gitlab-auth.md | 11 - .../release-notes/94-April-2022/audit-log.md | 13 - .../94-April-2022/credentials-saved.md | 9 - .../94-April-2022/email-verification.md | 10 - .../94-April-2022/scheduler-improvements.md | 9 - .../95-March-2022/ide-timeout-message.md | 13 - .../95-March-2022/prep-and-waiting-time.md | 12 - .../96-February-2022/DAG-updates-more.md | 13 - .../96-February-2022/service-tokens-more.md | 17 -- .../97-January-2022/IDE-autocomplete-more.md | 14 - .../97-January-2022/model-timing-more.md | 15 -- website/sidebars.js | 1 + 25 files changed, 245 insertions(+), 372 deletions(-) create mode 100644 website/docs/docs/dbt-versions/2022-release-notes.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/86-Dec-2022/default-thread-value.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/86-Dec-2022/new-jobs-default-as-off.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/86-Dec-2022/private-packages-clone-git-token.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/87-Nov-2022/dbt-databricks-unity-catalog-support.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/87-Nov-2022/ide-features-ide-deprecation.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/88-Oct-2022/cloud-integration-azure.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/88-Oct-2022/new-ide-launch.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/89-Sept-2022/liststeps-endpoint-deprecation.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/89-Sept-2022/metadata-api-data-retention-limits.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/91-Aug-2022/ide-improvement-beta.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/91-Aug-2022/support-redshift-ra3.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/92-July-2022/render-lineage-feature.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/93-May-2022/gitlab-auth.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/94-April-2022/audit-log.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/94-April-2022/credentials-saved.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/94-April-2022/email-verification.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/94-April-2022/scheduler-improvements.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/95-March-2022/ide-timeout-message.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/95-March-2022/prep-and-waiting-time.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/96-February-2022/DAG-updates-more.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/96-February-2022/service-tokens-more.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/97-January-2022/IDE-autocomplete-more.md delete mode 100644 website/docs/docs/dbt-versions/release-notes/97-January-2022/model-timing-more.md diff --git a/website/docs/docs/dbt-versions/2022-release-notes.md b/website/docs/docs/dbt-versions/2022-release-notes.md new file mode 100644 index 00000000000..1c45d5ce134 --- /dev/null +++ b/website/docs/docs/dbt-versions/2022-release-notes.md @@ -0,0 +1,244 @@ +--- +title: "2022 dbt Cloud release notes" +description: "dbt Cloud release notes for 2022" +id: "2022-release-notes" +sidebar: "2022 release notes" +pagination_next: null +pagination_prev: null +--- + +Archived release notes for dbt Cloud from 2022 + +## December 2022 + +### Threads default value changed to 4 + +Threads help parallelize node execution in the dbt directed acyclic graph [(DAG)](https://docs.getdbt.com/terms/dag). + +Previously, the thread value defaulted to 1, which can increase the runtime of your project. To help reduce the runtime of your project, the default value for threads in user profiles is now set to 4 threads. + +You can supply a custom thread count if you'd prefer more or less parallelization. + +For more information, read [Understanding threads](/docs/running-a-dbt-project/using-threads). + +### Creating a new job no longer triggers a run by default + +To help save compute time, new jobs will no longer be triggered to run by default. When you create a new job in dbt Cloud, you can trigger the job to run by selecting **Run on schedule** and completing the desired schedule and timing information. + +For more information, refer to [Deploy jobs](/docs/deploy/deploy-jobs). + + + +### Private packages must be cloned using access tokens provided by environment variables + +The supported method for cloning private GitHub packages is the [git token method](/docs/build/packages#git-token-method), where an appropriate access token is passed into the package repository URL with an environment variable. + +A small number of people have been able to clone private packages using dbt's native GitHub application without explicitly providing an access token. This functionality is being deprecated as it’s limited in flexibility. + +If you have been using a package hosted in a private repository on GitHub, you must start passing an access token into the URL. + +An example of passing an access token: + + + +```yaml + +packages: +- git: "https://{{env_var('DBT_ENV_SECRET_GIT_CREDENTIAL')}}@github.com/dbt-labs/awesome_repo.git" + +``` + + + + +## Novemver 2022 + +### The dbt Cloud + Databricks experience is getting even better" + +dbt Cloud is the easiest and most reliable way to develop and deploy a dbt project. It helps remove complexity while also giving you more features and better performance. A simpler Databricks connection experience with support for Databricks’ Unity Catalog and better modeling defaults is now available for your use. + +For all the Databricks customers already using dbt Cloud with the dbt-spark adapter, you can now [migrate](/guides/migrate-from-spark-to-databricks) your connection to the [dbt-databricks adapter](/docs/core/connect-data-platform/databricks-setup) to get the benefits. [Databricks](https://www.databricks.com/blog/2022/11/17/introducing-native-high-performance-integration-dbt-cloud.html) is committed to maintaining and improving the adapter, so this integrated experience will continue to provide the best of dbt and Databricks. + +Check out our [live blog post](https://www.getdbt.com/blog/dbt-cloud-databricks-experience/) to learn more. + +### Extra features in new and refreshed IDE + +The refreshed version of the dbt Cloud IDE has launched four brand-new additional features, making it easier and faster for you to develop in the IDE. + +The new features are: + +- **Formatting** — Format your dbt SQL files to a single code style with a click of a button. This uses the tool [sqlfmt](https://github.com/tconbeer/sqlfmt). +- **Git diff view** — Highlights the changes in a file before opening a pull request. +- **dbt autocomplete** — There are four new types of autocomplete features to help you develop faster: + - Use `ref` to autocomplete your model names + - Use `source` to autocomplete your source name + table name + - Use `macro` to autocomplete your arguments + - Use `env var` to autocomplete env var +- **Dark mode** — Use dark mode in the dbt Cloud IDE for low-light environments. + +Read more about all the [Cloud IDE features](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud#cloud-ide-features). + +### Classic IDE deprecation notice + +In December 2022, dbt Labs will deprecate the classic IDE. The [new and refreshed IDE](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud) will be available for _all_ dbt Cloud users. You will no longer be able to access the classic IDE and dbt Labs might introduce changes that break the classic IDE. + +With deprecation, dbt Labs will only support the refreshed version of the dbt Cloud IDE. + +Virtual Private Cloud (VPC) customers with questions about when this change will affect your account can contact your account team or support contact for assistance. + + +## October 2022 + +### Announcing dbt Cloud’s native integration with Azure DevOps + +dbt Cloud now offers a native integration with Azure DevOps for dbt Cloud customers on the enterprise plan. We built this integration to remove friction, increase security, and unlock net new product experiences for our customers. [Setting up the Azure DevOps integration](/docs/cloud/git/connect-azure-devops) in dbt Cloud provides: + - easy dbt project set up, + - an improved security posture, + - repo permissions enforcement in dbt Cloud IDE, and + - dbt Cloud Slim CI. + +Check out our [live blog post](https://www.getdbt.com/blog/dbt-cloud-integration-azure-devops/) to learn more! + +### Introducing a snappier, improved, and powerful Cloud IDE + +The new version of the Cloud IDE makes it easy for you to build data models without thinking much about environment setup and configuration. + +The new Cloud IDE includes performance upgrades, ergonomics improvements, and some delightful enhancements! + +Some of the improvements include: + +- Improved Cloud IDE startup time (starting the IDE), interaction time (saving and committing), and reliability. +- Better organization and navigation with features like drag and drop of files, breadcrumb, build button drop-down, and more. +- You can use new features like auto-format your file, auto-complete model names, and git diff view to see your changes before making a pull request. + +Read more about the new [Cloud IDE features](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud#cloud-ide-features) and check out [New and improved Cloud IDE](https://www.getdbt.com/blog/new-improved-cloud-ide/) blog for more info! + +## September 2022 + +### List Steps API endpoint deprecation warning + +On October 14th, 2022 dbt Labs is deprecating the [List Steps](https://docs.getdbt.com/dbt-cloud/api-v2-legacy#tag/Runs/operation/listSteps) API endpoint. From October 14th, any GET requests to this endpoint will fail. Please prepare to stop using the List Steps endpoint as soon as possible. + +dbt Labs will continue to maintain the [Get Run](https://docs.getdbt.com/dbt-cloud/api-v2-legacy#tag/Runs/operation/getRunById) endpoint, which is a viable alternative depending on the use case. + +You can fetch run steps for an individual run with a GET request to the following URL, replacing `YOUR_ACCESS_URL` with the [appropriate Access URL](/docs/cloud/about-cloud/access-regions-ip-addresses) for your region and plan: + +`https://YOUR_ACCESS_URL/api/v2/accounts/{accountId}/runs/{runId}/?include_related=["run_steps"]` + +### Query the previous three months of data using the metadata API + +In order to make the metadata API more scalable and improve its latency, we’ve implemented data retention limits. The metadata API can now query data from the previous three months. For example, if today was March 1, you could query data back to January 1st. + +For more information, see [Metadata API](/docs/dbt-cloud-apis/discovery-api) + +## August 2022 + +### Support for cross-database sources on Redshift RA3 instances + +Cross-database queries for RA3 instances are now supported by dbt Cloud projects using a Redshift connection. + +With cross-database queries, you can seamlessly query data from any database in the cluster, regardless of which database you are connected to with dbt. + +The [connection configuration](https://docs.getdbt.com/reference/warehouse-profiles/redshift-profile) `ra3_node` has been defaulted to `true`. This allows users to: + +- benefit from the full RA3 nodes’ capabilities, +- generate appropriate dbt documentation. + +## July 2022 + +### Large DAG feature + +You can now select **Render Lineage** to visualize large DAGs. + +Large DAGs can take a long time (10 or more seconds, if not minutes) to render and can cause browsers to crash. + +The new button prevents large DAGs from rendering automatically. Instead, you can select **Render Lineage** to load the visualization. This should affect about 15% of the DAGs. + + + +## May 2022 + +### Refresh expired access tokens in the IDE when using GitLab + +On May 22, GitLab changed how they treat [OAuth access tokens that don't expire](https://docs.gitlab.com/ee/update/deprecations.html#oauth-tokens-without-expiration). We updated our IDE logic to handle OAuth token expiration more gracefully. Now, the first time your token expires after 2 hours of consecutive IDE usage, you will have to re-authenticate in GitLab to refresh your expired OAuth access token. We will handle subsequent refreshes for you if you provide the authorization when you re-authenticate. + +This additional security layer in the IDE is available only to the dbt Cloud enterprise plan. + +## April 2022 + +## Audit log + +To review actions performed by people in your organization, dbt provides logs of audited user and system events. The dbt Cloud audit log lists events triggered in your organization within the last 90 days. + +The audit log includes details such as who performed the action, what the action was, and when it was performed. For more details, review [the audit log for dbt Cloud Enterprise](/docs/cloud/manage-access/audit-log) documentation. + + +### Credentials no longer accidentally wiped when editing an environment + +We resolved a bug where when updating unencrypted fields (e.g. threads, schema name) in an environment setting would cause secret fields (e.g. password, keypair, credential details) to be deleted from that environment. Now users can freely update environment settings without fear of unintentionally wiping credentials. + +### Email verification + +To enhance the security of user creation, dbt Cloud users created using SAML Just-in-Time (JIT) will now confirm identity via email to activate their account. Using email to confirm identity ensures the user still has access to the same email address they use to login via SAML. + +### Scheduler performance improvements + +We rolled out our new distributed scheduler, which has much faster prep times, especially at the top of the hour. We share more about our work and improvements in our [product news blog post](https://www.getdbt.com/blog/a-good-problem-to-have/). + +## March 2022 + +### Spotty internet issues no longer cause a session time out message + +We fixed an issue where a spotty internet connection could cause the “IDE session timed out” message to appear unexpectedly. People using a VPN were most likely to see this issue. + +We updated the health check logic so it now excludes client-side connectivity issues from the IDE session check. If you lose your internet connection, we no longer update the health-check state. Now, losing internet connectivity will no longer cause this unexpected message. + + + +### Dividing queue time into waiting and prep time + +dbt Cloud now shows "waiting time" and "prep time" for a run, which used to be expressed in aggregate as "queue time". Waiting time captures the time dbt Cloud waits to run your job if there isn't an available run slot or if a previous run of the same job is still running. Prep time represents the time it takes dbt Cloud to ready your job to run in your cloud data warehouse. + + + +## February 2022 + +### DAG updates and performance improvements + +Love the DAG in the IDE as much as we do? Now when you click on a node in the DAG, the model or config file will open as a new tab in the IDE, so you can directly view or edit the code. We'll continue to ship better developer ergonomic functionality throughout the year. + +#### Performance improvements and enhancements + +* Updated recommended dbt commands in the IDE to include dbt Core v1.0 commands, such as "build" and the "--select" argument. + +### Service tokens and bug fixes + +Service tokens can now be assigned granular permissions to enforce least privilege access. If you're on Enterprise, you can assign any enterprise permission set to newly issued service tokens. If you're on Teams, you can assign the Job Admin permission set to newly issued service tokens. We highly recommend you re-issue service tokens with these new permissions to increase your security posture! See docs [here](https://docs.getdbt.com/docs/dbt-cloud-apis/service-tokens#permissions-for-service-account-tokens). + +#### New products and features + +- We are joining the [GitHub secret scanning partner program](https://docs.github.com/en/developers/overview/secret-scanning-partner-program) to better secure your token against accidental public exposure and potential fraudulent usage. + +#### Bug fixes + +- Credentials are no longer accidentally deleted when a user updates an environment setting. + +## January 2022 + +### Autocomplete snippets for SQL and YAML files in IDE + +Some noteworthy improvements include autocomplete snippets for sql and YAML files in the IDE, which are available for use now! We also added a [new metric layer page](https://docs.getdbt.com/docs/dbt-cloud/using-dbt-cloud/cloud-metrics-layer) to docs.getdbt.com to help you begin thinking about the metrics layer in dbt Cloud. + +#### Performance improvements and enhancements + +* Branch names now default to "main" instead of "master" in new managed and unmanaged Git repositories. +* Update IDE autocomplete snippets. + + +### Model timing for Multi-tenant Team and Enterprise accounts + +We started the new year with a gift! Multi-tenant Team and Enterprise accounts can now use the new [Model timing](https://docs.getdbt.com/docs/dbt-cloud/using-dbt-cloud/cloud-model-timing-tab) tab in dbt Cloud. You can use this tab to further explore long-running models to see if they need refactoring or rescheduling. + +#### Performance improvements and enhancements + +* We added client-side naming validation for file or folder creation. \ No newline at end of file diff --git a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/default-thread-value.md b/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/default-thread-value.md deleted file mode 100644 index 90f3156599c..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/default-thread-value.md +++ /dev/null @@ -1,15 +0,0 @@ ---- -title: "Threads default value changed to 4" -id: "default-thread-value" -description: "Threads now default to 4 users' profile." -sidebar_label: "Enhancement: Threads default value changed to 4 " -tags: [Dec-2022] ---- - -Threads help parallelize node execution in the dbt directed acyclic graph [(DAG)](https://docs.getdbt.com/terms/dag). - -Previously, the thread value defaulted to 1, which can increase the runtime of your project. To help reduce the runtime of your project, the default value for threads in user profiles is now set to 4 threads. - -You can supply a custom thread count if you'd prefer more or less parallelization. - -For more information, read [Understanding threads](/docs/running-a-dbt-project/using-threads). diff --git a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/new-jobs-default-as-off.md b/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/new-jobs-default-as-off.md deleted file mode 100644 index bdc89b4abde..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/new-jobs-default-as-off.md +++ /dev/null @@ -1,14 +0,0 @@ ---- -title: "Creating a new job no longer triggers a run by default" -id: "new-jobs-default-as-off.md" -description: "You need to click **Run on schedule** before a job will be scheduled to run" -sidebar_label: "Improvement: New jobs no longer run by default" -tags: [Dec-2022] ---- - -To help save compute time, new jobs will no longer be triggered to run by default. When you create a new job in dbt Cloud, you can trigger the job to run by selecting **Run on schedule** and completing the desired schedule and timing information. - -For more information, refer to [Deploy jobs](/docs/deploy/deploy-jobs). - - - diff --git a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/private-packages-clone-git-token.md b/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/private-packages-clone-git-token.md deleted file mode 100644 index 75db9d1888b..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/86-Dec-2022/private-packages-clone-git-token.md +++ /dev/null @@ -1,25 +0,0 @@ ---- -title: "Private packages must be cloned using access tokens provided by environment variables" -description: "Private GitHub packages must be cloned using access tokens provided by environment variables." -sidebar_label: "Deprecation: Private packages must be cloned using access tokens" -tags: [Dec-2022] ---- - -The supported method for cloning private GitHub packages is the [git token method](/docs/build/packages#git-token-method), where an appropriate access token is passed into the package repository URL with an environment variable. - -A small number of people have been able to clone private packages using dbt's native GitHub application without explicitly providing an access token. This functionality is being deprecated as it’s limited in flexibility. - -If you have been using a package hosted in a private repository on GitHub, you must start passing an access token into the URL. - -An example of passing an access token: - - - -```yaml - -packages: -- git: "https://{{env_var('DBT_ENV_SECRET_GIT_CREDENTIAL')}}@github.com/dbt-labs/awesome_repo.git" - -``` - - diff --git a/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/dbt-databricks-unity-catalog-support.md b/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/dbt-databricks-unity-catalog-support.md deleted file mode 100644 index 012615e1e4e..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/dbt-databricks-unity-catalog-support.md +++ /dev/null @@ -1,13 +0,0 @@ ---- -title: "The dbt Cloud + Databricks experience is getting even better" -id: "cloud-databricks-unitycatalog" -description: "The dbt-databricks adapter is now available for use with dbt Cloud" -sidebar_label: "Enhancement: Support for Databricks Unity Catalog with dbt-databricks" -tags: [Nov-2022, v1.1.66.15] ---- - -dbt Cloud is the easiest and most reliable way to develop and deploy a dbt project. It helps remove complexity while also giving you more features and better performance. A simpler Databricks connection experience with support for Databricks’ Unity Catalog and better modeling defaults is now available for your use. - -For all the Databricks customers already using dbt Cloud with the dbt-spark adapter, you can now [migrate](/guides/migrate-from-spark-to-databricks) your connection to the [dbt-databricks adapter](/docs/core/connect-data-platform/databricks-setup) to get the benefits. [Databricks](https://www.databricks.com/blog/2022/11/17/introducing-native-high-performance-integration-dbt-cloud.html) is committed to maintaining and improving the adapter, so this integrated experience will continue to provide the best of dbt and Databricks. - -Check out our [live blog post](https://www.getdbt.com/blog/dbt-cloud-databricks-experience/) to learn more. diff --git a/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/ide-features-ide-deprecation.md b/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/ide-features-ide-deprecation.md deleted file mode 100644 index 87a7b179b6d..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/87-Nov-2022/ide-features-ide-deprecation.md +++ /dev/null @@ -1,37 +0,0 @@ ---- - -title: "New IDE features and classic IDE deprecation" -id: "ide-features-ide-deprecation" -description: "Nov 2022 release note: We've enhanced the IDE by adding a button to automatically format your SQL. Added dark mode, Git diff view, and 4 new autocomplete options. We have deprecated the classic IDE." -sidebar_label: "Enhancement and deprecation: New IDE features and classic IDE deprecation" -tags: - - Nov-2022 - - v1.1.67.0 - - IDE - ---- - -### Extra features in new and refreshed IDE - -The refreshed version of the dbt Cloud IDE has launched four brand-new additional features, making it easier and faster for you to develop in the IDE. - -The new features are: - -- **Formatting** — Format your dbt SQL files to a single code style with a click of a button. This uses the tool [sqlfmt](https://github.com/tconbeer/sqlfmt). -- **Git diff view** — Highlights the changes in a file before opening a pull request. -- **dbt autocomplete** — There are four new types of autocomplete features to help you develop faster: - - Use `ref` to autocomplete your model names - - Use `source` to autocomplete your source name + table name - - Use `macro` to autocomplete your arguments - - Use `env var` to autocomplete env var -- **Dark mode** — Use dark mode in the dbt Cloud IDE for low-light environments. - -Read more about all the [Cloud IDE features](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud#cloud-ide-features). - -### Classic IDE deprecation notice - -In December 2022, dbt Labs will deprecate the classic IDE. The [new and refreshed IDE](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud) will be available for _all_ dbt Cloud users. You will no longer be able to access the classic IDE and dbt Labs might introduce changes that break the classic IDE. - -With deprecation, dbt Labs will only support the refreshed version of the dbt Cloud IDE. - -Virtual Private Cloud (VPC) customers with questions about when this change will affect your account can contact your account team or support contact for assistance. diff --git a/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/cloud-integration-azure.md b/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/cloud-integration-azure.md deleted file mode 100644 index 513c2ef1258..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/cloud-integration-azure.md +++ /dev/null @@ -1,15 +0,0 @@ ---- -title: "Announcing dbt Cloud’s native integration with Azure DevOps" -id: "cloud-integration-azure" -description: "dbt Cloud native integration with Azure DevOps" -sidebar_label: "Improvement: Native integration with Azure DevOps" -tags: [Oct-2022, v1.1.64] ---- - -dbt Cloud now offers a native integration with Azure DevOps for dbt Cloud customers on the enterprise plan. We built this integration to remove friction, increase security, and unlock net new product experiences for our customers. [Setting up the Azure DevOps integration](/docs/cloud/git/connect-azure-devops) in dbt Cloud provides: - - easy dbt project set up, - - an improved security posture, - - repo permissions enforcement in dbt Cloud IDE, and - - dbt Cloud Slim CI. - -Check out our [live blog post](https://www.getdbt.com/blog/dbt-cloud-integration-azure-devops/) to learn more! diff --git a/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/new-ide-launch.md b/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/new-ide-launch.md deleted file mode 100644 index aaf5f670e09..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/88-Oct-2022/new-ide-launch.md +++ /dev/null @@ -1,21 +0,0 @@ ---- -title: "Enhancement: New Cloud IDE launch" -id: "new-ide-launch" -description: "Oct 2022 release note: Introducing a new dbt Cloud IDE that's faster, has performance upgrades, ergonomics improvements, and other delightful enhancements." -sidebar_label: "Snappier, faster, and new Cloud IDE" -tags: [Oct-2022, IDE] ---- - -## Introducing a snappier, improved, and powerful Cloud IDE - -The new version of the Cloud IDE makes it easy for you to build data models without thinking much about environment setup and configuration. - -The new Cloud IDE includes performance upgrades, ergonomics improvements, and some delightful enhancements! - -Some of the improvements include: - -- Improved Cloud IDE startup time (starting the IDE), interaction time (saving and committing), and reliability. -- Better organization and navigation with features like drag and drop of files, breadcrumb, build button drop-down, and more. -- You can use new features like auto-format your file, auto-complete model names, and git diff view to see your changes before making a pull request. - -Read more about the new [Cloud IDE features](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud#cloud-ide-features) and check out [New and improved Cloud IDE](https://www.getdbt.com/blog/new-improved-cloud-ide/) blog for more info! diff --git a/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/liststeps-endpoint-deprecation.md b/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/liststeps-endpoint-deprecation.md deleted file mode 100644 index 9cae773ea3e..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/liststeps-endpoint-deprecation.md +++ /dev/null @@ -1,15 +0,0 @@ ---- -title: "List Steps API endpoint deprecation warning" -id: "liststeps-endpoint-deprecation.md" -description: "List Steps API deprecation" -sidebar_label: "Deprecation: List Steps API endpoint" -tags: [Sept-2022] ---- - -On October 14th, 2022 dbt Labs is deprecating the [List Steps](https://docs.getdbt.com/dbt-cloud/api-v2-legacy#tag/Runs/operation/listSteps) API endpoint. From October 14th, any GET requests to this endpoint will fail. Please prepare to stop using the List Steps endpoint as soon as possible. - -dbt Labs will continue to maintain the [Get Run](https://docs.getdbt.com/dbt-cloud/api-v2-legacy#tag/Runs/operation/getRunById) endpoint, which is a viable alternative depending on the use case. - -You can fetch run steps for an individual run with a GET request to the following URL, replacing `YOUR_ACCESS_URL` with the [appropriate Access URL](/docs/cloud/about-cloud/access-regions-ip-addresses) for your region and plan: - -`https://YOUR_ACCESS_URL/api/v2/accounts/{accountId}/runs/{runId}/?include_related=["run_steps"]` diff --git a/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/metadata-api-data-retention-limits.md b/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/metadata-api-data-retention-limits.md deleted file mode 100644 index 3ced6fecedd..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/89-Sept-2022/metadata-api-data-retention-limits.md +++ /dev/null @@ -1,11 +0,0 @@ ---- -title: "Query the previous three months of data using the metadata API" -id: "metadata-api-data-retention-limits.md" -description: "Metadata API data retention limits" -sidebar_label: "Fix: Metadata API data retention limits" -tags: [Sept-2022] ---- - -In order to make the metadata API more scalable and improve its latency, we’ve implemented data retention limits. The metadata API can now query data from the previous three months. For example, if today was March 1, you could query data back to January 1st. - -For more information, see [Metadata API](/docs/dbt-cloud-apis/discovery-api) diff --git a/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/ide-improvement-beta.md b/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/ide-improvement-beta.md deleted file mode 100644 index aa2c5ee4fa7..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/ide-improvement-beta.md +++ /dev/null @@ -1,36 +0,0 @@ ---- -title: "Enhancement: New Cloud IDE beta" -id: "ide-improvements-beta.md" -description: "Aug 2022 release note: Launch of the IDE beta, which focuses on performance and reliability improvements." -sidebar_label: "Enhancement: New cloud IDE beta" -tags: [Aug-2022, IDE] ---- - -:::info Beta feature -Read more about the [Cloud IDE beta](https://www.getdbt.com/blog/staging-highlights-the-latest-from-dbt-labs/) and [submit your expression of interest](https://docs.google.com/forms/d/e/1FAIpQLSdlU65gqTZPyGAUc16SkxqTc50NO9vdq_KGx1Mjm_4FB_97FA/viewform) to join the new Cloud IDE beta group. - -::: - -Building code on the dbt Cloud integrated development environment (IDE) should be seamless, and the tool that you’re using should not add more distractions to the data work that is often already confusing and difficult. - -We're now excited to start rolling out the IDE Beta version, which focuses on performance and reliability improvements. - -The classic IDE currently has severe performance and reliability issues. It takes a long time to start up the IDE, and the interactions (saving or committing) are slow. - -Our focus is on performance and reliability, particularly around the following four metrics: - -- Spinner time for cold start = Time that you see a spinner in a brand new session. -- Spinner time for hot start = Time that you see a spinner when you resume an existing session (return within 3 hours). -- Time to save = Time between saving a file and the IDE being ready for edit. -- Time to git = Time between making a commit and the IDE being ready for edit. - -**Improvements:** - -To address the issue, we rebuilt the IDE and made some significant architectural changes to the way we work. These changes will help improve the IDE performance and reliability: - -- Your IDE spinner and interaction time will be faster, regardless of the size of your dbt project. - - Instead of fetching and downloading all the contents for the files during any change, the IDE only needs the file tree/name. This means that starting up the IDE should no longer depend on the size of the dbt project. This also helps make the interaction with the IDE (saving files and committing changes) more snappy. - -- Your IDE spinner time will be quicker as you can access it without needing to wait for the rpc server to finish getting ready. - - diff --git a/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/support-redshift-ra3.md b/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/support-redshift-ra3.md deleted file mode 100644 index f48a8539923..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/91-Aug-2022/support-redshift-ra3.md +++ /dev/null @@ -1,18 +0,0 @@ ---- -title: "Enhancement: Support for cross-database sources on Redshift RA3 instances" -id: "support-redshift-ra3.md" -description: "Adding support for cross-database queries for RA3" -sidebar_label: "Enhancement: Support for RA3" -tags: [Aug-2022, 1.1.61.5] - ---- - -Cross-database queries for RA3 instances are now supported by dbt Cloud projects using a Redshift connection. - -With cross-database queries, you can seamlessly query data from any database in the cluster, regardless of which database you are connected to with dbt. - -The [connection configuration](https://docs.getdbt.com/reference/warehouse-profiles/redshift-profile) `ra3_node` has been defaulted to `true`. This allows users to: - -- benefit from the full RA3 nodes’ capabilities, -- generate appropriate dbt documentation. - diff --git a/website/docs/docs/dbt-versions/release-notes/92-July-2022/render-lineage-feature.md b/website/docs/docs/dbt-versions/release-notes/92-July-2022/render-lineage-feature.md deleted file mode 100644 index 2d0488d4488..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/92-July-2022/render-lineage-feature.md +++ /dev/null @@ -1,16 +0,0 @@ ---- -title: "Enhancement: Large DAG feature" -id: "render-lineage-feature" -description: "Jul 2022 release note: Use the Render Lineage button to visualize large DAGs" -sidebar_label: "Enhancement: Large DAG feature" -tags: [July-2022, v1.1.56, IDE] - ---- - -You can now select **Render Lineage** to visualize large DAGs. - -Large DAGs can take a long time (10 or more seconds, if not minutes) to render and can cause browsers to crash. - -The new button prevents large DAGs from rendering automatically. Instead, you can select **Render Lineage** to load the visualization. This should affect about 15% of the DAGs. - - diff --git a/website/docs/docs/dbt-versions/release-notes/93-May-2022/gitlab-auth.md b/website/docs/docs/dbt-versions/release-notes/93-May-2022/gitlab-auth.md deleted file mode 100644 index 4e7c9ec3ea3..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/93-May-2022/gitlab-auth.md +++ /dev/null @@ -1,11 +0,0 @@ ---- -title: "Refresh expired access tokens in the IDE when using GitLab" -id: "gitlab-auth" -description: "Adding support for expiring OAuth access tokens." -sidebar_label: "Enhancement: Refreshing GitLab OAuth Access" -tags: [May-2022, v1.1.52] ---- - -On May 22, GitLab changed how they treat [OAuth access tokens that don't expire](https://docs.gitlab.com/ee/update/deprecations.html#oauth-tokens-without-expiration). We updated our IDE logic to handle OAuth token expiration more gracefully. Now, the first time your token expires after 2 hours of consecutive IDE usage, you will have to re-authenticate in GitLab to refresh your expired OAuth access token. We will handle subsequent refreshes for you if you provide the authorization when you re-authenticate. - -This additional security layer in the IDE is available only to the dbt Cloud enterprise plan. diff --git a/website/docs/docs/dbt-versions/release-notes/94-April-2022/audit-log.md b/website/docs/docs/dbt-versions/release-notes/94-April-2022/audit-log.md deleted file mode 100644 index d0cc9208e1e..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/94-April-2022/audit-log.md +++ /dev/null @@ -1,13 +0,0 @@ ---- -title: "Audit log" -id: "audit-log" -description: "Review actions performed by people in your organization." -sidebar_label: "New: Audit log" - -tags: [April-26-2022] ---- - - -To review actions performed by people in your organization, dbt provides logs of audited user and system events. The dbt Cloud audit log lists events triggered in your organization within the last 90 days. - -The audit log includes details such as who performed the action, what the action was, and when it was performed. For more details, review [the audit log for dbt Cloud Enterprise](/docs/cloud/manage-access/audit-log) documentation. diff --git a/website/docs/docs/dbt-versions/release-notes/94-April-2022/credentials-saved.md b/website/docs/docs/dbt-versions/release-notes/94-April-2022/credentials-saved.md deleted file mode 100644 index 388f133e861..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/94-April-2022/credentials-saved.md +++ /dev/null @@ -1,9 +0,0 @@ ---- -title: "Credentials no longer accidentally wiped when editing an environment" -id: "credentials-saved" -description: "Credentials are now saved when editing an environment." -sidebar_label: "Fix: Credentials saved" -tags: [April-29-2022, v1.1.51] ---- - -We resolved a bug where when updating unencrypted fields (e.g. threads, schema name) in an environment setting would cause secret fields (e.g. password, keypair, credential details) to be deleted from that environment. Now users can freely update environment settings without fear of unintentionally wiping credentials. diff --git a/website/docs/docs/dbt-versions/release-notes/94-April-2022/email-verification.md b/website/docs/docs/dbt-versions/release-notes/94-April-2022/email-verification.md deleted file mode 100644 index 4beff1b5506..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/94-April-2022/email-verification.md +++ /dev/null @@ -1,10 +0,0 @@ ---- -title: "Email verification" -description: "dbt Cloud users created via SAML JIT will now confirm identity via email to activate their account." -sidebar_label: "New: Email verification" -sidebar_position: 1 - -tags: [April-26-2022, v1.1.48] ---- - -To enhance the security of user creation, dbt Cloud users created using SAML Just-in-Time (JIT) will now confirm identity via email to activate their account. Using email to confirm identity ensures the user still has access to the same email address they use to login via SAML. diff --git a/website/docs/docs/dbt-versions/release-notes/94-April-2022/scheduler-improvements.md b/website/docs/docs/dbt-versions/release-notes/94-April-2022/scheduler-improvements.md deleted file mode 100644 index 02d3f1bf401..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/94-April-2022/scheduler-improvements.md +++ /dev/null @@ -1,9 +0,0 @@ ---- -title: "Scheduler performance improvements" -id: "scheduler-improvements" -description: "scheduler, which has much faster prep times, especially at the top of the hour." -sidebar_label: "Improvement: Scheduler performance" -tags: [April-19-2022] ---- - -We rolled out our new distributed scheduler, which has much faster prep times, especially at the top of the hour. We share more about our work and improvements in our [product news blog post](https://www.getdbt.com/blog/a-good-problem-to-have/). diff --git a/website/docs/docs/dbt-versions/release-notes/95-March-2022/ide-timeout-message.md b/website/docs/docs/dbt-versions/release-notes/95-March-2022/ide-timeout-message.md deleted file mode 100644 index 307786c6b85..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/95-March-2022/ide-timeout-message.md +++ /dev/null @@ -1,13 +0,0 @@ ---- -title: "Spotty internet issues no longer cause a session time out message" -id: "ide-timeout-message" -description: "Mar 2022 release note: We fixed an issue where a spotty internet connection could cause the “IDE session timed out” message to appear unexpectedly. People using a VPN were most likely to see this issue." -sidebar_label: "Fix: Session time out" -tags: [v1.1.47, March-10-2022, IDE] ---- - -We fixed an issue where a spotty internet connection could cause the “IDE session timed out” message to appear unexpectedly. People using a VPN were most likely to see this issue. - -We updated the health check logic so it now excludes client-side connectivity issues from the IDE session check. If you lose your internet connection, we no longer update the health-check state. Now, losing internet connectivity will no longer cause this unexpected message. - - diff --git a/website/docs/docs/dbt-versions/release-notes/95-March-2022/prep-and-waiting-time.md b/website/docs/docs/dbt-versions/release-notes/95-March-2022/prep-and-waiting-time.md deleted file mode 100644 index 9ff5986b4da..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/95-March-2022/prep-and-waiting-time.md +++ /dev/null @@ -1,12 +0,0 @@ ---- -title: "Dividing queue time into waiting and prep time" -id: "prep-and-waiting-time" -description: "dbt Cloud now shows waiting time and prep time for a run." -sidebar_label: "Enhancement: Waiting time and prep time" - -tags: [v1.1.46, March-02-2022] ---- - -dbt Cloud now shows "waiting time" and "prep time" for a run, which used to be expressed in aggregate as "queue time". Waiting time captures the time dbt Cloud waits to run your job if there isn't an available run slot or if a previous run of the same job is still running. Prep time represents the time it takes dbt Cloud to ready your job to run in your cloud data warehouse. - - diff --git a/website/docs/docs/dbt-versions/release-notes/96-February-2022/DAG-updates-more.md b/website/docs/docs/dbt-versions/release-notes/96-February-2022/DAG-updates-more.md deleted file mode 100644 index 6557d080394..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/96-February-2022/DAG-updates-more.md +++ /dev/null @@ -1,13 +0,0 @@ ---- -title: "DAG updates and performance improvements" -description: "Feb 2022 release note: Clicking a node in the DAG opens a model or config file in new tab in the IDE." -id: "DAG-updates-more" -sidebar_label: "DAG updates and more" -tags: [v1.1.44, February-02-2022, IDE] ---- - -Love the DAG in the IDE as much as we do? Now when you click on a node in the DAG, the model or config file will open as a new tab in the IDE, so you can directly view or edit the code. We'll continue to ship better developer ergonomic functionality throughout the year. - -#### Performance improvements and enhancements - -* Updated recommended dbt commands in the IDE to include dbt Core v1.0 commands, such as "build" and the "--select" argument. \ No newline at end of file diff --git a/website/docs/docs/dbt-versions/release-notes/96-February-2022/service-tokens-more.md b/website/docs/docs/dbt-versions/release-notes/96-February-2022/service-tokens-more.md deleted file mode 100644 index 5ad241d1365..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/96-February-2022/service-tokens-more.md +++ /dev/null @@ -1,17 +0,0 @@ ---- -title: "Service tokens and bug fixes" -is: "service-tokens-more" -description: "Service tokens can now be assigned granular permissions to enforce least privilege access." -sidebar_label: "Service tokens and more" -tags: [v1.1.45, February-16-2022] ---- - -Service tokens can now be assigned granular permissions to enforce least privilege access. If you're on Enterprise, you can assign any enterprise permission set to newly issued service tokens. If you're on Teams, you can assign the Job Admin permission set to newly issued service tokens. We highly recommend you re-issue service tokens with these new permissions to increase your security posture! See docs [here](https://docs.getdbt.com/docs/dbt-cloud-apis/service-tokens#permissions-for-service-account-tokens). - -#### New products and features - -- We are joining the [GitHub secret scanning partner program](https://docs.github.com/en/developers/overview/secret-scanning-partner-program) to better secure your token against accidental public exposure and potential fraudulent usage. - -#### Bug fixes - -- Credentials are no longer accidentally deleted when a user updates an environment setting. diff --git a/website/docs/docs/dbt-versions/release-notes/97-January-2022/IDE-autocomplete-more.md b/website/docs/docs/dbt-versions/release-notes/97-January-2022/IDE-autocomplete-more.md deleted file mode 100644 index c29ed790e8e..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/97-January-2022/IDE-autocomplete-more.md +++ /dev/null @@ -1,14 +0,0 @@ ---- -title: "Autocomplete snippets for SQL and YAML files in IDE" -id: "ide-timeout-message" -description: "Jan 2022 release note: Autocomplete snippets for SQL and YAML files in IDE" -sidebar_label: "Autocomplete in IDE and more" -tags: [v1.1.43, January-19-2022, IDE] ---- - -Some noteworthy improvements include autocomplete snippets for sql and YAML files in the IDE, which are available for use now! We also added a [new metric layer page](https://docs.getdbt.com/docs/dbt-cloud/using-dbt-cloud/cloud-metrics-layer) to docs.getdbt.com to help you begin thinking about the metrics layer in dbt Cloud. - -#### Performance improvements and enhancements - -* Branch names now default to "main" instead of "master" in new managed and unmanaged Git repositories. -* Update IDE autocomplete snippets. diff --git a/website/docs/docs/dbt-versions/release-notes/97-January-2022/model-timing-more.md b/website/docs/docs/dbt-versions/release-notes/97-January-2022/model-timing-more.md deleted file mode 100644 index 6f49fe5d336..00000000000 --- a/website/docs/docs/dbt-versions/release-notes/97-January-2022/model-timing-more.md +++ /dev/null @@ -1,15 +0,0 @@ ---- -title: "Model timing for Multi-tenant Team and Enterprise accounts" -id: "model-timing-more" -description: "Model timing is now available for Multi-tenant Team and Enterprise accounts, plus performance improvements." -sidebar_label: "Model timing and more" - -tags: [v1.1.42, January-05-2022] ---- -#### New products and features - -We started the new year with a gift! Multi-tenant Team and Enterprise accounts can now use the new [Model timing](https://docs.getdbt.com/docs/dbt-cloud/using-dbt-cloud/cloud-model-timing-tab) tab in dbt Cloud. You can use this tab to further explore long-running models to see if they need refactoring or rescheduling. - -#### Performance improvements and enhancements - -* We added client-side naming validation for file or folder creation. diff --git a/website/sidebars.js b/website/sidebars.js index 8bfcb68178b..a5992389ea1 100644 --- a/website/sidebars.js +++ b/website/sidebars.js @@ -692,6 +692,7 @@ const sidebarSettings = { items: [ "docs/dbt-versions/dbt-cloud-release-notes", "docs/dbt-versions/2023-release-notes", + "docs/dbt-versions/2022-release-notes", { type: "autogenerated", dirName: "docs/dbt-versions/release-notes", From 15c2b9fae7dfb2ea73e077d511d395b56ec61c9b Mon Sep 17 00:00:00 2001 From: Matt Shaver <60105315+matthewshaver@users.noreply.github.com> Date: Mon, 20 May 2024 16:38:20 -0400 Subject: [PATCH 2/3] Removing old link --- .../docs/docs/core/connect-data-platform/connection-profiles.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/connection-profiles.md b/website/docs/docs/core/connect-data-platform/connection-profiles.md index 32e60c8cc18..e5394ae7473 100644 --- a/website/docs/docs/core/connect-data-platform/connection-profiles.md +++ b/website/docs/docs/core/connect-data-platform/connection-profiles.md @@ -132,7 +132,7 @@ While the target schema represents the default schema that dbt will use, it may ## Understanding threads -When dbt runs, it creates a directed acyclic graph (DAG) of links between models. The number of threads represents the maximum number of paths through the graph dbt may work on at once – increasing the number of threads can minimize the run time of your project. The default value for threads in user profiles is [4 threads](/docs/dbt-versions/release-notes/Dec-2022/default-thread-value). +When dbt runs, it creates a directed acyclic graph (DAG) of links between models. The number of threads represents the maximum number of paths through the graph dbt may work on at once – increasing the number of threads can minimize the run time of your project. The default value for threads in user profiles is 4 threads. For more information, check out [using threads](/docs/running-a-dbt-project/using-threads). From 3456fdc70d8745e3109b7703028db9dbaccd79dd Mon Sep 17 00:00:00 2001 From: Matt Shaver <60105315+matthewshaver@users.noreply.github.com> Date: Tue, 21 May 2024 09:49:17 -0400 Subject: [PATCH 3/3] Apply suggestions from code review Co-authored-by: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> --- website/docs/docs/dbt-versions/2022-release-notes.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/website/docs/docs/dbt-versions/2022-release-notes.md b/website/docs/docs/dbt-versions/2022-release-notes.md index 1c45d5ce134..e7c5e1290c1 100644 --- a/website/docs/docs/dbt-versions/2022-release-notes.md +++ b/website/docs/docs/dbt-versions/2022-release-notes.md @@ -53,7 +53,7 @@ packages: ## Novemver 2022 -### The dbt Cloud + Databricks experience is getting even better" +### The dbt Cloud + Databricks experience is getting even better dbt Cloud is the easiest and most reliable way to develop and deploy a dbt project. It helps remove complexity while also giving you more features and better performance. A simpler Databricks connection experience with support for Databricks’ Unity Catalog and better modeling defaults is now available for your use. @@ -166,7 +166,7 @@ This additional security layer in the IDE is available only to the dbt Cloud ent ## April 2022 -## Audit log +### Audit log To review actions performed by people in your organization, dbt provides logs of audited user and system events. The dbt Cloud audit log lists events triggered in your organization within the last 90 days.