dbt-spark v1.7.0b2

dbt-spark 1.7.0-b2 - October 02, 2023

Features

• Persist Column level comments when creating views (#372)

Under the Hood

• Remove dependency on hologram (#881)

Dependencies

• Replace sasl with pure-sasl for PyHive (#818)
• Update tox requirement from ~=4.8 to ~=4.9 (#874)
• Bump mypy from 1.5.0 to 1.5.1 (#875)
• Update tox requirement from ~=4.9 to ~=4.10 (#879)
• Update pre-commit requirement from ~=3.3 to ~=3.4 (#884)
• Update black requirement from ~=23.7 to ~=23.9 (#886)
• Update tox requirement from ~=4.10 to ~=4.11 (#887)

Security

• Add docker image to the repo (#876)

Contributors

• @Fokko (#876)
• @jurasan (#372)

dbt-spark v1.7.0b1

dbt-spark 1.7.0-b1 - August 17, 2023

Features

• Support server side parameters in thrift connection (#387)
• Support server_side_parameters for Spark session connection method (#690)
• Add server_side_parameters to HTTP connection method (#824)
• Enforce server side parameters keys and values to be strings (#826)
• Add SessionConnectionWrapper (#829)

Fixes

• Wrap AnalysisException into DbtRuntimeError (#782)
• include tblproperties macro in adapters.sql create table (#865)

Under the Hood

• Update stale workflow to use centralized version (#842)

Dependencies

• Update tox requirement from ~=3.0 to ~=4.5 (#741)
• Update pyodbc requirement from ~=4.0.30 to ~=4.0.39 (#742)
• Update pre-commit requirement from ~=2.21 to ~=3.3 (#748)
• Update types-requests requirement from ~=2.28 to ~=2.29 (#749)
• Bump mypy from 1.2.0 to 1.3.0 (#768)
• Update flake8 requirement from ~=6.0 to ~=6.1 (#849)
• Update types-requests requirement from ~=2.29 to ~=2.31 (#850)
• Update pytest-xdist requirement from ~=3.2 to ~=3.3 (#851)
• Update pytest requirement from ~=7.3 to ~=7.4 (#852)
• Update pip-tools requirement from ~=6.13 to ~=7.2 (#856)
• Update black requirement from ~=23.3 to ~=23.7 (#857)
• Update wheel requirement from ~=0.40 to ~=0.41 (#858)
• Update mock requirement from ~=5.0 to ~=5.1 (#859)
• Bump mypy from 1.3.0 to 1.4.1 (#860)
• Update tox requirement from ~=4.5 to ~=4.6 (#861)
• Update pip-tools requirement from ~=7.2 to ~=7.3 (#863)
• Update tox requirement from ~=4.6 to ~=4.7 (#867)
• Update tox requirement from ~=4.7 to ~=4.8 (#871)
• Bump mypy from 1.4.1 to 1.5.0 (#872)

Contributors

• @Fokko (#829, #782)
• @Fokko,JCZuurmond (#824, #826)
• @alarocca-apixio (#690)
• @etheleon (#865)
• @hanna-liashchuk (#387)

dbt-spark v1.5.2

dbt-spark 1.5.2 - August 04, 2023

dbt-spark v1.4.3

dbt-spark 1.4.3 - August 04, 2023

dbt-spark v1.3.3

dbt-spark 1.3.3 - August 04, 2023

dbt-spark v1.5.1

dbt-spark 1.5.1 - July 31, 2023

Features

• All constraint types are supported, but not enforced. (#656, #657)

Fixes

• Wrap expression for check constraints in parentheses (#7480)

dbt-spark v1.6.0

dbt-spark 1.6.0 - July 31, 2023

Features

• Support insert_overwrite strategy with delta (#1013)
• All constraint types are supported, but not enforced. (#656, #657)
• Standardize the _connection_keys and debug_query for dbt debug. (#PR754)
• add dbt-spark portion of dbt_clone functionality (#815)

Fixes

• allow negative args for spark split part (#688)
• Fixed issue where table materialization was not always properly refreshing for non-admin users on Databricks (#725)
• Remove dead code 💀 (#758)
• Disallow untyped def's (#760)
• wrap expression for check constraints in parentheses (#7480)
• Allow hostname to be provided with or without trailing slash (#302)
• Remove dependent_projects argument from PartialProject call in unit tests (#7955)

Under the Hood

• Remove unneeded type ignore (#753)
• drop support for python 3.7 (#792)

Dependencies

• Update black requirement from ~=23.1 to ~=23.3 (#701)
• Bump mypy from 1.1.1 to 1.2.0 (#708)
• Update pytest requirement from ~=7.2 to ~=7.3 (#726)
• Update types-pytz requirement from ~=2023.2 to ~=2023.3 (#704)
• Update pip-tools requirement from ~=6.12 to ~=6.13 (#737)
• Update pytz requirement from ~=2023.2 to ~=2023.3 (#702)

Dependency

• Bump pyodbc from 4.0.34 to 4.0.35 (#417)

Contributors

• @Fokko (#758, #760, #753)
• @dave-connors-3 (#688)
• @flvndh (#1013)
• @tim-steinkuhler (#302)

dbt-spark v1.6.0rc1

dbt-spark 1.6.0-rc1 - July 17, 2023

Features

• add dbt-spark portion of dbt_clone functionality (#815)

Fixes

• allow negative args for spark split part (#688)
• Disallow untyped def's (#760)
• Allow hostname to be provided with or without trailing slash (#302)
• Remove dependent_projects argument from PartialProject call in unit tests (#7955)

Contributors

• @Fokko (#760)
• @dave-connors-3 (#688)
• @tim-steinkuhler (#302)

dbt-spark v1.6.0b3

dbt-spark 1.6.0-b3 - June 09, 2023

Features

• Standardize the _connection_keys and debug_query for dbt debug. (#PR754)

Fixes

• wrap expression for check constraints in parentheses (#7480)

Under the Hood

• drop support for python 3.7 (#792)

dbt-spark v1.3.2

dbt-spark 1.3.2 - May 26, 2023

Fixes

• Fixed issue where table materialization was not always properly refreshing for non-admin users on Databricks (#725)

Contributors

• @mikealfare (#725)