Skip to content

dbt-spark 1.2.0
Compare
Choose a tag to compare
@leahwicz leahwicz released this 26 Jul 16:50
· 14 commits to 1.2.latest since this release
v1.2.0
e529fcf
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

dbt-spark 1.2.0 (July 26, 2022)

Features

  • Add grants to materializations (#366, #381)

Fixes

  • Pin pyodbc to version 4.0.32 to prevent overwriting libodbc.so and libltdl.so on Linux (#397, #398)
  • Incremental materialization updated to not drop table first if full refresh for delta lake format, as it already runs create or replace table (#286, #287)
  • Apache Spark version upgraded to 3.1.1 (#348, #349)
  • adapter.get_columns_in_relation (method) and get_columns_in_relation (macro) now return identical responses. The previous behavior of get_columns_in_relation (macro) is now represented by a new macro, get_columns_in_relation_raw (#354, #355)

Under the hood

  • Update SparkColumn.numeric_type to return decimal instead of numeric, since SparkSQL exclusively supports the former (#380)
  • Initialize lift + shift for cross-db macros (#359)
  • Add invocation env to user agent string (#367)
  • Use dispatch pattern for get_columns_in_relation_raw macro (#365)

Contributors

Assets 4
Loading