Skip to content

Release Kyuubi-v1.1.0

Compare
Choose a tag to compare
@github-actions github-actions released this 10 Mar 08:14

The Kyuubi community is pleased to announce the release of Kyuubi v1.1.0. This is a feature release that includes the completion of 73 bug fixes and improvements. A full list of the new features, improvements, and bug fixes can be found here.

Highlighting

  • [KYUUBI #298] Add Support for Apache Spark 3.1.1
  • [KYUUBI #312] Support run kyuubi in foreground
  • [KYUUBI #307] [KYUUBI #318] ... [KYUUBI #310] Support Multi-catalog MetaOperations
  • [KYUUBI #209] [Server] Fix high cpu load due to log capture thread not release
  • [KYUUBI #381] Enhanced Connection-Share-Level mode for better batch processing

Contributors and Contributions

This release was a huge community effort. We’ve welcomed contributions from a lot of developers. Big thanks to everyone who helped out!

Cheng Pan (22):
      [KYUUBI #268] Improve pom.xml 
      [BUILD] Tune pom
      [KYUUBI #275] Exclude hbase-* from hive-jdbc
      [MINOR] fix typo
      [KYUUBI #282] Downgrade libthrift:0.9.3 due to THRIFT-4805
      [KYUUBI #280] Align Operation GET_SCHEMAS * behavior with Hive
      [KYUUBI #340] Swtich to commons-lang3
      [KYUUBI #342] Exclude unused hive-jdbc transitive dependencies
      [KYUUBI #344] [MINOR] update kyuubi version in quick_start
      [KYUUBI #312] Support run kyuubi in foreground
      [KYUUBI #350] Avoid using HiveResult
      [KYUUBI #363] exclude hive-shims unused dependencies
      [KYUUBI #360] Correct handle getNextRowSet with FETCH_PRIOR FETCH_FIRST
      [KYUUBI #372] Auto upload unit-tests.log
      [KYUUBI #374] [DOC] Add Collaborators page
      [KYUUBI #377] build/dist support --spark-provided
      [KYUUBI #380] [FOLLOWUP #377] change default distribution bundle name, and distribute without spark bundle
      [KYUUBI #390] Replace abbr in doc
      [KYUUBI #383] Support beeline --hivevar --hiveconf
      [KYUUBI #398] Move to hadoop shaded client
      [KYUUBI #398] [FOLLOWUP] exclude unused jars
      [KYUUBI #402] Remove hadoop suffix from tarball name when dist —without-spark

Honglun (3):
      [KYUUBI #306] SparkProcessBuilder support Windows
      [KYUUBI #347] Closing expired operations does not require updating 'lastAccessTime'
      [KYUUBI #347] The 'lastIdleTime' needs to be updated after the last expired Handle has been cleaned

Kent Yao (45):
      [MINOR] Show Github Actions build status in readme
      [KYUUBI #291] Add a quick start guide for DBeaver
      [KYUUBI #293] Remove dulicated error msg for open sessions at engine side
      [KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err
      [KYUUBI #307] GetCatalogs supports DSv2 and keeps its backward compatibility
      [KYUUBI #315] Update README.md
      [KYUUBI #317] [KYUUBI #317] merge pr script
      [KYUUBI #318] [KYUUBI #311] GetSchemas supports DSv2 and keeps its backward compatibility
      [KYUUBI #329] Support tests with Apache Iceberg in engine
      [KYUUBI #334] GetSchemas supports DSv2 multipart namespaces
      [KYUUBI #337] [FOLLOWUP] GetSchemas supports DSv2 multipart namespaces with dot backtick
      [KYUUBI #336] Fix a race in Kyuubi start and stop
      [KYUUBI #309] GetTables supports DSv2 and keeps its backward compatibility
      [KYUUBI #356] Fix missing default versions
      [KYUUBI #310] GetColumns supports DSv2 and keeps its backward compatibility
      [KYUUBI #361] Remove Hive Suffix for built in
      [KYUUBI #367] Engine terminating checker should start after exposed
      [KYUUBI #369] Using a lightweight zk client for kyuubi session
      [KYUUBI #371] Avoid creating useless operation log for meta operation
      [KYUUBI #375] THRIFT-4858 causes metadata operations being flaky
      [KYUUBI #376] Use spark-hive instead of spark-hive-thriftserver in engine test
      [KYUUBI #379] Improve engine log capture
      [KYUUBI #388] How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
      [KYUUBI #389] Bump up curator to 2.12.0
      [KYUUBI #391] Bump up guava to 14.0.1
      [KYUUBI #392] Remove netty dependency
      [KYUUBI #298] Add Support for Apache Spark 3.1.1
      [KYUUBI #393] Add Support for Hadoop 3.2
      [KYUUBI #396] Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1
      [KYUUBI #400] Implement a simpler toHiveString to convert spark row
      [KYUUBI #406] Create GitHub Release only once
      [HOTFIX] User hadoop2.7 as default for spark built in

MyLanPangzi (1):
      [KYUUBI #413] [MINOR] Remove unused class import

Zac Zhou (1):
      [KYUUBI #331] Try to fix some minor issues in README.

cz1019sniper (1):
      [KYUUBI #319] Update Kyuubi Doc Version

dependabot[bot] (2):
      Bump zookeeper from 3.4.6 to 3.4.14
      Bump libthrift from 0.9.3 to 0.12.0 fixes #273

fwang12 (5):
      [KYUUBI #281] Remove unused setting in pom
      [KYUUBI #294] [TEST] Enable UT for CONNECTION level engine shared.
      [KYUUBI #295] [INFRA] Add licenses for some yml files
      [KYUUBI #297] Remove unused property from build properties file
      [KYUUBI #300] [TEST] Extract basic jdbc tests to prevent long time UT

hzxiongyinke (1):
      [KYUUBI #313] [MINOR] Fix README.md

jhx1008 (9):
      [KYUUBI #321] Add Terminologies Documentation
      [KYUUBI #323] Fix Kyuubi conf template
      [KYUUBI #322] Override statement for better logging
      [KYUUBI #324] Use a human-readable engine start command
      [KYUUBI #326] Remove outdated deployment guide
      [KYUUBI #327] Update contribution guide
      [KYUUBI #328] Print a server log trace for engine process
      [KYUUBI #330] PR template Update
      [KYUUBI #333] Fix hanging due to disordered service stopping

peterylh (2):
      [KYUUBI #320] Fix Merge PR with duplicated title
      [KYUUBI #325] Update PR template

ulysses-you (23):
      [KYUUBI #267] Fix EmbeddedZkServerSuite embedded zookeeper server NPE problem
      [KYUUBI #209] [Server] Fix high cpu load due to log capture thread not release
      [KYUUBI #285] Add comment to remind develop if config updated
      [KYUUBI #284] Sesson submit log should be overwritten
      [KYUUBI #286] Add PR template fixe #286 I believe it should be simple for now and we can update it when need.
      [KYUUBI #284] [FOLLOWUP] Fix a race condition in engine redirect log file initialization
      [KYUUBI #302] Fix zk client not release if open session failed
      [KYUUBI #303] Add host:port msg if we failed to initialize 
      [KYUUBI #303] [FOLLOWUP] Fix test
      [KYUUBI #314] Add statement error msg in user log
      [KYUUBI #316] Nit remove some unnecessary blank
      [KYUUBI #339] Add JDK8 bug troubleshootint
      [KYUUBI #345] Catch Throwable instead of Exception
      [KYUUBI #356] Update built-in Spark version to 3.0.2
      [KYUUBI #365] Support user specify app name and tag
      [KYUUBI #381] Release session if shared level is CONNECTION
      [KYUUBI #385] Improve pass config between kyuubi and spark engine
      [KYUUBI #386] Clean up discovery service before engine stop in connection share level
      [KYUUBI #395] FIx flaky test in ConnectionLevelSparkEngineSuite
      [KYUUBI #403] FIx flaky test in ConnectionLevelSparkEngineSuite
      [KYUUBI #407] Auto update release note
      [KYUUBI #408] Fix engine log does not be overwrite
      release v1.1.0

yangrong688 (1):
      [KYUUBI #349] Fix typo

Best Regards,

Kyuubi