Skip to content

Release v1.7.0

Compare
Choose a tag to compare
@uncleGen uncleGen released this 23 Jul 01:57
· 143 commits to master-2.x since this release
484777c
  • New features
    • Support datahub datasource in Spark Structured Streaming
    • Add jdbc datasource support
    • Add hbase datasource support
    • Loghub relation support write
    • Add druid sink source
  • Improvements
    • Better support loghub datasource schema type convert
    • Check if shard has finished after pull logs
    • Add retry for internal server error
    • Dont use SinkLog when there is no config
    • Loghub table should be defined with schema
    • Optimize to reduce extra count job when generate loghub RDD
    • Optimize logstore read step to avoid exceeding read quota limits
  • Bug fix
    • Fix NPE when no data fetched from datahub
    • Could not generate RDD from a parent for unifying at time
    • Sometimes failed to get loghub schema
    • DatahubRDD 'count' should initial in each ShardPartition