Skip to content

Latest commit

 

History

History
71 lines (55 loc) · 2.43 KB

CHANGELOG.md

File metadata and controls

71 lines (55 loc) · 2.43 KB

Change Log

All notable changes to this project will be documented in this file.

[Unreleased]

[1.0.0] 2018-08-28

Changed

  • PNDA-4525: Deprecate Ubuntu 14.04
  • PNDA-4503: update to use new platformlibs and new ingest mechanics
  • PNDA-4654: Update kafka-python package version to 1.3.5
  • PNDA-4468: Add references to the guide for Gobblin topic config

Added

  • PNDA-4470: Adds a Traffic-Loss Analysis Spark2 python app to the example apps.
  • PNDA-4502: Adds example flinks applications
  • PNDA-4545: Add example Java Flink batch application

Fixed

  • PNDA-4895: Modified topic name as defined in README

[0.5.0] 2018-02-10

Changed

  • PNDA-3555: Use /pnda/deployment as expected HDFS library location.
  • PNDA-3549: Remove jar and egg dependencies used by spark-streaming-python application that run on PNDA that are now included by default.
  • PNDA-1899: Changed notes to reflect addition of Scala to supported languages in Jupyter (experimental)

Added

  • PNDA-3479: Added an example application that uses the Spark2 Structured Streaming API

Fixed

  • PNDA-3402: fix build issue on KSO app

[0.4.0] 2017-11-24

Changed

  • PNDA-3401: Change the spark-batch(-python) to output in the user's directory.

Added

  • PNDA-2445: Support for Hortonworks HDP hadoop distro.

Fixed

  • PNDA-3419: update KSO data source to work with Kafka 0.11.0.0
  • PNDA-3499: Cleanup CHANGELOG with missing release info.

[0.3.0] 2017-05-23

Changed

  • PNDA-2700: Update spark streaming example to work on redhat.

Fixed

  • PNDA-3051: Fix timestamp generation for opentsdb datapoints

Added

  • PNDA-2726: Added example spark-batch and spark-streaming jobs in python

[0.2.0] 2016-12-12

Added

  • PNDA-2359 Move applications to CDH 5.9 which include spark streaming 1.6
  • PNDA-2503 Remove explicit memory/vcore settings in apps

Fixed

  • Change Kafka version to 0.10.0.1
  • Pin assembly plugin to version 2.6
  • Update assembly.xml file to add the id xml tag

[0.1.0] 2016-10-21

Added

  • h2o-launcher application to run h2o data science platform
  • literary-word-count-app to run a classic wordcount
  • Spark streaming example app that consumes from Kafka and writes to HBase
  • Spark batch example app that consumes Gobblin produced Avro datasets from HDFS and produces Parquet for use with Impala
  • Spark streaming example app that consumes from Kafka and writes to OpenTSDB
  • Jupyter notebook example that shows some simple network data manipulation