0.66.0

The Apache StreamPipes (incubating) community is pleased to annouce the availability of Apache StreamPipes (incubating) 0.66.0!

The latest release brings major improvements to the live dashboard, the notification system, multiple new pipeline elements and StreamPipes Connect adapters, a simplified installation, more deployment options and a variety of bug fixes and minor improvements.

Release notes can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12323520&version=12347025

0.65.0-pre-asf

New features

• Added a welcome screen to the UI during startup
• Added an umbrella pipeline element to reduce memory requirements of lite version
• Bumped Flink to latest version 1.9.1
• Added CSV enrichment processor
• Added event counter processor
• Support FileStaticProperty in Pipeline Editor

Improvements

• Do not trigger cache refresh of pipeline elements during initial installation
• Websocket URL in live dashboard does not depend anymore on hostname
• Optimize Dockerfiles
• Installer now works without providing a hostname
• Optimize caching of pipeline element descriptions

Bug fixes

• Fixed a bug in the OPC-UA Adapter
• Fixed a bug that prevented error messages to be shown in the pipeline view
• Fixed a bug that cause the pipeline modification to fail

0.64.0-pre-asf

New features

• Added a new StreamPipes Connect adapter for Apache PLC4X
• Added a new StreamPipes Connect adapter for Apache Pulsar
• Added a new data sink to send events to Apache Pulsar

Improvements

• All StreamPipes services use a new Docker Image based on OpenJ9 which drastically reduces memory consumption

0.63.0-pre-asf

New features

• Added a new static property that handles secrets such as passwords
• Added a new static property to specify property groups
• Added a new external event processor in preparation for the upcoming python wrapper
• Added configuration options to FileStreamProtocol
• Pipeline Elements provide their own documentation and icons
• Added support for binary message formats: SMILE, FST and CBOR
• Added a new processor boolean inverter
• Added an OPC-UA adapter to Connect
• Added a new random data generator to Connect
• Added a new IoTDB sink
• Added a new OPC-UA sink
• Added a new settings page to select preferred message formats
• Added support for runtime-resolvable static properties in Connect
• Added a new static property StaticPropertyAlternatives that handles alternatives
• Extracted Connect adapters from Backend to new worker-based architecture
• Added support for multiple dashboards within one pipeline
• Extracted RDF4J HTTP repository to own service
• Added a feature to gracefully stop pipelines when containers are stopped
• Added support for Alternatives/Group static properties to Connect
• Added a feedback button
• Added authentication to MQTT adapter
• Added improved asset support for data streams

Bug Fixes

• Uninstallation of data sinks not working
• Duplicated events in pipelines with two dashboard sinks
• Trend detection fires too often
• Rules in ROS adapter are not working
• MQTT Protocol NullPointer in Guess Schema
• Unit conversion is not stored in connect
• Error when reading domain properties
• Shared usage of transport protocols and formats breaks pipeline element installation
• Modifying links between pipeline elements
• Validation of alternative configuration at MQTT adapter not working as expected
• Dashboard does not work after editing pipeline
• Dots in keys within StreamPipes Connect are currently not working
• Error in Dashboard with ROS messages with header field
• CSV Format does not guess numbers correctly
• AppendOutputStrategy: Renaming does not work correctly
• Wrong extractor for Runtime-resolvable selections in documentation
• ProtocolMatch adds wrong error message
• Uninstalling pipeline elements not working

Improvements

• Customize event output in Siddhi wrapper
• Connect not showing Error Messages
• Improve edit schema dialog in Connect
• Directly mark event property as timestamp
• Avoid using function calls in Connect UI
• Make UI more browser-independent
• Let DeclarersSingleton declare supported protocols
• Improve support for runtime resolvable static properties
• Package StreamPipes backend as jar instead of war file
• Migrate pipeline element containers to Spring Boot
• Pipeline Tutorial still has Field Hasher in last step
• Migrate Connect containers to Spring Boot
• Enable gzip compression in UI
• In Installation Dialogue Enter not working as expected
• Extended and improved documentation

Minors / Library updates

• Update Kafka
• Update Flink
• Update Maven plugin dependencies
• Update Powermock Version
• Update jetty version
• Update Checkstyle version
• Add method to SDK to get type of Mapping Property
• Update Jackson libraries
• Update documentation
• Update Maven archetypes

0.62.0-pre-asf

Added

• Always show consistency check messages of pipeline elements
• StreamPipes Connect: Sort adapters by name
• Add categories to StreamPipes Connect
• Add Wikipedia adapter
• Add Coindesk adapter
• Add IEXCloud adapter
• Extract labels and descriptions to external resources file
• Add extractor for Static Properties in all Connect adapters
• Implement Interfaces for historic data access
• Add description for Connect configuration properties

Changed / Bug Fixes

• StreamPipes Connect: Ensure correct ordering of static properties
• Adapter Event-Property Order
• Fix bug in data set support of Connect
• Upgrade UI to latest Angular version 7
• Refactor authentication/configuration checks in UI
• Ensure correct ordering of stream requirements
• Fix link to documentation in StreamPipes UI
• Improve behaviour of customizing window

Removed

0.61.0-pre-asf

Added

• Improved validation of pipelines in the pipeline editor
• Case-insensitive pipeline element search
• Customize dialog is hidden if no static properties are present
• Export and import of Adapter descriptions
• Migration guide for SIP-08
• New map visualization
• Improved support for complex data types
• Introduction of new event model
• New Maven archetype: pe-source
• SSL support

Changed / Bug Fixes

• Bug Fix: Tutorial not shown
• Bug Fix: Transform Output Strategy not working
• Refactor Maven archetypes to support new event model and wrapper classes
• Upgrade to latest AngularJS version
• Ensure correct ordering of static properties
• Bug Fix: AnyStaticProperty not working
• Bug Fix: Pipeline can be stored without a Sink
• Bug Fix: Pipeline modelling: duplicated runtimeNames
• Use of the UI without Internet
• Bug Fix: CollectionStaticProperty not working

Removed

• OpenSenseMap adapter due to API changes

0.60.1-pre-asf

StreamPipes 0.60.1 is a minor release that includes the following new features:

Added

• Maven archetypes to easily create new pipeline elements using the SDK

Changed

• UI improvements
• Several bug fixes

0.60.0-pre-asf

Added

• Beta release of StreamPipes Connect Library
• Tutorials for better user guidance
• New Wrapper for the Siddhi CEP engine
• New Project streampipes-pipeline-elements contains more than 40 new pipeline elements

Changed

• Various bug fixes and stability improvements
• Many UX improvements (e.g., harmonized styles)
• Dashboard does not reload after new visualization type has been created
• Improved test coverage

Removed