flink-connector-examples

Flink Connector Examples for Pravega

Battery of code examples to demonstrate the capabilities of Pravega as a data stream storage system for Apache Flink.

Pre-requisites

1. Pravega running (see here for instructions)
2. Build pravega-samples repository
3. Apache Flink 1.12 running

Distributing Flink Samples

Use gradle to assemble a distribution folder containing the Flink programs as a ready-to-deploy uber-jar called pravega-flink-examples-<VERSION>-all.jar:

$ ./gradlew installDist
...
$ ls flink-connector-examples/build/install/pravega-flink-examples/lib
...
pravega-flink-examples-<VERSION>-all.jar
...

---

Examples Catalog

Word Count

This example demonstrates how to use the Pravega Flink Connectors to write data collected from an external network stream into a Pravega Stream and read the data from the Pravega Stream. See wordcount for more information and execution instructions.

Exactly Once Sample

This sample demonstrates Pravega EXACTLY_ONCE feature in conjuction with Flink checkpointing and exactly-once mode. See Exactly Once Sample for instructions.

StreamCuts Sample

This sample demonstrates the use of Pravega StreamCuts in Flink applications. See StreamCuts Sample for instructions.

Pravega Watermark Sample

This sample demonstrates the use of Pravega Watermarks in Flink applications. See Watermark Sample for instructions.