-
Notifications
You must be signed in to change notification settings - Fork 68
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow inner class being parameter of withTimestampAssigner
in Table API stream table source
#281
Comments
I'm a little concerned that we're missing an ingredient with how assigners would be configured in Flink SQL. One of the main use cases of Flink SQL is to be able to use Flink without writing Java code. It is therefore important that a table source provide a pure properties-based experience. See the pure-SQL experience depicted here: Basically, we need a way to interoperate with the rowtime schema elements as seen here: One approach could be, recommend that the user extract the timestamp by using
|
Also, notice in the Kafka table source that there's a property called |
Thanks for the comment. @EronWright Here is what I'd like to explain.
This one is exactly what I have considered during the design. The problem is that when users want to use source with Pravega watermark, we force them to give an implementation of timestamp for each event. This implementation of our
|
Problem description
Due to the serialization validation for
connectorProperties
, onlypublic
static-inner/outer
class implementsAssignerWithTimeWindow
is supported as a parameter ofwithTimestampAssigner
in Table API stream table source. We should support inner class for easier use.Problem location
https://github.com/pravega/flink-connectors/blob/master/src/main/java/io/pravega/connectors/flink/Pravega.java#L292
Suggestions for an improvement
The text was updated successfully, but these errors were encountered: