You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, InLong supports both real-time and offline data synchronization.
The offline data sync is scheduled repeatedly by the schedule engine. #10412 introduced a built-in schedule engine and #10515 supports the built-in engine to trigger the Flink batch job.
So, InLong has the basic capability for offline data synchronization.
There are some mature and stable scheduling engines like Apache Airflow and Apache Dolphinscheduler. It will be helpful for Inlong to support these scheduling engines in offline data synchronization.
This issue is part of this which aims to support Apache Airflow.
Description
Currently, InLong supports both real-time and offline data synchronization.
The offline data sync is scheduled repeatedly by the schedule engine.
#10412 introduced a built-in schedule engine and #10515 supports the built-in engine to trigger the Flink batch job.
So, InLong has the basic capability for offline data synchronization.
There are some mature and stable scheduling engines like Apache Airflow and Apache Dolphinscheduler. It will be helpful for Inlong to support these scheduling engines in offline data synchronization.
This issue is part of this which aims to support Apache Airflow.
Ref:
InLong offline synchronization
Offline data synchronization Example
Offline Sync Connector Extension
Use case
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: