Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raft #2219

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Raft #2219

wants to merge 4 commits into from

Commits on Nov 21, 2023

  1. initial work

    Signed-off-by: Heinz N. Gies <[email protected]>
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Move startup and stop logic into ClusterNode and RunningClusterNode
    
    It looked cleaner from my angle and now we can properly stop the machinery and all its tasks.
    Unify cluster start and join to one command: cluster start --join ...
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Update to openraft higher-cote branch rebased on openraft main
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Do not connect in TremorNetwork::new_client
    
    this call is not guarded by a timeout, so if we cannot connect we are going to hang in the TCP connect call.
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    improve docs for tremor_common::file::is_empty
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Redesign flow task and state machine.
    
    deploying a flow does not automatically start it. That needs to be done explicitly in a second step.
    
    Signed-off-by: Matthias Wahl <[email protected]>
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Add remove_node operation to the API client
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    k8s autoscaling experiment
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Fail the client if it returns a non-200, so it doesn't try to deserialize an error struct as a regular response
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Refactor our custom raft statemachines into seperate sub-statemachines
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Make sure the network impl reconnects upon errors
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Add some more cluster tests
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Add app id and flow id to common ids and logs
    
    Signed-off-by: Matthias Wahl <[email protected]>
    
    Update HTTP server library and API
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Change config to defaults and improve errors
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Allow connectors access to raft api
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Remove old API
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Add clustered kv and API improvements
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Add cluster::node_id tremorscript function
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Improve networking and cleanup
    
    * Add two examples
    * Update tremor new to create clustered apps
    * Fix memory corruption when apps are uninstalled
    * Try optimizing storage and n2n coms
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Remove unused deps
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    
    Remove unused LINE_REGEXP lazy_static in tremor-pipeline to fix build
    
    Signed-off-by: Darach Ennis <[email protected]>
    
    Fix non consistant reads
    
    Signed-off-by: Heinz N. Gies <[email protected]>
    Licenser committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    0984158 View commit details
    Browse the repository at this point in the history
  2. Update to use redb instead of rocksdb

    Signed-off-by: Heinz N. Gies <[email protected]>
    Licenser committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    edc2921 View commit details
    Browse the repository at this point in the history
  3. Partial transition to anyhow / thiserror for errors

    Signed-off-by: Heinz N. Gies <[email protected]>
    Licenser committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    4f556e2 View commit details
    Browse the repository at this point in the history
  4. Add tests for cluster components

    Signed-off-by: Heinz N. Gies <[email protected]>
    Licenser committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    b002c0e View commit details
    Browse the repository at this point in the history