Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use NTTEC for erasure coding #50

Open
slaperche-scality opened this issue May 14, 2018 · 0 comments
Open

Use NTTEC for erasure coding #50

slaperche-scality opened this issue May 14, 2018 · 0 comments
Assignees

Comments

@slaperche-scality
Copy link
Collaborator

Quadiron should be able to use NTTEC to split a file into chunks and distribute them to the nodes.
It should also be able to retrieve the chunks to rebuild the original file.

What we need is:

  • to have an erasure coding module, that relies on NTTEC
  • to have two new method (for now in the simulator shell, later in the RPC interface):
    • "put filename" (when using REST we will give the data directly instead of the filepath): read the file, apply erasure coding on it and store the chunks.
    • "get KEY": retrieve the data identified by KEY (find the chunks, fetch them and rebuild the file, send back the file to the user).

We should also be able to retrieve the file, even if some parts are missing (that's the reason for erasure coding after all).

@slaperche-scality slaperche-scality self-assigned this May 23, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant