Skip to content
This repository has been archived by the owner on Aug 18, 2020. It is now read-only.

optimize the partition distribute algorithm #15

Open
baotiao opened this issue Sep 1, 2017 · 0 comments
Open

optimize the partition distribute algorithm #15

baotiao opened this issue Sep 1, 2017 · 0 comments
Assignees

Comments

@baotiao
Copy link
Contributor

baotiao commented Sep 1, 2017

In current version, the partition distribute algorithm has some problems, such as we can't not allot every node the same number of partition, we can only promise that the 3 copies not be put in same node, but we can't not promise that any two copy will not be put in same machine, since there is many nodes in a machine.

we need improve the partition distribute algorithm, the most elaborate dirstribute algorithm I have seen is ceph's crush algorithm. Maybe we can copy this algorithm and implement it in zeppelin

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants