Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

高可用实现了吗？，数据分布式增量读取 #29

Open
CaiGaoQing opened this issue Mar 11, 2019 · 2 comments
Open

高可用实现了吗？，数据分布式增量读取 #29

CaiGaoQing opened this issue Mar 11, 2019 · 2 comments

Comments

@CaiGaoQing
Copy link

CaiGaoQing commented Mar 11, 2019 •
edited
Loading

如果启动2个进程，配置的相同的配置文件，读取的相同文件一共1000 条数据，数据是怎么平均分配到这2个线程，每个500条。看了下源码，基本是多线程和队列都是进程内的，如何保证集群了读取的 数据不重复那？咨询下。谢谢.QQ:907519797, vx：17865621181
@yangsishu
Copy link
Contributor

一个文件只会一个线程去读取，jlogstash现在是单机的

@yangsishu
Copy link
Contributor

文件的读取都是增量读取，会记住当时读取的offset的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yangsishu @CaiGaoQing