Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support asynchronous external indexing #15

Open
mattgodbolt opened this issue May 13, 2015 · 4 comments
Open

Support asynchronous external indexing #15

mattgodbolt opened this issue May 13, 2015 · 4 comments

Comments

@mattgodbolt
Copy link
Owner

At the moment line buffering is required of the --pipe command, as the whole thing is synchronous. Ideally the external indexer could run in parallel with zindex itself, which would make it impossible to deadlock, and can probably speed up the operation too.

@mattgodbolt
Copy link
Owner Author

Will probably have to implement this as some large jq queries are sometimes hitting some buffering limit (e.g. a query I have which has 567481 byte lines, and 6000 byte outputs)

@mattgodbolt
Copy link
Owner Author

That turned out to be a bug, so this is just a "would be nice"

@mattgodbolt
Copy link
Owner Author

This still seems to happen when (for example) tests run under an IDE (eg CLion)

@mattgodbolt
Copy link
Owner Author

(/home/mgodbolt/dev/zindex/tests/ExternalIndexerTest.cpp:21)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant