Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Noise shards together #345

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Noise shards together #345

wants to merge 2 commits into from

Conversation

zmbc
Copy link
Collaborator

@zmbc zmbc commented Oct 27, 2023

Noise shards together

Description

  • Category: feature
  • JIRA issue: None

The thinking here was that noising the shards all at once could simplify things, especially having to use heuristics to warn the user about unsatisfiable noise requests. However, in its current state this PR makes pseudopeople markedly slower. I am not sure why.

Testing

  • all tests pass (pytest --runslow)

@zmbc zmbc force-pushed the noise_shards_together branch from c9e8a3d to 78c9f82 Compare October 27, 2023 05:21
@zmbc zmbc force-pushed the noise_shards_together branch from 78c9f82 to 9513813 Compare October 27, 2023 05:28
@albrja
Copy link
Contributor

albrja commented Oct 27, 2023

It is surprising that this makes noising slower. I guess it's just the size of the data once we concat all of it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants