Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nr of links is constant for the REAL generator #7

Open
henrikingo opened this issue Sep 4, 2018 · 1 comment
Open

Nr of links is constant for the REAL generator #7

henrikingo opened this issue Sep 4, 2018 · 1 comment

Comments

@henrikingo
Copy link
Collaborator

henrikingo commented Sep 4, 2018

Hi Mark

I realize this is not very actively maintained, but recording this here while I'm deep diving into Linkbench a little. Comments on options for fixing this are welcome.

For development purposes, and maybe other reasons, I want to run quicker runs of Linkbench. I can make load phase quicker by loading less data. If I set maxid1 = 10001 I get a smaller nodetable and counttable. However, the load phase then continues to insert 44M records to linktable. This also means there will be on average thousands of links per node, which is probably not a good model of reality.

It appears the default links generator nlinks_func = real isn't configurable at all. Should it be? Maybe is should automatically adapt to maxid1 so that it always generates about 4 links per node?

I can workaround this issue by using another nlinks_func:

nlinks_func = com.facebook.LinkBench.distributions.ZipfDistribution
nlinks_shape = 1.5
nlinks_mean = 2
@mdcallag
Copy link
Owner

mdcallag commented Sep 4, 2018

I have no experience with nlinks_func=real, but not adapting to maxid1 sounds like a bug. I am happy to take a pull request.

mdcallag pushed a commit that referenced this issue Mar 5, 2020
SERVER-35142 Update LinkBench to use released 3.8.2 driver
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants