Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TESTING] Script for benchmarking builders locally #137

Open
wants to merge 78 commits into
base: main
Choose a base branch
from
Open

[TESTING] Script for benchmarking builders locally #137

wants to merge 78 commits into from

Commits on Oct 19, 2023

  1. Runner script (#1) 

    * Runner script

Allows image building, kurtosis ethereum-package starting and stopping using the generated image

* feat: update geth builder overview dashboard

Created a Go script that follows the following API and is expected to exist in ./scripts inside builder repo:

Main features:
 - Runs on Windows and Linux using Go run
 - Does progressive command log printing
 - Allows to set ImageTag and provide ImageArgs when building starting the network
Example commands:

 - build ../ repo into docker image go run emulate_network.go build
 - run network and see deployment progress go run emulate_network.go run -n=enclaveName -k="C:/Users/olegj/kurtosis.exe”
 - stop network go run emulate_network.go stop -n=enclaveName -k="C:/Users/olegj/kurtosis.exe”


Co-authored-by: Carlos Bermudez Porto <[email protected]>
    @OlegJakushkin @cbermudez97
    OlegJakushkin and cbermudez97 authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    2a2511d View commit details
    Browse the repository at this point in the history

  2. Update builder metrics flags

    @cbermudez97
    cbermudez97 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    00ba47b View commit details
    Browse the repository at this point in the history

  3. fix: update metrics flags

    @cbermudez97
    cbermudez97 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d032267 View commit details
    Browse the repository at this point in the history

  4. feat: update dashboard tooltips

    @cbermudez97
    cbermudez97 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b5b1d20 View commit details
    Browse the repository at this point in the history

  5. feat: use ethereum package main branch

    @cbermudez97
    cbermudez97 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    141ce8e View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. feat: use version 0.6.1 with builder fix

    @cbermudez97
    cbermudez97 committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    b8d791c View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. updated build script 

    new docker debug file
    @OlegJakushkin
    OlegJakushkin committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    124cd55 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Increase the number of generated transactions. Update custom flood co… 

    …nfig (#2)

* Increase the number of generated transactions. Update custom flood config
    @piwonskp
    piwonskp authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    4b58a8f View commit details
    Browse the repository at this point in the history

  2. Fix additional builder metrics flags (#3) 

    * Update builder metrics flags

* fix: update metrics flags

* feat: update dashboard tooltips

* feat: use ethereum package main branch

* feat: use version 0.6.1 with builder fix
    @cbermudez97
    cbermudez97 authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    a110e8b View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Fix builders not submitting blocks. Use geth as it appear to deliver … 

    …a better peering of transactions.

Minor improvements:
* Use flashbots/builder for participant
* Hardcode tag instead of using `latest`
* Use capella 0
    @piwonskp
    piwonskp authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    6cf4f91 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Update issue templates

    @kamilchodola
    kamilchodola authored Oct 30, 2023
    Configuration menu
    Copy the full SHA
    40ac12b View commit details
    Browse the repository at this point in the history

  2. Revert "Update issue templates" 

    This reverts commit 40ac12b.
    @kamilchodola
    kamilchodola committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    4765df9 View commit details
    Browse the repository at this point in the history

  3. feat: update old dashboard panels

    @cbermudez97
    cbermudez97 committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    35fc869 View commit details
    Browse the repository at this point in the history

  4. feat: add smaller dashboard for builders comparisson

    @cbermudez97
    cbermudez97 committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    b6b0eae View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. Merge pull request #4 from NethermindEth/fix-txs-not-peered 

    Fix builders not submitting blocks.  Use geth as it appear to deliver…
    @piwonskp
    piwonskp authored Oct 31, 2023
    Configuration menu
    Copy the full SHA
    d3ec936 View commit details
    Browse the repository at this point in the history

  2. Change URL for Kurtosis install (#5)

    @kamilchodola
    kamilchodola authored Oct 31, 2023
    Configuration menu
    Copy the full SHA
    64fc940 View commit details
    Browse the repository at this point in the history

  3. chore: merge branch 'main' into dashboards-improvements

    @cbermudez97
    cbermudez97 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    30c2139 View commit details
    Browse the repository at this point in the history

  4. feat: use ethereum package version 1.0.0

    @cbermudez97
    cbermudez97 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    67bef29 View commit details
    Browse the repository at this point in the history

  5. fix: revert "feat: use ethereum package version 1.0.0" 

    This reverts commit 67bef29.
    @cbermudez97
    cbermudez97 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    d9afb54 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. Merge branch 'main' into dashboards-improvements

    @cbermudez97
    cbermudez97 committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    25b0784 View commit details
    Browse the repository at this point in the history

  2. feat: add additional prometheus labels

    @cbermudez97
    cbermudez97 committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    755cce2 View commit details
    Browse the repository at this point in the history

  3. feat: update labels in dashboards

    @cbermudez97
    cbermudez97 committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    713bc18 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. feat: centralize dashboards and apply custom prometheus config

    @cbermudez97
    cbermudez97 committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    b91f222 View commit details
    Browse the repository at this point in the history

  2. fix: wrong prometheus config values

    @cbermudez97
    cbermudez97 committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    0e8f484 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Merge remote-tracking branch 'origin/dashboards-improvements' into main

    @OlegJakushkin
    OlegJakushkin committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    1e0ca5e View commit details
    Browse the repository at this point in the history

  2. tested dind 

    no port forwarding
    @OlegJakushkin
    OlegJakushkin committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    333d014 View commit details
    Browse the repository at this point in the history

  3. fix: wrong units for slots on blocks build time

    @cbermudez97
    cbermudez97 committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    591d8e3 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. feat: update ethereum package branch

    @cbermudez97
    cbermudez97 committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    480d3df View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Use broadcaster instead of peering between builders

    @piwonskp
    piwonskp authored Nov 9, 2023
    Configuration menu
    Copy the full SHA
    e607941 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/broadcaster' into dashboards-imp… 

    …rovements
    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    5ed3ba5 View commit details
    Browse the repository at this point in the history

  3. Use ethereum-package main branch and a newer version of nethermind cl… 

    …ient
    @piwonskp
    piwonskp authored Nov 9, 2023
    Configuration menu
    Copy the full SHA
    06a35e2 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/broadcaster' into dashboards-imp… 

    …rovements
    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    e985a43 View commit details
    Browse the repository at this point in the history

  5. feat: improve dashboard and reduce slot time

    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    51ade5b View commit details
    Browse the repository at this point in the history

  6. feat: allow to disable epoch 4 annotation

    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    daeb9dd View commit details
    Browse the repository at this point in the history

  7. fix: wrong value mappings

    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    029dd54 View commit details
    Browse the repository at this point in the history

  8. Add slot Time

    @kamilchodola
    kamilchodola committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    deb051e View commit details
    Browse the repository at this point in the history

  9. Add missing usage

    @kamilchodola
    kamilchodola committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    cd6bff9 View commit details
    Browse the repository at this point in the history

  10. feat: add bids built count

    @cbermudez97
    cbermudez97 committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    27fa340 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. Started finetuning fore public ports on eth package

    @OlegJakushkin
    OlegJakushkin committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    8a3d7e8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/kch/add_slot_time' into main

    @OlegJakushkin
    OlegJakushkin committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    0a21923 View commit details
    Browse the repository at this point in the history

  3. Partial enclave stop and progress monitoring 

    Only in case -s is provided to Run
    @OlegJakushkin
    OlegJakushkin committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    5cfcc17 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #7 from NethermindEth/broadcaster 

    Use broadcaster instead of peering between builders
    @piwonskp
    piwonskp authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    ff4fb5f View commit details
    Browse the repository at this point in the history

  5. Merge pull request #8 from NethermindEth/dashboards-improvements 

    feat: update builder grafana dashboard
    @kamilchodola
    kamilchodola authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    5f67305 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #9 from NethermindEth/kch/add_slot_time 

    Add --slotTime param which allows to manipulate slotTime on chain and default it to 5
    @kamilchodola
    kamilchodola authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    f3b8bfe View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into partial-stop

    @kamilchodola
    kamilchodola authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    fd6bfc8 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #10 from NethermindEth/partial-stop 

    Partial stop
    @kamilchodola
    kamilchodola authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    dbe6a31 View commit details
    Browse the repository at this point in the history

  9. Set dev builder image tag as dev 

    To avoid confusion change the tag to the same as default in go script
    @piwonskp
    piwonskp authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    78c61e0 View commit details
    Browse the repository at this point in the history

  10. Merge pull request #11 from NethermindEth/piwonskp/change-dev-builder… 

    …-tag

Set dev builder image tag as `dev`
    @kamilchodola
    kamilchodola authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    720c2e8 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2023

  1. Fix linting

    @kamilchodola
    kamilchodola committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    69ffbe0 View commit details
    Browse the repository at this point in the history

  2. Adjust references

    @kamilchodola
    kamilchodola committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    cd2c2f4 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #12 from NethermindEth/kch/lint 

    Adjust linting
    @kamilchodola
    kamilchodola authored Nov 12, 2023
    Configuration menu
    Copy the full SHA
    cd2b117 View commit details
    Browse the repository at this point in the history

  4. Fix readme, change -s to 1000 and improve summary

    @kamilchodola
    kamilchodola committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    ded84f9 View commit details
    Browse the repository at this point in the history

  5. Fix method def

    @kamilchodola
    kamilchodola committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    c3f2274 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #13 from NethermindEth/kch/adjust_default_slot_number 

    Adjustments to Readme and add default BlockNum
    @kamilchodola
    kamilchodola authored Nov 12, 2023
    Configuration menu
    Copy the full SHA
    af74e21 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. Pretty print service urls

    @piwonskp
    piwonskp authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    8f905f3 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Add third builder - relay validator

    @piwonskp
    piwonskp authored Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a3498e0 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Print exact url of the dashboard, not the grafana service root

    @piwonskp
    piwonskp authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    1260c63 View commit details
    Browse the repository at this point in the history

  2. Use latest versions of lighthouse and nethermind & fix baseline extra… 

    …data
    @piwonskp
    piwonskp authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    487bae4 View commit details
    Browse the repository at this point in the history

  3. Change the prometheus label so validator is not visible on the dashboard

    @piwonskp
    piwonskp authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    58af272 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Use default lighthouse image

    @piwonskp
    piwonskp authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    bdeb000 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #14 from NethermindEth/bold-service-urls 

    Messages adjustments
    @piwonskp
    piwonskp authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    463fbfd View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Merge pull request #15 from NethermindEth/three-builders 

    Add third builder - relay validator
    @kamilchodola
    kamilchodola authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    354ef10 View commit details
    Browse the repository at this point in the history

  2. Using default Dockerfile for build (#16) 

    * Using default Dockerfile for build

Also updated readme
    @OlegJakushkin
    OlegJakushkin authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    c440fa5 View commit details
    Browse the repository at this point in the history

  3. Add architecture diagram

    @piwonskp
    piwonskp authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    c2cf45d View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2023

  1. Increase fuzzing rate

    @piwonskp
    piwonskp authored Nov 18, 2023
    Configuration menu
    Copy the full SHA
    b783bfa View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2023

  1. Merge pull request #17 from NethermindEth/increase-fuzzing-rate 

    Increase fuzzing rate
    @piwonskp
    piwonskp authored Nov 19, 2023
    Configuration menu
    Copy the full SHA
    240b202 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Uppercase readme

    @kamilchodola
    kamilchodola authored Nov 21, 2023
    Configuration menu
    Copy the full SHA
    db9578c View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Merge remote-tracking branch 'origin/main' into dind

    @OlegJakushkin
    OlegJakushkin committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    9ef02d2 View commit details
    Browse the repository at this point in the history

  2. clean up dind docs

    @OlegJakushkin
    OlegJakushkin committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    475e6c7 View commit details
    Browse the repository at this point in the history

  3. added wip disclamer

    @OlegJakushkin
    OlegJakushkin committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    b3cb7c0 View commit details
    Browse the repository at this point in the history

  4. fix diff with main

    @OlegJakushkin
    OlegJakushkin committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    02fea33 View commit details
    Browse the repository at this point in the history

  5. fix distance to main 

    minimal edited files
    @OlegJakushkin
    OlegJakushkin committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    cc3f7bb View commit details
    Browse the repository at this point in the history

  6. Update scripts/README.md

    @piwonskp
    piwonskp authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    d32645f View commit details
    Browse the repository at this point in the history

  7. Update scripts/README.md

    @piwonskp
    piwonskp authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    c824177 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #18 from NethermindEth/dind 

    Dind updates WIP.
    @piwonskp
    piwonskp authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    f488a4f View commit details
    Browse the repository at this point in the history

  9. Add dashboard and architecture description to the readme

    @piwonskp
    piwonskp authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    8fc222a View commit details
    Browse the repository at this point in the history

  10. Fix links to fuzzeers

    @piwonskp
    piwonskp authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    6e617c2 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. Rename readme -> README

    @piwonskp
    piwonskp authored Dec 3, 2023
    Configuration menu
    Copy the full SHA
    3cee741 View commit details
    Browse the repository at this point in the history