Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run bench on demo #1552

Merged
merged 115 commits into from
Aug 29, 2024
Merged

Run bench on demo #1552

merged 115 commits into from
Aug 29, 2024

Commits on Aug 28, 2024

  1. Define basic demo options

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    fe73fd1 View commit details
    Browse the repository at this point in the history
  2. Extract genDatasetConstantUTxO

    To take faucet and client keys as arg,
    so that is reusable also for the current use-case.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    86201c0 View commit details
    Browse the repository at this point in the history
  3. Extract bench scenario

    So that is also reusable for the current use-case.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ffaf84c View commit details
    Browse the repository at this point in the history
  4. Extract findRunningCardanoNode'

    To find a node runing on unknown network, like devnet.
    
    So that is also reusable for the current use-case.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    74ad553 View commit details
    Browse the repository at this point in the history
  5. Add network id as part of the options

    Also removed starting node id as not needed,
    because Alice will always lead the demo bench.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8d1eb68 View commit details
    Browse the repository at this point in the history
  6. Draft base bench demo script

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    85667fd View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    22a0dbd View commit details
    Browse the repository at this point in the history
  8. Fix tx building for funding transaction

    This solves the problem of:
    
    SubmitTxValidationError (TxValidationErrorInCardanoMode (ShelleyTxValidationError ShelleyBasedEraBabbage (ApplyTxError (UtxowFailure (UtxoFailure (AlonzoInBabbageUtxoPredFailure (FeeTooSmallUTxO (Coin 169153) (Coin 0)))) :| []))))
    
    The problem was we were using a build-raw transaction api instead of one which autobalances it.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1a16408 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    03da04b View commit details
    Browse the repository at this point in the history
  10. Extend generator of constant utxo property

    To be valid for an arbitrary set of client keys,
    instead of just a single one.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    47f105c View commit details
    Browse the repository at this point in the history
  11. Trying to work out why large numbers of clients fail

    - Also note strange keys generated when allocating only small amounts of
      lovelace
    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6b5b52e View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    85c6f75 View commit details
    Browse the repository at this point in the history
  13. Return funds to faucet when it finishes

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f338f27 View commit details
    Browse the repository at this point in the history
  14. Avoid passing network id to options and faucet keys on generators

    As we forcing the bench to run on devnet for the moment.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8cb5813 View commit details
    Browse the repository at this point in the history
  15. Make bench-demo sim to run on top of previous run

    For that we made the following changes:
    - avoid requesting for node's history upon connection
    - datasets transactions use sender same as recipient
    - finally we avoid waiting for nodes to be connected given that is assumed in this case
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    74d6896 View commit details
    Browse the repository at this point in the history
  16. Replace hydra-keys options by hydra-client hosts instead

    Given we connect to provided hydra-clients we don't need to check
    we observe a head is inicializing with the same parties as its assumed.
    Instead we take hydra-client hosts so that the solution scales in other settings.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b6d53d8 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    d1716b7 View commit details
    Browse the repository at this point in the history
  18. Spin up things individually

    ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a449194 View commit details
    Browse the repository at this point in the history
  19. Acquire and upload logs

    ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9e0041c View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    1de6a0a View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    0cc7f8a View commit details
    Browse the repository at this point in the history
  22. check socket permissions

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    d1a7094 View commit details
    Browse the repository at this point in the history
  23. ls not la

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    04f7724 View commit details
    Browse the repository at this point in the history
  24. tmate

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8800ea3 View commit details
    Browse the repository at this point in the history
  25. tmate; socket file permissions

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    59d27da View commit details
    Browse the repository at this point in the history
  26. split setup and run benchmarks

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6c8cc69 View commit details
    Browse the repository at this point in the history
  27. Run pumba and the benchmarks

    - Build and run seperate nix steps
    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7039d7f View commit details
    Browse the repository at this point in the history
  28. Line buffering; 100% loss on pumba

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    781200d View commit details
    Browse the repository at this point in the history
  29. tmate

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7a5750e View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    cca50cc View commit details
    Browse the repository at this point in the history
  31. Use docker version of pumba

    It seems to have the right priviledges to do the netem work
    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a8c420f View commit details
    Browse the repository at this point in the history
  32. Does it work with 20% loss?

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7d77a2f View commit details
    Browse the repository at this point in the history
  33. See if it succeeds with 0% loss

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f79dbb4 View commit details
    Browse the repository at this point in the history
  34. What about 5%

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    69ced33 View commit details
    Browse the repository at this point in the history
  35. Optional tmate'ing

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    c1d15e7 View commit details
    Browse the repository at this point in the history
  36. Disable condition as it doesn't work

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    26998e8 View commit details
    Browse the repository at this point in the history
  37. Try nix again; leave very long running time

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    4fc35a2 View commit details
    Browse the repository at this point in the history
  38. Try a sleep

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    61b1e89 View commit details
    Browse the repository at this point in the history
  39. Horrible hack

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9703451 View commit details
    Browse the repository at this point in the history
  40. Note about checking for pumba working

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9e00319 View commit details
    Browse the repository at this point in the history
  41. Configuration menu
    Copy the full SHA
    336ae3f View commit details
    Browse the repository at this point in the history
  42. Try /24

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9ad4b41 View commit details
    Browse the repository at this point in the history
  43. Multiple targets is right

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9530f1e View commit details
    Browse the repository at this point in the history
  44. Let's try 2%

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a0e18bc View commit details
    Browse the repository at this point in the history
  45. Add now 5%

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9c49594 View commit details
    Browse the repository at this point in the history
  46. 3%

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b66a128 View commit details
    Browse the repository at this point in the history
  47. 4%

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e6e0e2a View commit details
    Browse the repository at this point in the history
  48. Configuration menu
    Copy the full SHA
    314ec58 View commit details
    Browse the repository at this point in the history
  49. Executable; compatible with NixOS

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8dcb837 View commit details
    Browse the repository at this point in the history
  50. Add persitency-dir options to hydra-node

    Due to the watch_logs script isn't able to find it
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a9ff65b View commit details
    Browse the repository at this point in the history
  51. Configuration menu
    Copy the full SHA
    88e5bce View commit details
    Browse the repository at this point in the history
  52. Add base network testing readme docs

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    080d915 View commit details
    Browse the repository at this point in the history
  53. Use local functions to seed the network

    Instead of exposing private ones defined in where clauses.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6290615 View commit details
    Browse the repository at this point in the history
  54. Do not seed neetwork before runnin bench-demo

    Because the script will be seeding the network.
    The reason for this its because the scripts does not rely on
    a genesis funding transaction.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    de10549 View commit details
    Browse the repository at this point in the history
  55. Remove FIXME as its not reproduceable

    It just simply does not break ¯\_(ツ)_/¯
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1c086e9 View commit details
    Browse the repository at this point in the history
  56. Minor refactor on generateOneTransfer

    So that is reusable for this use-case without braking others.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    58eab02 View commit details
    Browse the repository at this point in the history
  57. Use random/self transfer generator functions

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    088d661 View commit details
    Browse the repository at this point in the history
  58. Update demo-bech to take datasets from args

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e48b67a View commit details
    Browse the repository at this point in the history
  59. Gen demo datasets

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    4d1b2cb View commit details
    Browse the repository at this point in the history
  60. Refactor HydraClient to keep peer information

    This is useful to triger node actions not depending on localhost,
    like in demo-bench where commit has to be done on running peers.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    eaef6ec View commit details
    Browse the repository at this point in the history
  61. dbg

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b29df8f View commit details
    Browse the repository at this point in the history
  62. Configuration menu
    Copy the full SHA
    7be87ce View commit details
    Browse the repository at this point in the history
  63. Generate each client dataset from a different client funding tx

    Instead of usign a single one from the faucet current utxo.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6c517b7 View commit details
    Browse the repository at this point in the history
  64. Try not to specify any output

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5a61308 View commit details
    Browse the repository at this point in the history
  65. Try using mkTxOutAutoBalance instead

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    2a69816 View commit details
    Browse the repository at this point in the history
  66. Fix client utxo

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    3a67f0c View commit details
    Browse the repository at this point in the history
  67. Try not to specify any output ~ v2

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6eec715 View commit details
    Browse the repository at this point in the history
  68. Go back to unbalanced outputs ~ v2

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b8bfb3e View commit details
    Browse the repository at this point in the history
  69. Make funding tx optional for datasets

    This is used to seed the network in other scenarios.
    This one assumes the cluster is pre-seeded.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    99035a4 View commit details
    Browse the repository at this point in the history
  70. Try not to specify any output ~ v3

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    374147a View commit details
    Browse the repository at this point in the history
  71. Try using mkTxOutAutoBalance instead ~ v2

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0250340 View commit details
    Browse the repository at this point in the history
  72. WIP; Revert faucet; use buildRawTransaction

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5617254 View commit details
    Browse the repository at this point in the history
  73. Create workdir if it doesn't exist

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ef399ad View commit details
    Browse the repository at this point in the history
  74. Configuration menu
    Copy the full SHA
    04648a9 View commit details
    Browse the repository at this point in the history
  75. Small refactors around types

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0d7c62c View commit details
    Browse the repository at this point in the history
  76. Configuration menu
    Copy the full SHA
    c17ecfb View commit details
    Browse the repository at this point in the history
  77. Do not pre-seed devnet

    Instead, let the scenario seed the network and
    provide funds to running clients.
    At the end, funds are returned back to the faucet.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b98ad0a View commit details
    Browse the repository at this point in the history
  78. Use other script for exporting pparams

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    42d4cdf View commit details
    Browse the repository at this point in the history
  79. Configuration menu
    Copy the full SHA
    b761578 View commit details
    Browse the repository at this point in the history
  80. add failure handling on tx processing while head is open

    this allows us to close the head when we get a
    time exceeded while wait for all confirmations when processing a tx.
    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    79dfee8 View commit details
    Browse the repository at this point in the history
  81. Compute pct of transactions confirmed

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0a15354 View commit details
    Browse the repository at this point in the history
  82. 4% should work

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e205443 View commit details
    Browse the repository at this point in the history
  83. Enhance workflow

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b00a43c View commit details
    Browse the repository at this point in the history
  84. Some nice refactoring

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0872fa1 View commit details
    Browse the repository at this point in the history
  85. Make watch for logs optional

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8e2c14d View commit details
    Browse the repository at this point in the history
  86. Reframe wait for peer disconnected variable

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f77ef9b View commit details
    Browse the repository at this point in the history
  87. Experiment with a matrix

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a855021 View commit details
    Browse the repository at this point in the history
  88. Name in artifact

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    faee8b8 View commit details
    Browse the repository at this point in the history
  89. Expect-failure matrix configuration

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0efbdc4 View commit details
    Browse the repository at this point in the history
  90. Add failure mode we expect; refine matrix

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7335112 View commit details
    Browse the repository at this point in the history
  91. Fix order of detecting error conditions

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    c80281f View commit details
    Browse the repository at this point in the history
  92. Add scaling factor to matrix config

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a1e0de4 View commit details
    Browse the repository at this point in the history
  93. Replace yq by docker inspect

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    d14576b View commit details
    Browse the repository at this point in the history
  94. Upload the results as part of the artifacts

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b90ee87 View commit details
    Browse the repository at this point in the history
  95. Configuration menu
    Copy the full SHA
    46746c6 View commit details
    Browse the repository at this point in the history
  96. Write the summary out even when it failed

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8324d53 View commit details
    Browse the repository at this point in the history
  97. Make peers part of the matrix

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0ccb72d View commit details
    Browse the repository at this point in the history
  98. Allow 5% to fail

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    dd2051f View commit details
    Browse the repository at this point in the history
  99. Configuration menu
    Copy the full SHA
    b4c3376 View commit details
    Browse the repository at this point in the history
  100. Add extra scaling factor

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    d7b18ab View commit details
    Browse the repository at this point in the history
  101. Matrix information in the name

    noonio authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    fc26227 View commit details
    Browse the repository at this point in the history
  102. Rename hydra clients peers to api hosts

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    4f31cfe View commit details
    Browse the repository at this point in the history
  103. Update README

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    cc59644 View commit details
    Browse the repository at this point in the history
  104. Configuration menu
    Copy the full SHA
    116976f View commit details
    Browse the repository at this point in the history
  105. Update bench demo option description

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    d1d96fd View commit details
    Browse the repository at this point in the history
  106. Make the scenario to seed the network

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a5185a5 View commit details
    Browse the repository at this point in the history
  107. Configuration menu
    Copy the full SHA
    02d460d View commit details
    Browse the repository at this point in the history
  108. Do not trace signing keys during benchmark

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    36ac132 View commit details
    Browse the repository at this point in the history
  109. Configuration menu
    Copy the full SHA
    cdf5ff6 View commit details
    Browse the repository at this point in the history
  110. Remove unnecessary scripts

    ffakenz authored and ch1bo committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5e69dd7 View commit details
    Browse the repository at this point in the history
  111. Configuration menu
    Copy the full SHA
    a555aec View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Remove hack to check every node sees head is initialized for demo

    In this case the parties are unknown but we still need
    to fetch the headId from a head id observation.
    ffakenz committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    3aafd9c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    710d65f View commit details
    Browse the repository at this point in the history
  3. Fix not seeding during scenario but before it gets executed

    The reason is  depends on  before starting the hydra-cluster.
    That consumes the Faucet UTxO making the fundingTransaction from dataset invalid, thus
    making the scenario to fail.
    ffakenz committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6654d08 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c5d1208 View commit details
    Browse the repository at this point in the history