Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automate manual tests #847

Merged
merged 29 commits into from
Sep 26, 2024
Merged

Automate manual tests #847

merged 29 commits into from
Sep 26, 2024

Commits on Oct 5, 2022

  1. Add yamlWitnessStrip testing utility

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    2bc950b View commit details
    Browse the repository at this point in the history

  2. Add cram witness test to 56-witness/05-prec-problem

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    74477a4 View commit details
    Browse the repository at this point in the history

  3. Strip file hashes from YAML witness cram tests

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    d8b0c1e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into yaml-witness-cram

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    d751c4c View commit details
    Browse the repository at this point in the history

  5. Add YAML witness privatized invariant tests

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    9086c99 View commit details
    Browse the repository at this point in the history

  6. Fix variable counting with ana.apron.invariant.one-var

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    950cf9b View commit details
    Browse the repository at this point in the history

  7. Add ana.apron.invariant.diff-box test

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    6023cbd View commit details
    Browse the repository at this point in the history

  8. Add test for dead code messages (issue #94) 

    Automatic testing wasn't possible in #785 (comment),
but is now with cram.
    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    5959095 View commit details
    Browse the repository at this point in the history

  9. Add test for synthetic YAML witness invariant locations (PR #758)

    @sim642
    sim642 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    cd90dfe View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Automate 00-sanity/33-hoare-over-paths using cram

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    8cc3ff2 View commit details
    Browse the repository at this point in the history

  2. Print regression tests without any automatic checks

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    9f5c0e1 View commit details
    Browse the repository at this point in the history

  3. Fix many regression tests without automatic checks

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    4705c30 View commit details
    Browse the repository at this point in the history

  4. Add cram tests for manual checks

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    f1ca09d View commit details
    Browse the repository at this point in the history

  5. Hide getdate_err from MacOS output

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    7b3a3ec View commit details
    Browse the repository at this point in the history

  6. Add test for broken mutex contents hiding on MacOS

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    0542913 View commit details
    Browse the repository at this point in the history

  7. Fix 03-practical/28-base-mutex-macos

    @sim642
    sim642 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    7d9de04 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2022

  1. Add cram tests for CFG

    @sim642
    sim642 committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    f49fd11 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Merge branch 'master' into cram-manual

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    d285260 View commit details
    Browse the repository at this point in the history

  2. Add NOCHECK annotation to suppress missing automatic check warning

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    8971af4 View commit details
    Browse the repository at this point in the history

  3. Add NOCHECK and another annotations

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    5946abc View commit details
    Browse the repository at this point in the history

  4. Add NOCHECK and CRAM annotations to incremental tests

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    5de8823 View commit details
    Browse the repository at this point in the history

  5. Error on missing automatic checks in regression tests

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    205f058 View commit details
    Browse the repository at this point in the history

  6. Document meta annotations for regression tests

    @sim642
    sim642 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    8da7046 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Add yamlWitnessStripDiff for cram test 

    diff binary gives differently biased output on OSX, this should be fully deterministic.
    @sim642
    sim642 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    50b7e14 View commit details
    Browse the repository at this point in the history

  2. Add pretty-deterministic output for cram test

    @sim642
    sim642 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    65d4c02 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'master' into cram-manual

    @sim642
    sim642 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    e5a103c View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Document scope of regression test meta annotations

    @sim642
    sim642 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    701f1ae View commit details
    Browse the repository at this point in the history

  2. Comment on negative line numbers in update_suite

    @sim642
    sim642 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    8cce1c9 View commit details
    Browse the repository at this point in the history

  3. Add CRAM annotation to 00-sanity/33-hoare-over-paths 

    Although there are asserts, so update_suite doesn't complain about no checks.
    @sim642
    sim642 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    54eb6f6 View commit details
    Browse the repository at this point in the history