Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a nice message when reftest screenshots differ in size #49837

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Add a nice message when reftest screenshots differ in size

e2a2e32
Select commit
Loading
Failed to load commit list.
Open

Add a nice message when reftest screenshots differ in size #49837

Add a nice message when reftest screenshots differ in size
e2a2e32
Select commit
Loading
Failed to load commit list.
Community-TC Integration / tools/ unittests (Python 3.12) succeeded Dec 24, 2024 in 10m 41s

Community-TC (pull_request)

Unit tests for tools running under Python 3.12, excluding wptrunner

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-12-24T06:04:21.391Z
Resolved: 2024-12-24T06:14:11.346Z
Task Execution Time: 9 minutes, 49 seconds, 955 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2024-12-24 06:04:21.451Z] Task ID: PqVr_J9UQd2WfdHSUtThFQ
[taskcluster 2024-12-24 06:04:21.451Z] Worker ID: 136240514684416165
[taskcluster 2024-12-24 06:04:21.451Z] Worker Group: us-east4-b
[taskcluster 2024-12-24 06:04:21.451Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2024-12-24 06:04:21.451Z] Worker Pool: proj-wpt/ci
[taskcluster 2024-12-24 06:04:21.451Z] Worker Version: 46.1.0
[taskcluster 2024-12-24 06:04:21.451Z] Public IP: 35.245.49.235
[taskcluster 2024-12-24 06:04:21.451Z] Hostname: proj-wpt-ci-orhsuy2tqxagrhkrowt4wq

[taskcluster 2024-12-24 06:04:22.215Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/libvirt-uri.sh ']'
+ . /etc/profile.d/libvirt-uri.sh

...(659 lines hidden)...



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================= 287 passed, 59 skipped, 1 warning in 10.99s ==================

py312-sauce: OK ✔ in 19.54 seconds
py312-servo: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/wptrunner/../requirements_pytest.txt -r /home/test/web-platform-tests/tools/wptrunner/requirements.txt
py312-servo: install_package> python -I -m pip install --force-reinstall --no-deps /home/test/web-platform-tests/tools/wptrunner/.tox/.tmp/package/7/wptrunner-1.14.tar.gz
py312-servo: commands[0]> pytest -c/home/test/web-platform-tests/tools/wptrunner/../pytest.ini --rootdir=/home/test/web-platform-tests/tools/wptrunner
============================= test session starts ==============================

platform linux -- Python 3.12.8, pytest-8.3.2, pluggy-1.5.0

cachedir: .tox/py312-servo/.pytest_cache

rootdir: /home/test/web-platform-tests/tools/wptrunner

configfile: ../pytest.ini

plugins: hypothesis-6.112.0, cov-5.0.0

collecting ... 
collected 346 items                                                            



wptrunner/formatters/tests/test_chromium.py ...................          [  5%]

wptrunner/tests/browsers/test_base.py .                                  [  5%]

wptrunner/tests/browsers/test_sauce.py ..........                        [  8%]

wptrunner/tests/browsers/test_webkitgtk.py ssssssssssssssssssss          [ 14%]

wptrunner/tests/test_executors.py ........                               [ 16%]

wptrunner/tests/test_expectedtree.py .....                               [ 18%]

wptrunner/tests/test_formatters.py .....                                 [ 19%]

wptrunner/tests/test_manifestexpected.py ..........                      [ 22%]

wptrunner/tests/test_manifestupdate.py .                                 [ 22%]

wptrunner/tests/test_metadata.py ............                            [ 26%]

wptrunner/tests/test_products.py sssssssssss..sssssss................... [ 37%]

.sssssssssss..sssssss                                                    [ 43%]

wptrunner/tests/test_stability.py ......                                 [ 45%]

wptrunner/tests/test_testloader.py ........                              [ 47%]

wptrunner/tests/test_update.py ......................................... [ 59%]

...............                                                          [ 63%]

wptrunner/tests/test_wptrunner.py ........                               [ 66%]

wptrunner/tests/test_wpttest.py .........                                [ 68%]

wptrunner/wptmanifest/tests/test_conditional.py ........                 [ 71%]

wptrunner/wptmanifest/tests/test_parser.py .........                     [ 73%]

wptrunner/wptmanifest/tests/test_serializer.py ......................... [ 80%]

..................                                                       [ 86%]

wptrunner/wptmanifest/tests/test_static.py ......                        [ 87%]

wptrunner/wptmanifest/tests/test_tokenizer.py .......................... [ 95%]

................                                                         [100%]



=============================== warnings summary ===============================

../wptserve/wptserve/request.py:4

  /home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13

    import cgi



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================= 290 passed, 56 skipped, 1 warning in 11.83s ==================

py312-servo: OK ✔ in 18.94 seconds
py312-webkit: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/wptrunner/../requirements_pytest.txt -r /home/test/web-platform-tests/tools/wptrunner/requirements.txt
py312-webkit: install_package> python -I -m pip install --force-reinstall --no-deps /home/test/web-platform-tests/tools/wptrunner/.tox/.tmp/package/8/wptrunner-1.14.tar.gz
py312-webkit: commands[0]> pytest -c/home/test/web-platform-tests/tools/wptrunner/../pytest.ini --rootdir=/home/test/web-platform-tests/tools/wptrunner
============================= test session starts ==============================

platform linux -- Python 3.12.8, pytest-8.3.2, pluggy-1.5.0

cachedir: .tox/py312-webkit/.pytest_cache

rootdir: /home/test/web-platform-tests/tools/wptrunner

configfile: ../pytest.ini

plugins: hypothesis-6.112.0, cov-5.0.0

collecting ... 
collected 346 items                                                            



wptrunner/formatters/tests/test_chromium.py ...................          [  5%]

wptrunner/tests/browsers/test_base.py .                                  [  5%]

wptrunner/tests/browsers/test_sauce.py ..........                        [  8%]

wptrunner/tests/browsers/test_webkitgtk.py ssssssssssssss.sssss          [ 14%]

wptrunner/tests/test_executors.py ........                               [ 16%]

wptrunner/tests/test_expectedtree.py .....                               [ 18%]

wptrunner/tests/test_formatters.py .....                                 [ 19%]

wptrunner/tests/test_manifestexpected.py ..........                      [ 22%]

wptrunner/tests/test_manifestupdate.py .                                 [ 22%]

wptrunner/tests/test_metadata.py ............                            [ 26%]

wptrunner/tests/test_products.py ssssssssssssss.sssss................... [ 37%]

.ssssssssssssss.sssss                                                    [ 43%]

wptrunner/tests/test_stability.py ......                                 [ 45%]

wptrunner/tests/test_testloader.py ........                              [ 47%]

wptrunner/tests/test_update.py ......................................... [ 59%]

...............                                                          [ 63%]

wptrunner/tests/test_wptrunner.py ........                               [ 66%]

wptrunner/tests/test_wpttest.py .........                                [ 68%]

wptrunner/wptmanifest/tests/test_conditional.py ........                 [ 71%]

wptrunner/wptmanifest/tests/test_parser.py .........                     [ 73%]

wptrunner/wptmanifest/tests/test_serializer.py ......................... [ 80%]

..................                                                       [ 86%]

wptrunner/wptmanifest/tests/test_static.py ......                        [ 87%]

wptrunner/wptmanifest/tests/test_tokenizer.py .......................... [ 95%]

................                                                         [100%]



=============================== warnings summary ===============================

../wptserve/wptserve/request.py:4

  /home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13

    import cgi



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================= 289 passed, 57 skipped, 1 warning in 11.47s ==================

py312-webkit: OK ✔ in 18.59 seconds
py312-webkitgtk_minibrowser: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/wptrunner/../requirements_pytest.txt -r /home/test/web-platform-tests/tools/wptrunner/requirements.txt
py312-webkitgtk_minibrowser: install_package> python -I -m pip install --force-reinstall --no-deps /home/test/web-platform-tests/tools/wptrunner/.tox/.tmp/package/9/wptrunner-1.14.tar.gz
py312-webkitgtk_minibrowser: commands[0]> pytest -c/home/test/web-platform-tests/tools/wptrunner/../pytest.ini --rootdir=/home/test/web-platform-tests/tools/wptrunner
============================= test session starts ==============================

platform linux -- Python 3.12.8, pytest-8.3.2, pluggy-1.5.0

cachedir: .tox/py312-webkitgtk_minibrowser/.pytest_cache

rootdir: /home/test/web-platform-tests/tools/wptrunner

configfile: ../pytest.ini

plugins: hypothesis-6.112.0, cov-5.0.0

collecting ... 
collected 346 items                                                            



wptrunner/formatters/tests/test_chromium.py ...................          [  5%]

wptrunner/tests/browsers/test_base.py .                                  [  5%]

wptrunner/tests/browsers/test_sauce.py ..........                        [  8%]

wptrunner/tests/browsers/test_webkitgtk.py sssssssssssssss.ssss          [ 14%]

wptrunner/tests/test_executors.py ........                               [ 16%]

wptrunner/tests/test_expectedtree.py .....                               [ 18%]

wptrunner/tests/test_formatters.py .....                                 [ 19%]

wptrunner/tests/test_manifestexpected.py ..........                      [ 22%]

wptrunner/tests/test_manifestupdate.py .                                 [ 22%]

wptrunner/tests/test_metadata.py ............                            [ 26%]

wptrunner/tests/test_products.py sssssssssssssss.ssss................... [ 37%]

.sssssssssssssss.ssss                                                    [ 43%]

wptrunner/tests/test_stability.py ......                                 [ 45%]

wptrunner/tests/test_testloader.py ........                              [ 47%]

wptrunner/tests/test_update.py ......................................... [ 59%]

...............                                                          [ 63%]

wptrunner/tests/test_wptrunner.py ........                               [ 66%]

wptrunner/tests/test_wpttest.py .........                                [ 68%]

wptrunner/wptmanifest/tests/test_conditional.py ........                 [ 71%]

wptrunner/wptmanifest/tests/test_parser.py .........                     [ 73%]

wptrunner/wptmanifest/tests/test_serializer.py ......................... [ 80%]

..................                                                       [ 86%]

wptrunner/wptmanifest/tests/test_static.py ......                        [ 87%]

wptrunner/wptmanifest/tests/test_tokenizer.py .......................... [ 95%]

................                                                         [100%]



=============================== warnings summary ===============================

../wptserve/wptserve/request.py:4

  /home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13

    import cgi



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================= 289 passed, 57 skipped, 1 warning in 11.50s ==================

py312-webkitgtk_minibrowser: OK ✔ in 18.6 seconds
py312-epiphany: install_deps> python -I -m pip install -r /home/test/web-platform-tests/tools/wptrunner/../requirements_pytest.txt -r /home/test/web-platform-tests/tools/wptrunner/requirements.txt
py312-epiphany: install_package> python -I -m pip install --force-reinstall --no-deps /home/test/web-platform-tests/tools/wptrunner/.tox/.tmp/package/10/wptrunner-1.14.tar.gz
py312-epiphany: commands[0]> pytest -c/home/test/web-platform-tests/tools/wptrunner/../pytest.ini --rootdir=/home/test/web-platform-tests/tools/wptrunner
============================= test session starts ==============================

platform linux -- Python 3.12.8, pytest-8.3.2, pluggy-1.5.0

cachedir: .tox/py312-epiphany/.pytest_cache

rootdir: /home/test/web-platform-tests/tools/wptrunner

configfile: ../pytest.ini

plugins: hypothesis-6.112.0, cov-5.0.0

collecting ... 
collected 346 items                                                            



wptrunner/formatters/tests/test_chromium.py ...................          [  5%]

wptrunner/tests/browsers/test_base.py .                                  [  5%]

wptrunner/tests/browsers/test_sauce.py ..........                        [  8%]

wptrunner/tests/browsers/test_webkitgtk.py ssssssssssssssssss.s          [ 14%]

wptrunner/tests/test_executors.py ........                               [ 16%]

wptrunner/tests/test_expectedtree.py .....                               [ 18%]

wptrunner/tests/test_formatters.py .....                                 [ 19%]

wptrunner/tests/test_manifestexpected.py ..........                      [ 22%]

wptrunner/tests/test_manifestupdate.py .                                 [ 22%]

wptrunner/tests/test_metadata.py ............                            [ 26%]

wptrunner/tests/test_products.py ssssssssssssssssss.s................... [ 37%]

.ssssssssssssssssss.s                                                    [ 43%]

wptrunner/tests/test_stability.py ......                                 [ 45%]

wptrunner/tests/test_testloader.py ........                              [ 47%]

wptrunner/tests/test_update.py ......................................... [ 59%]

...............                                                          [ 63%]

wptrunner/tests/test_wptrunner.py ........                               [ 66%]

wptrunner/tests/test_wpttest.py .........                                [ 68%]

wptrunner/wptmanifest/tests/test_conditional.py ........                 [ 71%]

wptrunner/wptmanifest/tests/test_parser.py .........                     [ 73%]

wptrunner/wptmanifest/tests/test_serializer.py ......................... [ 80%]

..................                                                       [ 86%]

wptrunner/wptmanifest/tests/test_static.py ......                        [ 87%]

wptrunner/wptmanifest/tests/test_tokenizer.py .......................... [ 95%]

................                                                         [100%]



=============================== warnings summary ===============================

../wptserve/wptserve/request.py:4

  /home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13

    import cgi



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================= 289 passed, 57 skipped, 1 warning in 11.43s ==================

  py312-base: OK (24.72=setup[12.45]+cmd[12.27] seconds)
  py312-chrome: OK (20.47=setup[7.69]+cmd[12.79] seconds)
  py312-firefox: OK (21.24=setup[8.89]+cmd[12.36] seconds)
  py312-opera: OK (20.24=setup[7.97]+cmd[12.27] seconds)
  py312-safari: OK (18.87=setup[6.63]+cmd[12.24] seconds)
  py312-sauce: OK (19.53=setup[7.69]+cmd[11.85] seconds)
  py312-servo: OK (18.94=setup[6.34]+cmd[12.61] seconds)
  py312-webkit: OK (18.59=setup[6.33]+cmd[12.26] seconds)
  py312-webkitgtk_minibrowser: OK (18.60=setup[6.28]+cmd[12.32] seconds)
  py312-epiphany: OK (18.59=setup[6.39]+cmd[12.20] seconds)
  congratulations :) (199.88 seconds)
+ export TOXENV=py312
+ TOXENV=py312
+ cd /home/test/web-platform-tests/tools/ci/../..
[taskcluster 2024-12-24 06:14:10.648Z] === Task Finished ===
[taskcluster 2024-12-24 06:14:10.699Z] Successful task run with exit code: 0 completed in 589.249 seconds