Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a nice message when reftest screenshots differ in size #49837

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Add a nice message when reftest screenshots differ in size

e2a2e32
Select commit
Loading
Failed to load commit list.
Open

Add a nice message when reftest screenshots differ in size #49837

Add a nice message when reftest screenshots differ in size
e2a2e32
Select commit
Loading
Failed to load commit list.
Community-TC Integration / resources/ tests (Python 3.8) succeeded Dec 24, 2024 in 5m 11s

Community-TC (pull_request)

Tests for testharness.js and other files in resources/ under Python 3.8

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-12-24T06:04:35.684Z
Resolved: 2024-12-24T06:08:42.044Z
Task Execution Time: 4 minutes, 6 seconds, 360 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2024-12-24 06:04:35.752Z] Task ID: bzNKS1hDSYOrV4Sr2tYf-A
[taskcluster 2024-12-24 06:04:35.752Z] Worker ID: 8557413875845689386
[taskcluster 2024-12-24 06:04:35.752Z] Worker Group: us-east4-c
[taskcluster 2024-12-24 06:04:35.752Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2024-12-24 06:04:35.752Z] Worker Pool: proj-wpt/ci
[taskcluster 2024-12-24 06:04:35.752Z] Worker Version: 46.1.0
[taskcluster 2024-12-24 06:04:35.752Z] Public IP: 34.86.146.17
[taskcluster 2024-12-24 06:04:35.752Z] Hostname: proj-wpt-ci-asgdg6s0rkyodkpws-yjvg

72ebe8ecf66d - Started downloading
ff2b96c8f8ff - Started downloading
ff2b96c8f8ff - Downloaded in 0.002 seconds
430011f338a2 - Started downloading
79df10d18997 - Started downloading
560c024910be - Started downloading
560c024910be - Downloaded in 0.18 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.001 seconds
7e274023cae9 - Started downloading
7e274023cae9 - Downloaded in 0.042 seconds

...(537 lines hidden)...

console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.warn: services.settings: #fetchAttachment: Forcing fallbackToDump to false due to Utils.LOAD_DUMPS being false

console.error: (new NotFoundError("Could not find fa0fc42c-d91d-fca7-34eb-806ff46062dc in cache or dump", "resource://services-settings/Attachments.sys.mjs", 48))

console.warn: "Unable to find the attachment for" "fa0fc42c-d91d-fca7-34eb-806ff46062dc"

console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



PASSED                [  1%]

tests/functional/add_cleanup.html::Test#add_cleanup PASSED               [  2%]

tests/functional/add_cleanup_async.html::Test#add_cleanup with Promise-returning functions PASSED [  3%]

tests/functional/add_cleanup_async_bad_return.html::Test#add_cleanup with non-thenable-returning function PASSED [  4%]

tests/functional/add_cleanup_async_rejection.html::Test#add_cleanup with Promise-returning functions (rejection handling) PASSED [  5%]

tests/functional/add_cleanup_async_rejection_after_load.html::Test#add_cleanup with Promise-returning functions (rejection handling following "load" event) PASSED [  6%]

tests/functional/add_cleanup_async_timeout.html::Test#add_cleanup with Promise-returning functions (timeout handling) PASSED [  7%]

tests/functional/add_cleanup_bad_return.html::Test#add_cleanup with value-returning function PASSED [  9%]

tests/functional/add_cleanup_count.html::Test#add_cleanup reported count PASSED [ 10%]

tests/functional/add_cleanup_err.html::Test#add_cleanup: error PASSED    [ 11%]

tests/functional/add_cleanup_err_multi.html::Test#add_cleanup: multiple functions with one in error PASSED [ 12%]

tests/functional/add_cleanup_sync_queue.html::Test#add_cleanup: queuing tests PASSED [ 13%]

tests/functional/api-tests-1.html::Sample HTML5 API Tests JavaScript error: resource:///modules/backup/BackupService.sys.mjs, line 108: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]

PASSED         [ 14%]

tests/functional/api-tests-2.html::Sample HTML5 API Tests PASSED         [ 15%]

tests/functional/api-tests-3.html::Sample HTML5 API Tests PASSED         [ 17%]

tests/functional/assert-array-equals.html::assert_array_equals PASSED    [ 18%]

tests/functional/assert-throws-dom.html::assert_throws_dom PASSED        [ 19%]

tests/functional/force_timeout.html::Test#force_timeout PASSED           [ 20%]

tests/functional/generate-callback.html::Sample for using generate_tests to create a series of tests that share the same callback. PASSED [ 21%]

tests/functional/idlharness/IdlDictionary/test_partial_interface_of.html::idlharness: Partial dictionary PASSED [ 22%]

tests/functional/idlharness/IdlInterface/test_exposed_wildcard.html::idlharness: Exposed=* PASSED [ 23%]

tests/functional/idlharness/IdlInterface/test_immutable_prototype.html::idlharness: Immutable prototypes PASSED [ 25%]

tests/functional/idlharness/IdlInterface/test_interface_mixin.html::idlharness: interface mixins PASSED [ 26%]

tests/functional/idlharness/IdlInterface/test_partial_interface_of.html::idlharness: Partial interface PASSED [ 27%]

tests/functional/idlharness/IdlInterface/test_primary_interface_of.html::idlharness: Primary interface PASSED [ 28%]

tests/functional/idlharness/IdlInterface/test_to_json_operation.html::IdlInterface.prototype.test_to_json_operation() PASSED [ 29%]

tests/functional/idlharness/IdlNamespace/test_attribute.html::idlharness: namespace attribute PASSED [ 30%]

tests/functional/idlharness/IdlNamespace/test_operation.html::idlharness: namespace operation PASSED [ 31%]

tests/functional/idlharness/IdlNamespace/test_partial_namespace.html::idlharness: Partial namespace PASSED [ 32%]

tests/functional/iframe-callback.html::Example with iframe that notifies containing document via callbacks PASSED [ 34%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error

tests/functional/iframe-consolidate-errors.html::Example with iframe that consolidates errors via fetch_tests_from_window console.error: services.settings: 

  Message: Error: Unexpected content-type "text/plain;charset=US-ASCII"

  Stack:

    fetchLatestChanges@resource://services-settings/Utils.sys.mjs:441:13



console.error: (new Error("Polling for changes failed: Unexpected content-type \"text/plain;charset=US-ASCII\".", "resource://services-settings/remote-settings.sys.mjs", 430))

console.error: "Could not download new icon" (new ServerInfoError("Server response is invalid SyntaxError: JSON.parse: unexpected end of data at line 1 column 1 of the JSON data", "resource://services-settings/Attachments.sys.mjs", 40))

PASSED [ 35%]

tests/functional/iframe-consolidate-tests.html::Example with iframe that consolidates tests via fetch_tests_from_window PASSED [ 36%]

tests/functional/iframe-msg.html::Example with iframe that notifies containing document via cross document messaging PASSED [ 37%]

tests/functional/log-insertion.html::Log insertion PASSED                [ 38%]

tests/functional/no-title.html::Tests with no title PASSED               [ 39%]

tests/functional/order.html::Ordering PASSED                             [ 40%]

tests/functional/promise-async.html::Async Tests and Promises PASSED     [ 42%]

tests/functional/promise-with-sync.html::Promise Tests and Synchronous Tests PASSED [ 43%]

tests/functional/promise.html::Promise Tests PASSED                      [ 44%]

tests/functional/queue.html::Test queuing synchronous tests PASSED       [ 45%]

tests/functional/setup-worker-service.html::Setup function in a service worker PASSED [ 46%]

JavaScript error: https://web-platform.test:8443/resources/testharness.js, line 1469: uncaught exception: Error: assert_true: expected true got false

tests/functional/single-page-test-fail.html::Example with file_is_test (should fail) PASSED [ 47%]

tests/functional/single-page-test-no-assertions.html::Example single page test with no asserts PASSED [ 48%]

tests/functional/single-page-test-no-body.html::Example single page test with no body PASSED [ 50%]

tests/functional/single-page-test-pass.html::Example with file_is_test PASSED [ 51%]

tests/functional/step_wait.html::Tests for step_wait PASSED              [ 52%]

tests/functional/step_wait_func.html::Tests for step_wait_func and step_wait_func_done PASSED [ 53%]

tests/functional/task-scheduling-promise-test.html::testharness.js - task scheduling PASSED [ 54%]

tests/functional/task-scheduling-test.html::testharness.js - task scheduling PASSED [ 55%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error

tests/functional/uncaught-exception-handle.html::Harness Handling Uncaught Exception PASSED [ 56%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-ignore.html, line 15: Error: Example Error

tests/functional/uncaught-exception-ignore.html::Harness Ignoring Uncaught Exception PASSED [ 57%]

tests/functional/worker-dedicated-uncaught-allow.html::Dedicated Worker Tests - Allowed Uncaught Exception PASSED [ 59%]

tests/functional/worker-dedicated-uncaught-single.html::Dedicated Worker Tests - Uncaught Exception in Single-Page Test PASSED [ 60%]

tests/functional/worker-dedicated.sub.html::Dedicated Worker Tests PASSED [ 61%]

tests/functional/worker-service.html::Example with a service worker PASSED [ 62%]

tests/functional/worker-shared.html::Example with a shared worker PASSED [ 63%]

tests/unit/IdlArray/is_json_type.html::IdlArray.prototype.is_json_type() PASSED [ 64%]

tests/unit/IdlDictionary/get_reverse_inheritance_stack.html::IdlDictionary.prototype.get_reverse_inheritance_stack() PASSED [ 65%]

tests/unit/IdlDictionary/test_partial_dictionary.html::idlharness: partial dictionaries PASSED [ 67%]

tests/unit/IdlInterface/constructors.html::IdlInterface.prototype.constructors() PASSED [ 68%]

tests/unit/IdlInterface/default_to_json_operation.html::IdlDictionary.prototype.default_to_json_operation() PASSED [ 69%]

tests/unit/IdlInterface/do_member_unscopable_asserts.html::IdlDictionary.prototype.do_member_unscopable_asserts() PASSED [ 70%]

tests/unit/IdlInterface/get_interface_object.html::IdlInterface.prototype.get_interface_object() PASSED [ 71%]

tests/unit/IdlInterface/get_interface_object_owner.html::IdlInterface.prototype.get_interface_object_owner() PASSED [ 72%]

tests/unit/IdlInterface/get_legacy_namespace.html::IdlInterface.prototype.get_legacy_namespace() PASSED [ 73%]

tests/unit/IdlInterface/get_qualified_name.html::IdlInterface.prototype.get_qualified_name() PASSED [ 75%]

tests/unit/IdlInterface/get_reverse_inheritance_stack.html::IdlInterface.prototype.get_reverse_inheritance_stack() PASSED [ 76%]

tests/unit/IdlInterface/has_default_to_json_regular_operation.html::IdlInterface.prototype.has_default_to_json_regular_operation() PASSED [ 77%]

tests/unit/IdlInterface/has_to_json_regular_operation.html::IdlInterface.prototype.has_to_json_regular_operation() PASSED [ 78%]

tests/unit/IdlInterface/should_have_interface_object.html::IdlInterface.prototype.should_have_interface_object() PASSED [ 79%]

tests/unit/IdlInterface/test_primary_interface_of_undefined.html::idlharness test_primary_interface_of_undefined PASSED [ 80%]

tests/unit/IdlInterfaceMember/is_to_json_regular_operation.html::IdlInterfaceMember.prototype.is_to_json_regular_operation() PASSED [ 81%]

tests/unit/IdlInterfaceMember/toString.html::IdlInterfaceMember.prototype.toString() PASSED [ 82%]

tests/unit/assert_implements.html::assert_implements unittests PASSED    [ 84%]

tests/unit/assert_implements_optional.html::assert_implements_optional unittests PASSED [ 85%]

tests/unit/assert_object_equals.html::Assertion functions PASSED         [ 86%]

tests/unit/async-test-return-restrictions.html::Restrictions on return value from `async_test` PASSED [ 87%]

tests/unit/basic.html::idlharness basic PASSED                           [ 88%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected

tests/unit/exceptional-cases-timeouts.html::Exceptional cases - timeouts PASSED [ 89%]

tests/unit/exceptional-cases.html::Exceptional cases JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.40537461495895766, line 1469: uncaught exception: Error: assert_false: expected false got true

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 16: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 17: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 19: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

PASSED              [ 90%]

tests/unit/format-value.html::format_value utility function PASSED       [ 92%]

tests/unit/late-test.html::Test declared after harness completion PASSED [ 93%]

tests/unit/promise_setup-timeout.html::promise_setup - timeout PASSED    [ 94%]

tests/unit/promise_setup.html::promise_setup JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 15: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 18: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 20: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 17: Error: this error is expected

PASSED                      [ 95%]

tests/unit/single_test.html::single_test JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.7591335025134318, line 2493: Error: Tried to create a test with file_is_test

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.8914889918568517, line 2493: Error: Tried to create a test with file_is_test

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.5057036411084027, line 2493: Error: Tried to create a test with file_is_test

PASSED                          [ 96%]

tests/unit/test-return-restrictions.html::Restrictions on return value from `test` PASSED [ 97%]

tests/unit/throwing-assertions.html::Test the methods that make assertions about exceptions PASSED [ 98%]

tests/unit/unpaired-surrogates.html::Restrictions on return value from `test` PASSED [100%]



=============================== warnings summary ===============================

conftest.py:32

  /home/test/web-platform-tests/resources/test/conftest.py:32: PytestRemovedIn9Warning: The (path: py.path.local) argument is deprecated, please use (file_path: pathlib.Path)

  see https://docs.pytest.org/en/latest/deprecations.html#py-path-local-arguments-for-hooks-replaced-with-pathlib-path

    def pytest_collect_file(file_path, path, parent):



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================== 88 passed, 1 warning in 106.27s (0:01:46) ===================

1735020520084	Marionette	INFO	Stopped listening on port 38509

[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt

  py38: OK (113.85=setup[3.45]+cmd[110.40] seconds)
  congratulations :) (113.91 seconds)
X connection to :99.0 broken (explicit kill or server shutdown).

[taskcluster 2024-12-24 06:08:41.369Z] === Task Finished ===
[taskcluster 2024-12-24 06:08:41.421Z] Successful task run with exit code: 0 completed in 245.672 seconds