Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add web platform tests for WebExtensions API in WebDriver Classic #49786

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Add web platform tests for WebExtensions API in WebDriver Classic

6a613b1
Select commit
Loading
Failed to load commit list.
Open

Add web platform tests for WebExtensions API in WebDriver Classic #49786

Add web platform tests for WebExtensions API in WebDriver Classic
6a613b1
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-stability succeeded Dec 19, 2024 in 1h 25m 57s

Community-TC (pull_request)

Verify that all tests affected by a pull request are stable when executed in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-12-19T19:32:33.655Z
Resolved: 2024-12-19T20:56:58.515Z
Task Execution Time: 1 hour, 24 minutes, 24 seconds, 860 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md

WPT Command: python3 ./wpt run --channel=nightly --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox


[taskcluster 2024-12-19 19:32:33.718Z] Task ID: D-hh7MpfTKCDyzDBfagZVQ
[taskcluster 2024-12-19 19:32:33.718Z] Worker ID: 6270063200512363788
[taskcluster 2024-12-19 19:32:33.718Z] Worker Group: us-east1-c
[taskcluster 2024-12-19 19:32:33.718Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2024-12-19 19:32:33.718Z] Worker Pool: proj-wpt/ci
[taskcluster 2024-12-19 19:32:33.718Z] Worker Version: 46.1.0
[taskcluster 2024-12-19 19:32:33.718Z] Public IP: 34.73.160.163
[taskcluster 2024-12-19 19:32:33.718Z] Hostname: proj-wpt-ci-vuwe0sq8r2g1fo2bkur5bw

[taskcluster 2024-12-19 19:32:34.505Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/libvirt-uri.sh ']'
+ . /etc/profile.d/libvirt-uri.sh

...(258040 lines hidden)...

83:02.37 INFO | `test_frame_id_webelement_stale_element_reference[child_context]` | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_no_frame_element`                       | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_frame[0-foo]`                           | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_frame[1-bar]`                           | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_iframe[0-foo]`                          | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_iframe[1-bar]`                          | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_nested`                                 | PASS    |          |
83:02.37 INFO | `test_frame_id_webelement_cloned_into_iframe`                     | PASS    |          |
83:02.37 INFO 
83:02.37 INFO ### /webdriver/tests/classic/switch_to_parent_frame/switch.py ###
83:02.37 INFO |                      Subtest                      | Results | Messages |
83:02.37 INFO |---------------------------------------------------|---------|----------|
83:02.37 INFO |                                                   | OK      |          |
83:02.37 INFO | `test_null_response_value`                        | PASS    |          |
83:02.37 INFO | `test_no_top_browsing_context`                    | PASS    |          |
83:02.37 INFO | `test_no_browsing_context`                        | PASS    |          |
83:02.37 INFO | `test_no_browsing_context_when_already_top_level` | PASS    |          |
83:02.37 INFO | `test_switch_from_iframe`                         | PASS    |          |
83:02.37 INFO | `test_switch_from_top_level`                      | PASS    |          |
83:02.37 INFO 
83:02.37 INFO ### /webdriver/tests/classic/switch_to_window/alerts.py ###
83:02.37 INFO |            Subtest             | Results | Messages |
83:02.37 INFO |--------------------------------|---------|----------|
83:02.37 INFO |                                | OK      |          |
83:02.37 INFO | `test_retain_tab_modal_status` | PASS    |          |
83:02.37 INFO 
83:02.37 INFO ### /webdriver/tests/classic/switch_to_window/switch.py ###
83:02.37 INFO |                          Subtest                           | Results | Messages |
83:02.37 INFO |------------------------------------------------------------|---------|----------|
83:02.37 INFO |                                                            | OK      |          |
83:02.37 INFO | `test_null_parameter_value`                                | PASS    |          |
83:02.38 INFO | `test_null_response_value`                                 | PASS    |          |
83:02.38 INFO | `test_no_top_browsing_context`                             | PASS    |          |
83:02.38 INFO | `test_no_browsing_context`                                 | PASS    |          |
83:02.38 INFO | `test_switch_to_window_sets_top_level_context`             | PASS    |          |
83:02.38 INFO | `test_element_not_found_after_tab_switch`                  | PASS    |          |
83:02.38 INFO | `test_finds_exising_user_prompt_after_tab_switch[alert]`   | PASS    |          |
83:02.38 INFO | `test_finds_exising_user_prompt_after_tab_switch[confirm]` | PASS    |          |
83:02.38 INFO | `test_finds_exising_user_prompt_after_tab_switch[prompt]`  | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_element_screenshot/iframe.py ###
83:02.38 INFO |              Subtest               | Results | Messages |
83:02.38 INFO |------------------------------------|---------|----------|
83:02.38 INFO |                                    | OK      |          |
83:02.38 INFO | `test_frame_element`               | PASS    |          |
83:02.38 INFO | `test_source_origin[same_origin]`  | PASS    |          |
83:02.38 INFO | `test_source_origin[cross_origin]` | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_element_screenshot/screenshot.py ###
83:02.38 INFO |                         Subtest                         | Results | Messages |
83:02.38 INFO |---------------------------------------------------------|---------|----------|
83:02.38 INFO |                                                         | OK      |          |
83:02.38 INFO | `test_no_top_browsing_context`                          | PASS    |          |
83:02.38 INFO | `test_no_browsing_context`                              | PASS    |          |
83:02.38 INFO | `test_no_such_element_with_invalid_value`               | PASS    |          |
83:02.38 INFO | `test_no_such_element_with_shadow_root`                 | PASS    |          |
83:02.38 INFO | `test_no_such_element_from_other_window_handle[open]`   | PASS    |          |
83:02.38 INFO | `test_no_such_element_from_other_window_handle[closed]` | PASS    |          |
83:02.38 INFO | `test_no_such_element_from_other_frame[open]`           | PASS    |          |
83:02.38 INFO | `test_no_such_element_from_other_frame[closed]`         | PASS    |          |
83:02.38 INFO | `test_stale_element_reference[top_context]`             | PASS    |          |
83:02.38 INFO | `test_stale_element_reference[child_context]`           | PASS    |          |
83:02.38 INFO | `test_format_and_dimensions`                            | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_element_screenshot/user_prompts.py ###
83:02.38 INFO |                        Subtest                         | Results | Messages |
83:02.38 INFO |--------------------------------------------------------|---------|----------|
83:02.38 INFO |                                                        | OK      |          |
83:02.38 INFO | `test_accept[capabilities0-alert-None]`                | PASS    |          |
83:02.38 INFO | `test_accept[capabilities0-confirm-True]`              | PASS    |          |
83:02.38 INFO | `test_accept[capabilities0-prompt-]`                   | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-alert-None]`     | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-confirm-True]`   | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-prompt-]`        | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-alert-None]`               | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-confirm-False]`            | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-prompt-None]`              | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-alert-None]`    | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-confirm-False]` | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-prompt-None]`   | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-alert]`                     | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-confirm]`                   | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-prompt]`                    | PASS    |          |
83:02.38 INFO | `test_default[alert-None]`                             | PASS    |          |
83:02.38 INFO | `test_default[confirm-False]`                          | PASS    |          |
83:02.38 INFO | `test_default[prompt-None]`                            | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_screenshot/iframe.py ###
83:02.38 INFO |                   Subtest                   | Results | Messages |
83:02.38 INFO |---------------------------------------------|---------|----------|
83:02.38 INFO |                                             | OK      |          |
83:02.38 INFO | `test_always_captures_top_browsing_context` | PASS    |          |
83:02.38 INFO | `test_source_origin[same_origin]`           | PASS    |          |
83:02.38 INFO | `test_source_origin[cross_origin]`          | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_screenshot/screenshot.py ###
83:02.38 INFO |            Subtest             | Results | Messages |
83:02.38 INFO |--------------------------------|---------|----------|
83:02.38 INFO |                                | OK      |          |
83:02.38 INFO | `test_no_top_browsing_context` | PASS    |          |
83:02.38 INFO | `test_no_browsing_context`     | PASS    |          |
83:02.38 INFO | `test_format_and_dimensions`   | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/take_screenshot/user_prompts.py ###
83:02.38 INFO |                        Subtest                         | Results | Messages |
83:02.38 INFO |--------------------------------------------------------|---------|----------|
83:02.38 INFO |                                                        | OK      |          |
83:02.38 INFO | `test_accept[capabilities0-alert-None]`                | PASS    |          |
83:02.38 INFO | `test_accept[capabilities0-confirm-True]`              | PASS    |          |
83:02.38 INFO | `test_accept[capabilities0-prompt-]`                   | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-alert-None]`     | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-confirm-True]`   | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-prompt-]`        | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-alert-None]`               | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-confirm-False]`            | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-prompt-None]`              | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-alert-None]`    | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-confirm-False]` | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-prompt-None]`   | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-alert]`                     | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-confirm]`                   | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-prompt]`                    | PASS    |          |
83:02.38 INFO | `test_default[alert-None]`                             | PASS    |          |
83:02.38 INFO | `test_default[confirm-False]`                          | PASS    |          |
83:02.38 INFO | `test_default[prompt-None]`                            | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/web_extensions/load.py ###
83:02.38 INFO |                           Subtest                            | Results |                                  Messages                                 |
83:02.38 INFO |--------------------------------------------------------------|---------|---------------------------------------------------------------------------|
83:02.38 INFO |                                                              | OK      |                                                                           |
83:02.38 INFO | `test_no_top_browsing_context`                               | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_null_type_parameter`                                   | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_invalid_type_parameter`                                | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_null_value_parameter`                                  | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_invalid_zip`                                           | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_invalid_base64`                                        | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_invalid_path[path-/invalid/path/]`                     | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_invalid_path[archivePath-/invalid/path/extension.zip]` | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_load_extension[extension0]`                            | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_load_extension[extension1]`                            | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_load_extension[extension2]`                            | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/classic/web_extensions/unload.py ###
83:02.38 INFO |                   Subtest                    | Results |                                  Messages                                 |
83:02.38 INFO |----------------------------------------------|---------|---------------------------------------------------------------------------|
83:02.38 INFO |                                              | OK      |                                                                           |
83:02.38 INFO | `test_no_top_browsing_context`               | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_unload_extension_invalid_extension_id` | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO | `test_unload_extension`                      | FAIL    | `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)` |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/interop/beforeunload_prompt.py ###
83:02.38 INFO |                    Subtest                     | Results | Messages |
83:02.38 INFO |------------------------------------------------|---------|----------|
83:02.38 INFO |                                                | OK      |          |
83:02.38 INFO | `test_accept[capabilities0-False]`             | PASS    |          |
83:02.38 INFO | `test_accept[capabilities0-True]`              | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-False]`  | PASS    |          |
83:02.38 INFO | `test_accept_and_notify[capabilities0-True]`   | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-False]`            | PASS    |          |
83:02.38 INFO | `test_dismiss[capabilities0-True]`             | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-False]` | PASS    |          |
83:02.38 INFO | `test_dismiss_and_notify[capabilities0-True]`  | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-False]`             | PASS    |          |
83:02.38 INFO | `test_ignore[capabilities0-True]`              | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/interop/frames.py ###
83:02.38 INFO |                       Subtest                       | Results | Messages |
83:02.38 INFO |-----------------------------------------------------|---------|----------|
83:02.38 INFO |                                                     | OK      |          |
83:02.38 INFO | `test_classic_switch_to_parent_no_browsing_context` | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/interop/shared_id_node.py ###
83:02.38 INFO |                         Subtest                         | Results | Messages |
83:02.38 INFO |---------------------------------------------------------|---------|----------|
83:02.38 INFO |                                                         | OK      |          |
83:02.38 INFO | `test_web_element_reference_created_in_classic`         | PASS    |          |
83:02.38 INFO | `test_web_element_reference_created_in_bidi`            | PASS    |          |
83:02.38 INFO | `test_shadow_root_reference_created_in_classic[open]`   | PASS    |          |
83:02.38 INFO | `test_shadow_root_reference_created_in_classic[closed]` | PASS    |          |
83:02.38 INFO | `test_shadow_root_reference_created_in_bidi[open]`      | PASS    |          |
83:02.38 INFO | `test_shadow_root_reference_created_in_bidi[closed]`    | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ### /webdriver/tests/interop/shared_id_window.py ###
83:02.38 INFO |                     Subtest                      | Results | Messages |
83:02.38 INFO |--------------------------------------------------|---------|----------|
83:02.38 INFO |                                                  | OK      |          |
83:02.38 INFO | `test_top_level_context_id_equals_window_handle` | PASS    |          |
83:02.38 INFO | `test_web_window_reference_created_in_classic`   | PASS    |          |
83:02.38 INFO | `test_web_frame_reference_created_in_classic`    | PASS    |          |
83:02.38 INFO | `test_web_window_reference_created_in_bidi`      | PASS    |          |
83:02.38 INFO | `test_web_frame_reference_created_in_bidi`       | PASS    |          |
83:02.38 INFO 
83:02.38 INFO ::: Running tests in a loop with restarts 10 times : PASS *  2/10 repeats completed
83:02.38 INFO :::
83:02.38 INFO ::: Test verification PASS
83:02.38 INFO :::
X connection to :99.0 broken (explicit kill or server shutdown).

[taskcluster 2024-12-19 20:56:57.451Z] === Task Finished ===
[taskcluster 2024-12-19 20:56:57.856Z] Successful task run with exit code: 0 completed in 5064.139 seconds