Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve select-parsing test readability #48699

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Improve select-parsing test readability

0c36525
Select commit
Loading
Failed to load commit list.
Draft

Improve select-parsing test readability #48699

Improve select-parsing test readability
0c36525
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-results-without-changes succeeded Oct 18, 2024 in 4m 23s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in firefox but without the changes in the PR.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-10-18T16:18:50.319Z
Resolved: 2024-10-18T16:20:37.504Z
Task Execution Time: 1 minute, 47 seconds, 185 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected task_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2024-10-18 16:18:50.364Z] Task ID: CNahWXuJTWSkiiZFTDOQ_Q
[taskcluster 2024-10-18 16:18:50.364Z] Worker ID: 3111122291971274648
[taskcluster 2024-10-18 16:18:50.364Z] Worker Group: us-central1-f
[taskcluster 2024-10-18 16:18:50.364Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2024-10-18 16:18:50.364Z] Worker Pool: proj-wpt/ci
[taskcluster 2024-10-18 16:18:50.364Z] Worker Version: 46.1.0
[taskcluster 2024-10-18 16:18:50.364Z] Public IP: 34.41.143.46
[taskcluster 2024-10-18 16:18:50.364Z] Hostname: proj-wpt-ci-dok9qkb9qm-7epuj6tg3cg

[taskcluster 2024-10-18 16:18:50.956Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/libvirt-uri.sh ']'
+ . /etc/profile.d/libvirt-uri.sh

...(371 lines hidden)...

       cwd: /tmp/pip-install-_4kbv1h7/mozprofile/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozprofile
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-_4kbv1h7/mozrunner/setup.py'"'"'; __file__='"'"'/tmp/pip-install-_4kbv1h7/mozrunner/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-v_yqd0pb
       cwd: /tmp/pip-install-_4kbv1h7/mozrunner/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozrunner
 0:10.58 INFO Identified 1 affected tests
 0:10.58 INFO Using certutil /usr/bin/certutil
 0:10.58 INFO Downloading geckodriver
 0:10.58 INFO Attempting to install webdriver from nightly
 0:10.87 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
 0:10.88 INFO Installed b'geckodriver 0.35.0 (9e5434b8ef55 2024-09-07 00:18 +0000)'
 0:10.90 INFO Downloading test prefs from https://hg.mozilla.org/mozilla-central/archive/tip.zip/testing/profiles/
 0:16.95 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/nightly/133.0
 0:17.09 mozversion INFO application_buildid: 20241018093844
 0:17.09 mozversion INFO application_changeset: 8c0e0212d9532511ab649d58932e7a7e07fb8704
 0:17.09 mozversion INFO application_display_name: Firefox Nightly
 0:17.09 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
 0:17.09 mozversion INFO application_name: Firefox
 0:17.09 mozversion INFO application_remotingname: firefox-nightly
 0:17.09 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
 0:17.09 mozversion INFO application_vendor: Mozilla
 0:17.09 mozversion INFO application_version: 133.0a1
 0:17.09 mozversion INFO platform_buildid: 20241018093844
 0:17.09 mozversion INFO platform_changeset: 8c0e0212d9532511ab649d58932e7a7e07fb8704
 0:17.09 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
 0:17.09 mozversion INFO platform_version: 133.0a1
 0:22.50 INFO Installed font: Ahem.ttf
 0:23.38 wptserve INFO Starting http server on http://127.0.0.1:8000
 0:23.39 wptserve INFO Starting http server on http://127.0.0.1:8002
 0:23.42 wptserve INFO Starting http server on http://127.0.0.1:8003
 0:23.47 wptserve INFO Starting http server on http://127.0.0.1:8001
 0:23.47 wptserve INFO Starting https server on https://127.0.0.1:8445
 0:23.49 wptserve INFO Starting https server on https://127.0.0.1:8446
 0:23.51 wptserve INFO Starting https server on https://127.0.0.1:8444
 0:23.52 wptserve INFO Starting https server on https://127.0.0.1:8443
 0:23.52 wptserve INFO Starting http2 server on https://127.0.0.1:9000
 0:23.54 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.54 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.54 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.54 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.54 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.54 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.65 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:24.00 SUITE_START: web-platform-test - running 1 tests
 0:32.68 INFO Using 1 child processes
 0:32.70 INFO Setting up ssl
 0:32.73 certutil Full command: /usr/bin/certutil -N -d /tmp/tmptiiuamrd.mozrunner -f /tmp/tmptiiuamrd.mozrunner/.crtdbpw
certutil b''
 0:32.76 certutil b''
 0:32.77 certutil b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
 0:32.78 INFO Application command: /home/test/build/firefox/firefox --marionette about:blank -profile /tmp/tmpg_5chj97
 0:32.79 INFO Starting runner
 0:33.25 pid:1391 Full command: /home/test/build/firefox/firefox --marionette about:blank
pid:1391 [GFX1-]: glxtest: libpci missing
 0:33.26 pid:1391 ATTENTION: default value of option mesa_glthread overridden by environment.
 0:33.34 pid:1391 1729268430310	Marionette	INFO	Marionette enabled
 0:33.43 pid:1391 1729268430400	Marionette	INFO	Listening on port 45261
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
 0:35.44 pid:1391 console.error: ({})
 0:36.16 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:36.16 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amo: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:36.16 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:36.16 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Amp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:36.17 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:36.19 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Wikipedia: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:36.19 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:36.20 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Mdn: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:36.20 pid:1391 [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
 0:36.20 pid:1391 console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error for Yelp: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
 0:36.27 TEST_START: /html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html
 0:36.46 TEST_END: Test OK. Subtests passed 1/8. Unexpected 7
FAIL <div>s, <button>s, and <datalist>s should be allowed in <select>. - assert_equals: expected "\n  <div>div 1</div>\n  <button>button</button>\n  <div>div 2</div>\n  <datalist>\n    <option>option</option>\n  </datalist>\n  <div>div 3</div>\n" but got "\n  div 1\n  button\n  div 2\n  \n    <option>option</option>\n  \n  div 3\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:58:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:54:5
FAIL </select> should close <button>. - assert_equals: expected "\n  <button>button\n</button>" but got "\n  button\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:71:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:69:5
FAIL </select> should close <datalist>. - assert_equals: expected "\n  <datalist>datalist\n</datalist>" but got "\n  datalist\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:78:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:76:5
FAIL <select> in <button> in <select> should remove inner <select>. - assert_equals: expected "\n  <button>\n    </button>" but got "\n  \n    "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:85:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:83:5
FAIL <select> in <select><button><div> should remove inner <select>. - assert_equals: expected "\n  <button>\n    <div>\n      </div></button>" but got "\n  \n    \n      "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:92:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:90:5
FAIL Divs and imgs should be allowed as direct children of select and within options without a datalist. - assert_equals: expected "\n  <div>\n    <option><img>option</option>\n  </div>\n" but got "\n  \n    <option>option</option>\n  \n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:100:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:98:5
FAIL Input tags should parse inside select instead of closing the select. - assert_equals: expected "\n  <input>\n" but got "\n  "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:109:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:107:5

 0:36.46 INFO No more tests
 0:36.46 pid:1391 1729268433433	Marionette	INFO	Stopped listening on port 45261
 0:37.11 INFO Browser exited with return code -15
 0:37.00 INFO Closing logging queue
 0:37.00 INFO queue closed
 0:37.12 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 9 checks (8 subtests, 1 tests)
Expected results: 2
Unexpected results: 7
  subtest: 7 (7 fail)

Unexpected Results
------------------
/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html
  FAIL <div>s, <button>s, and <datalist>s should be allowed in <select>. - assert_equals: expected "\n  <div>div 1</div>\n  <button>button</button>\n  <div>div 2</div>\n  <datalist>\n    <option>option</option>\n  </datalist>\n  <div>div 3</div>\n" but got "\n  div 1\n  button\n  div 2\n  \n    <option>option</option>\n  \n  div 3\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:58:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:54:5
  FAIL </select> should close <button>. - assert_equals: expected "\n  <button>button\n</button>" but got "\n  button\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:71:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:69:5
  FAIL </select> should close <datalist>. - assert_equals: expected "\n  <datalist>datalist\n</datalist>" but got "\n  datalist\n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:78:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:76:5
  FAIL <select> in <button> in <select> should remove inner <select>. - assert_equals: expected "\n  <button>\n    </button>" but got "\n  \n    "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:85:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:83:5
  FAIL <select> in <select><button><div> should remove inner <select>. - assert_equals: expected "\n  <button>\n    <div>\n      </div></button>" but got "\n  \n    \n      "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:92:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:90:5
  FAIL Divs and imgs should be allowed as direct children of select and within options without a datalist. - assert_equals: expected "\n  <div>\n    <option><img>option</option>\n  </div>\n" but got "\n  \n    <option>option</option>\n  \n"
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:100:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:98:5
  FAIL Input tags should parse inside select instead of closing the select. - assert_equals: expected "\n  <input>\n" but got "\n  "
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:109:16
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2622:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/html/semantics/forms/the-select-element/customizable-select/select-parsing.tentative.html:107:5
 0:37.12 INFO Got 1 unexpected results, with 0 unexpected passes
 0:37.12 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:37.40 wptserve INFO Stopped http server on 127.0.0.1:8000
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8002
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8001
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8443
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8003
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8445
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8444
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:9000
 0:37.52 wptserve INFO Stopped http server on 127.0.0.1:8446
 0:37.53 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:37.53 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:37.63 INFO Removed font: Ahem.ttf
 0:37.65 INFO Closing logging queue
 0:37.65 INFO queue closed
 0:37.65 INFO Tolerating 1 unexpected results
X connection to :99.0 broken (explicit kill or server shutdown).

[taskcluster 2024-10-18 16:20:36.221Z] === Task Finished ===
[taskcluster 2024-10-18 16:20:36.939Z] Successful task run with exit code: 0 completed in 106.575 seconds
View more details on Community-TC Integration