Lighthouse plugin make the process exit on latest build

[brendan-rice]

Have you read the documentation?

• Yes, I've read the how to make a reproducable bug guide
• Yes, I've read the how to debug my script guide

URL

https://www.bbc.co.uk

What are you trying to accomplish

I want to run lighthouse and have some of the key metrics around SEO, Accessibility and Performance output to json.

What browser did you use?

Chrome

How to reproduce

1 - Use latest docker image (sitespeedio/sitespeed.io:36-plus1).
2 - Run the command below

docker run --rm -v "${PWD}:/sitespeed.io" sitespeedio/sitespeed.io:36-plus1 https://www.bbc.co.uk `
  --lighthouse.enable `
  --lighthouse.settings.onlyCategories performance,accessibility,best-practices,seo `
  --browsertime.browser chrome `
  --browsertime.screenshot false `
  --browsertime.video false `
  --browsertime.visualMetrics false `
  --browsertime.cpu true `
  --json-output true `
  --axe.enable `
  --sustainable.useGreenWebHostingAPI true `
  --sustainable.enable `
  --plugins.add analysisstorer `
  --lighthouse.output json `
  --lighthouse.collectLighthouseResult true

3 - Check the output folder and notice there are no lighthouse results in the json data folder or any reference in html files

4 - Notice that disabled-by-default-lighthouse appears in the console output suggesting lighthouse isn't enabled

Log output

PS C:\sitespeed.io> docker run --rm -v "${PWD}:/sitespeed.io" sitespeedio/sitespeed.io:36-plus1 https://www.bbc.co.uk `
>> --lighthouse.enable `
>> --lighthouse.settings.onlyCategories performance,accessibility,best-practices,seo `
>> --browsertime.browser chrome `
>> --browsertime.screenshot false `
>> --browsertime.video false `
>> --browsertime.visualMetrics false `
>> --browsertime.cpu true `
>> --json-output true `
>> --axe.enable `
>> --sustainable.useGreenWebHostingAPI true `
>> --sustainable.enable `
>> --plugins.add analysisstorer `
>> --lighthouse.output json `
>> --lighthouse.collectLighthouseResult true
Google Chrome 131.0.6778.85
Mozilla Firefox 133.0
Microsoft Edge 131.0.2903.70
[2025-01-14 21:55:32] INFO: Versions OS: linux 5.15.167.4-microsoft-standard-WSL2 nodejs: v20.17.0 sitespeed.io: 36.0.0-alpha.2 browsertime: 24.0.0-alpha.5 coach: 8.1.1
[2025-01-14 21:55:32] INFO: Axe version 4.10.2 plugin activated
[2025-01-14 21:55:32] INFO: Use the sustainable web plugin with model 1byte
[2025-01-14 21:55:33] INFO: Running tests using Chrome - 3 iteration(s)
[2025-01-14 21:55:34] INFO: Use Chrome trace categories: -*,disabled-by-default-lighthouse,v8,v8.execute,blink.user_timing,devtools.timeline,disabled-by-default-devtools.timeline,disabled-by-default-devtools.timeline.stack,disabled-by-default-devtools.timeline.frame,disabled-by-default-devtools.timeline.invalidationTracking,loading,latencyInfo
[2025-01-14 21:55:34] INFO: Testing url https://www.bbc.co.uk iteration 1
[2025-01-14 21:55:43] INFO: Take cumulative layout shift screenshot
[2025-01-14 21:55:43] INFO: Take largest contentful paint screenshot
[2025-01-14 21:55:44] INFO: Configure AXE with {
  "enable": true
}
[2025-01-14 21:55:44] INFO: Run AXE with run options {}
[2025-01-14 21:55:47] INFO: https://www.bbc.co.uk TTFB: 140ms DOMContentLoaded: 227ms firstPaint: 227ms LCP: 308ms Load: 1.84s TBT: 580ms CLS:0.0006
[2025-01-14 21:55:48] INFO: Use Chrome trace categories: -*,disabled-by-default-lighthouse,v8,v8.execute,blink.user_timing,devtools.timeline,disabled-by-default-devtools.timeline,disabled-by-default-devtools.timeline.stack,disabled-by-default-devtools.timeline.frame,disabled-by-default-devtools.timeline.invalidationTracking,loading,latencyInfo
[2025-01-14 21:55:48] INFO: Testing url https://www.bbc.co.uk iteration 2
[2025-01-14 21:55:57] INFO: Take cumulative layout shift screenshot
[2025-01-14 21:55:57] INFO: Take largest contentful paint screenshot
[2025-01-14 21:55:58] INFO: Configure AXE with {
  "enable": true
}
[2025-01-14 21:55:58] INFO: Run AXE with run options {}
[2025-01-14 21:56:01] INFO: https://www.bbc.co.uk TTFB: 204ms DOMContentLoaded: 262ms firstPaint: 259ms LCP: 342ms Load: 1.83s TBT: 574ms CLS:0.0006
[2025-01-14 21:56:02] INFO: Use Chrome trace categories: -*,disabled-by-default-lighthouse,v8,v8.execute,blink.user_timing,devtools.timeline,disabled-by-default-devtools.timeline,disabled-by-default-devtools.timeline.stack,disabled-by-default-devtools.timeline.frame,disabled-by-default-devtools.timeline.invalidationTracking,loading,latencyInfo
[2025-01-14 21:56:02] INFO: Testing url https://www.bbc.co.uk iteration 3
[2025-01-14 21:56:10] INFO: Take cumulative layout shift screenshot
[2025-01-14 21:56:10] INFO: Take largest contentful paint screenshot
[2025-01-14 21:56:11] INFO: Configure AXE with {
  "enable": true
}
[2025-01-14 21:56:11] INFO: Run AXE with run options {}
[2025-01-14 21:56:14] INFO: https://www.bbc.co.uk TTFB: 92ms DOMContentLoaded: 171ms firstPaint: 172ms LCP: 385ms Load: 1.72s TBT: 566ms CLS:0.0006
[2025-01-14 21:56:14] INFO: https://www.bbc.co.uk 100 requests, TTFB: 140ms (σ46.00ms 31.6%), firstPaint: 227ms (σ36.00ms 16.4%), FCP: 227ms (σ36.00ms 16.4%), DOMContentLoaded: 227ms (σ37.00ms 17.0%), LCP: 342ms (σ32.00ms 9.1%), CLS: 0.0006 (σ0.00 0%), TBT: 574ms (σ6.00ms 1.0%), CPUBenchmark: 21ms (σ0.00ms 0%), Load: 1.83s (σ54.00ms 3.0%) (3 runs)
[2025-01-14 21:56:14] INFO: Fetch hosting information from The Green Web Foundation
[2025-01-14 21:56:14] INFO: Fetch hosting information from The Green Web Foundation
[2025-01-14 21:56:14] INFO: Fetch hosting information from The Green Web Foundation
[2025-01-14 21:56:19] INFO: HTML stored in /sitespeed.io/sitespeed-result/www.bbc.co.uk/2025-01-14-21-55-32

[soulgalore]

Hi @brendan-rice thank you for creating the issue! I've been out sick the last couple of days but will have a look tomorrow. I'm in the middle of preparing for the next major release of sitespeed.io so worst case it will not be fixed until then (probably next week).

The disabled-by-default-lighthouse is a trace category for Chrome internal traces so it actually do not have anything to do with running Lighthouse or not (only what kind of trace events that will be in the trace). I will see happens when I run, in your case it looks like the Lighthouse plugin is running at all, not the GPSI plugin either (that also is enabled by default when you run that Docker container).

[soulgalore]

Hi again, I see you are using version 36, that is not released yet, you can see latest releases on https://www.sitespeed.io/. Try with 35 and I hope that will work.

Also I could see that there are flags you are using that do not exist for example --json-output true . Do you remember if that comes from AI? Best place for configuration is https://www.sitespeed.io/documentation/sitespeed.io/configuration/ or --help. Last months I've seen an increase in people using parameters that do not exist, I guess it comes from ChatGPT.