Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel jobs seems to misuse tunnels #11

Open
SevenOutman opened this issue May 29, 2021 · 0 comments
Open

Parallel jobs seems to misuse tunnels #11

SevenOutman opened this issue May 29, 2021 · 0 comments

Comments

@SevenOutman
Copy link

SevenOutman commented May 29, 2021

I'm using karma-browserstack-launcher in GitHub Actions to run tests on several browsers.

strategy:
  matrix:
    browser: ['bs_win_ie11', 'bs_win_edge', 'bs_mac_chrome', 'bs_mac_firefox', 'bs_mac_safari']

The YAML is creating 5 parallel jobs, each running tests on corresponding browser. But the jobs' logs shows that the parallel jobs are receiving messages from each other's tunnel.

The bs_win_ie11 job (the first to run):

29 05 2021 11:16:10.261:INFO [karma-server]: Karma v6.3.2 server started at http://localhost:9876/
29 05 2021 11:16:10.264:INFO [launcher]: Launching browsers bs_win_ie11 with concurrency unlimited
29 05 2021 11:16:10.328:INFO [launcher]: Starting browser IE 11.0 (Windows 10) on BrowserStack
29 05 2021 11:16:14.694:INFO [launcher.browserstack]: IE 11.0 (Windows 10) session at https://automate.browserstack.com/builds/f04621633b17d4e093614166b355b0fd76eff56e/sessions/b1cff1ace638252d23c60c66317a879569443321
29 05 2021 11:16:15.600:WARN [web-server]: 404: /bac.jpg
29 05 2021 11:16:15.625:WARN [web-server]: 404: /elva-fairy-480w.jpg
29 05 2021 11:16:16.500:INFO [Chrome 90.0.4430.72 (Mac OS 10.15.7)]: Connected on socket xoWxToYEtv0CKgzMAAAB with id 87431852

The last line seems to indicate that bs_win_ie11 is receiving messages from a Chrome session. And the test output that follows also came from Chrome instead of IE.

The bs_mac_chrome job:

29 05 2021 11:15:38.179:INFO [karma-server]: Karma v6.3.2 server started at http://localhost:9876/
29 05 2021 11:15:38.183:INFO [launcher]: Launching browsers bs_mac_chrome with concurrency unlimited
29 05 2021 11:15:38.246:INFO [launcher]: Starting browser Chrome latest (OS X Big Sur) on BrowserStack
29 05 2021 11:15:42.538:INFO [launcher.browserstack]: Chrome latest (OS X Big Sur) session at https://automate.browserstack.com/builds/f04621633b17d4e093614166b355b0fd76eff56e/sessions/18b1facd3c4004febe69c1f941a1890c02f0f717
29 05 2021 11:20:50.213:WARN [launcher.browserstack]: Chrome latest (OS X Big Sur) has not captured in 300000 ms, killing.

Seems that bs_mac_chrome session is occupied by the bs_win_ie11 job thus the bs_mac_chrome failed due to timeout.

My workaround for now is to run these jobs sequentially to avoid this problem, but it's not a practical solution because it takes too long to finish all sequential jobs.

FYI I'm using a sponsored plan on BrowserStack which have up to 5 parallel running threads.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant