Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monster Scraper Not Working #175

Closed
tdtrumble opened this issue Jan 10, 2025 · 1 comment
Closed

Monster Scraper Not Working #175

tdtrumble opened this issue Jan 10, 2025 · 1 comment
Labels

Comments

@tdtrumble
Copy link

Description

Monster scraper doesn't seem to be working

Steps to Reproduce

  1. Run funnel using MONSTER, no remoteness param set

  2. Get below as result
    [2025-01-10 17:26:18,637] [INFO] JobFunnel: Scraping local providers with: ['MonsterScraperUSAEng']
    [2025-01-10 17:26:18,637] [INFO] MonsterScraperUSAEng: No get() or set() will be done for Job attrs: ['REMOTENESS']
    [2025-01-10 17:26:18,908] [ERROR] JobFunnel: Failed to scrape jobs for MonsterScraperUSAEng: Unable to extract jobs from initial search result page:
    'NoneType' object has no attribute 'text'

  3. Run funnel using MONSTER, with remoteness param set

  4. Get below as result
    [2025-01-10 17:12:23,154] [INFO] JobFunnel: Scraping local providers with: ['MonsterScraperUSAEng']
    [2025-01-10 17:12:23,155] [INFO] MonsterScraperUSAEng: No get() or set() will be done for Job attrs: ['REMOTENESS']
    [2025-01-10 17:12:23,212] [WARNING] MonsterScraperUSAEng: Monster does not support remoteness in query.
    [2025-01-10 17:12:23,374] [ERROR] JobFunnel: Failed to scrape jobs for MonsterScraperUSAEng: Unable to extract jobs from initial search result page:
    'NoneType' object has no attribute 'text'

Expected behavior

funnel scrapes monster

Actual behavior

[ERROR] JobFunnel: Failed to scrape jobs for MonsterScraperUSAEng: Unable to extract jobs from initial search result page:
'NoneType' object has no attribute 'text'

Environment

  • Build: 4.0.0
  • Operating system and version: Windows 11, Python 3.13.1
@tdtrumble tdtrumble added the bug label Jan 10, 2025
@tdtrumble
Copy link
Author

This may be captcha related, will mess with it a bit more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant