Skip to content

Commit

Permalink
- Testing all scrapes. PaulMcInnis#126
Browse files Browse the repository at this point in the history
- TODO:Prepare for PR
- TODO:Update testing branch to "master" branch on workflow file
- TODO: Add the old workflow file to publish python package
  • Loading branch information
thebigG committed Dec 4, 2020
1 parent 046321b commit 1fd807b
Showing 1 changed file with 19 additions and 0 deletions.
19 changes: 19 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ jobs:
- name: Install JobFunnel
run: |
pip install -e .
python -m nltk.downloader stopwords
- name: Lint with flake8
run: |
# stop the build if there are Python syntax errors or undefined names
Expand All @@ -36,3 +37,21 @@ jobs:
- name: Run CANADA_ENGLISH demo by settings YAML
run: |
funnel load -s demo/settings.yaml -log-level DEBUG
- name: Run an american search by CLI
run: |
funnel inline -kw Python Data Scientist PHD AI -ps WA -c Seattle -l USA_ENGLISH -log-level DEBUG -csv demo_job_search_results/demo_search.csv -cache demo_job_search_results/cache2 -blf demo_job_search_results/demo_block_list.json -dl demo_job_search_results/demo_duplicates_list.json -log-file demo_job_search_results/log.log
- name: Run a Remote jobs only scrape
run: |
funnel inline -kw Python -ps ON -c Toronto -l CANADA_ENGLISH -remoteness FULLY_REMOTE -p INDEED -log-level DEBUG -csv demo_job_search_results/demo_remote_search.csv -cache demo_job_search_results/cache3 -blf demo_job_search_results/demo_block_list.json -dl demo_job_search_results/demo_duplicates_list.json -log-file demo_job_search_results/log.log
- name: Run a FRANCE_FRENCH demo by settings YAML
run: |
funnel load -s demo/settings_FR.yaml -log-level DEBUG
- name: Obtain coverage
run: |
pytest --cov=jobfunnel --cov-report=xml
- name: Codecov
run: |
bash <(curl -s https://codecov.io/bash)
# TODO: modify some job statuses and run with --no-scrape...
# - './tests/verify_time.sh' TODO: some way of verifying execution time
# - './demo/gen_call_graphs.sh' TODO: some way of showing .dot on GitHub?

0 comments on commit 1fd807b

Please sign in to comment.