Skip to content

Commit

Permalink
Further test petscams.com source
Browse files Browse the repository at this point in the history
  • Loading branch information
jarelllama authored Dec 25, 2024
1 parent 91e8310 commit f3446d4
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions scripts/retrieve_domains.sh
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,6 @@ readonly -a SOURCES=(

source_petscams

source_puppyscams

)

# Function 'source' calls on the respective functions of each source to
Expand Down Expand Up @@ -735,7 +733,7 @@ source_petscams() {
local url='https://petscams.com'
# First page must not have '/page'
curl -sS --retry 2 --retry-all-errors "${url}/" >> results.tmp
curl -sSZ --retry 2 --retry-all-errors "${url}/page/[2-15]/" >> results.tmp
curl -sSZ --retry 2 --retry-all-errors "${url}/page/[2-3]/" >> results.tmp

# Notes:
# Each page should return 10 domains but the regex also matches domains
Expand Down

0 comments on commit f3446d4

Please sign in to comment.