Skip to content

Ribeiro-Tiago/scraper

Repository files navigation

Scraper

This is a web scraper for whatever I might need. Currently on google's cloud functions. Stores the date of the last post checked on DB to see when a new post has appeared Runs at midnight and if there's any new post will send an email with the information.

Before deployment

Because firebase likes to get money sneakily, when new versions of an existing function are pushed there's stuff created in storage. So before updating / pushing functions, go to https://console.cloud.google.com/storage/browser and delete all buckets there

Deplyoment

  • Only certain function -> firebase deploy --only "functions:<function name>" --token "$FIREBASE_TOKEN"
  • All functions -> firebase deploy --only functions --token "$FIREBASE_TOKEN"

About

A scraper for whatever I might need

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published