Skip to content

Commit

Permalink
chore: clone ieee-rawbib and run fetcher
Browse files Browse the repository at this point in the history
  • Loading branch information
stefanomunarini committed Oct 8, 2023
1 parent 1e347a6 commit 34e30b7
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 4 deletions.
7 changes: 6 additions & 1 deletion .github/workflows/crawler.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,16 @@ on:
- cron: '0 14 * * *'
workflow_dispatch:

env:
token: "test"

jobs:
crawl:
uses: relaton/support/.github/workflows/crawler.yml@master
with:
override-files: |
https://raw.githubusercontent.com/ietf-tools/bibxml-service/main/Gemfile=Gemfile
https://raw.githubusercontent.com/ietf-tools/bibxml-service/main/Gemfile=Gemfileg
args: ${{ github.event.inputs.args }}
commit-indexes: false
secrets: inherit

10 changes: 7 additions & 3 deletions crawler.rb
Original file line number Diff line number Diff line change
@@ -1,14 +1,18 @@
# frozen_string_literal: true

require "fileutils"
require "relaton_ieee"

t1 = Time.now
puts "Started at: #{t1}"

system("git clone https://github.com/ietf-tools/relaton-data-ieee")
token = ENV["token"]
puts token

system("git clone https://oauth2:#{token}@github.com/ietf-ribose/ieee-rawbib.git ieee-rawbib")
FileUtils.rm_rf("data")
FileUtils.cp_r("relaton-data-ieee/data", ".")
FileUtils.rm_rf("relaton-data-ieee")
RelatonIeee::DataFetcher.fetch
FileUtils.rm_rf("ieee-rawbib")

t2 = Time.now
puts "Stopped at: #{t2}"
Expand Down

0 comments on commit 34e30b7

Please sign in to comment.