New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create csv to track missing sources #556

Open

2 tasks done

CarsonDavis opened this issue Jan 5, 2024 · 0 comments

Assignees

Labels

PI 24.1

Collaborator

CarsonDavis commented Jan 5, 2024 •

edited

Loading

Description

PDS_NASA_Science_Solar_System_Exploration_Website

new 0
original 72133
- delta: 72133

Helio_Events_Knowledgebase_Website

Raw Counts
- total unique: 80,519
- new 13,390
- original 67,131
Deltas
- missing from new: 67,128
- missing from original: 13,389

PDS_PDS_Small_Bodies_Node_Asteroid_Dust_Subnode_Website

new 61
original 84693
- delta: 84632

PDS_Mars_Exploration_Program_Website

new 9650
original 80566
- delta: 70916

Deliverable

url tracking spreadsheet

Key Questions

are there urls in original but not new that we want?
are there urls in new but not original that we want?

Future Actions

solar system
- new curation needed, with a new connector
- delete the old connector
helio
- update connector to scrape the non-data urls
- backlog ticket to make an api connector for the events and sequences
small bodies
- Emily needs to take a look at 'small bodies' and 'mars' to help figure out the delta
mars
- Emily needs to take a look at 'small bodies' and 'mars' to help figure out the delta

Tasks

Beta Give feedback

Missing Urls Analysis - Helio_Events_Knowledgebase_Website sde-indexing-helper#557
https://github.com/NASA-IMPACT/sde-backend/issues/313
Options

CarsonDavis self-assigned this

code-geek added the PI 24.1 label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment