From 0dcccaaa690b09733d5cd33dc940b8b12c87b83e Mon Sep 17 00:00:00 2001 From: Tyler Burton Date: Wed, 13 Dec 2023 17:02:48 -0600 Subject: [PATCH] adds new compare doc --- .../mermaid/dest/h20_compare_dcat-1.svg | 1 + .../diagrams/mermaid/dest/h20_compare_dcat.md | 1 + docs/diagrams/mermaid/src/h20_compare_dcat.md | 35 +++++++++++++++++++ 3 files changed, 37 insertions(+) create mode 100644 docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg create mode 100644 docs/diagrams/mermaid/dest/h20_compare_dcat.md create mode 100644 docs/diagrams/mermaid/src/h20_compare_dcat.md diff --git a/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg b/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg new file mode 100644 index 00000000..389193b1 --- /dev/null +++ b/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg @@ -0,0 +1 @@ +
Catalog
Harvest source
1-to-N
1-to-N
ID found; Hash not same
ID not found in Catalog
ID not found in Harvest Source
ID found; Hash same
Faceted Solr Query
create `id: sourch_hash` hashmap
Download Harvest Source
Extract datasets
Hash dataset
compare hashses
Create new dataset
Delete old dataset
Update existing dataset
Pass
 \ No newline at end of file diff --git a/docs/diagrams/mermaid/dest/h20_compare_dcat.md b/docs/diagrams/mermaid/dest/h20_compare_dcat.md new file mode 100644 index 00000000..44318af5 --- /dev/null +++ b/docs/diagrams/mermaid/dest/h20_compare_dcat.md @@ -0,0 +1 @@ +![diagram](./h20_compare_dcat-1.svg) diff --git a/docs/diagrams/mermaid/src/h20_compare_dcat.md b/docs/diagrams/mermaid/src/h20_compare_dcat.md new file mode 100644 index 00000000..0d3557c7 --- /dev/null +++ b/docs/diagrams/mermaid/src/h20_compare_dcat.md @@ -0,0 +1,35 @@ +```mermaid +flowchart TD + +subgraph Harvest source + getHarvest([Download Harvest Source]) + extractHarvest([Extract datasets]) + hashDataset([Hash dataset]) +end + +subgraph Catalog + queryCKAN([Faceted Solr Query]) + extractHash([create `id: sourch_hash` hashmap]) +end + +%% Operations + compareHash{compare hashses} + createDataset([Create new dataset]) + deleteDataset([Delete old dataset]) + updateDataset([Update existing dataset]) + + +%% flow + getHarvest -- 1-to-N --> extractHarvest + extractHarvest --> hashDataset + hashDataset --> compareHash + + queryCKAN -- 1-to-N --> extractHash + extractHash --> compareHash + + + compareHash -- ID found; Hash not same --> updateDataset + compareHash -- ID not found in Catalog --> createDataset + compareHash -- ID not found in Harvest Source --> deleteDataset + compareHash -- ID found; Hash same --> Pass([Pass]) +```