diff --git a/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg b/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg new file mode 100644 index 00000000..389193b1 --- /dev/null +++ b/docs/diagrams/mermaid/dest/h20_compare_dcat-1.svg @@ -0,0 +1 @@ +
Catalog
Harvest source
1-to-N
1-to-N
ID found; Hash not same
ID not found in Catalog
ID not found in Harvest Source
ID found; Hash same
Faceted Solr Query
create `id: sourch_hash` hashmap
Download Harvest Source
Extract datasets
Hash dataset
compare hashses
Create new dataset
Delete old dataset
Update existing dataset
Pass
\ No newline at end of file diff --git a/docs/diagrams/mermaid/dest/h20_compare_dcat.md b/docs/diagrams/mermaid/dest/h20_compare_dcat.md new file mode 100644 index 00000000..44318af5 --- /dev/null +++ b/docs/diagrams/mermaid/dest/h20_compare_dcat.md @@ -0,0 +1 @@ +![diagram](./h20_compare_dcat-1.svg) diff --git a/docs/diagrams/mermaid/src/h20_compare_dcat.md b/docs/diagrams/mermaid/src/h20_compare_dcat.md new file mode 100644 index 00000000..0d3557c7 --- /dev/null +++ b/docs/diagrams/mermaid/src/h20_compare_dcat.md @@ -0,0 +1,35 @@ +```mermaid +flowchart TD + +subgraph Harvest source + getHarvest([Download Harvest Source]) + extractHarvest([Extract datasets]) + hashDataset([Hash dataset]) +end + +subgraph Catalog + queryCKAN([Faceted Solr Query]) + extractHash([create `id: sourch_hash` hashmap]) +end + +%% Operations + compareHash{compare hashses} + createDataset([Create new dataset]) + deleteDataset([Delete old dataset]) + updateDataset([Update existing dataset]) + + +%% flow + getHarvest -- 1-to-N --> extractHarvest + extractHarvest --> hashDataset + hashDataset --> compareHash + + queryCKAN -- 1-to-N --> extractHash + extractHash --> compareHash + + + compareHash -- ID found; Hash not same --> updateDataset + compareHash -- ID not found in Catalog --> createDataset + compareHash -- ID not found in Harvest Source --> deleteDataset + compareHash -- ID found; Hash same --> Pass([Pass]) +```