From 994c9ae5bca8180ba084916eb569aac9cbcc8854 Mon Sep 17 00:00:00 2001 From: David Gauldie Date: Thu, 19 Dec 2024 20:37:37 -0500 Subject: [PATCH] Update compare-models.md --- testing/manual/compare-models.md | 23 +++++++++++++++++------ 1 file changed, 17 insertions(+), 6 deletions(-) diff --git a/testing/manual/compare-models.md b/testing/manual/compare-models.md index bd35121b29..340eec0436 100644 --- a/testing/manual/compare-models.md +++ b/testing/manual/compare-models.md @@ -26,26 +26,35 @@ Report any issues into GitHub: [open an issue](https://github.com/DARPA-ASKEM/te 4. Attach the Bertozzi2020, Fang2020, and Tang2020 models to the "Compare models" operator 5. Open the compare models drilldown 6. Ensure that when the drill-down starts: - - The overview begins to generate - The model graphs are displayed -7. When the overview is generated, it should compare the structure of the AMR models. + - There is a "Concept context comparison" section + - There is a "Tabular context comparison" section + - There is a "Concept graph comparison" section +7. Click on the "Compare" button. When the overview is generated, it should compare the structure of the AMR models. - It should have a title that states it is comparing all 3 models - It should have a summary of the comparison - - It should only compare the structure of the models + - It should have detailed comparisons of the structure of the models + - It should have vague comparisons of the metadata of the models +8. Add a goal of comparison such as "which model is best to simulate covid spread in Canada" and click on the compare button + - The summary should now address the goal and make a recommendation ### 3. Compare models with partial model cards 1. Enrich the Bertozzi2020 and Fang2020 models with their respective documents 2. Re-open the "Compare models" operator 3. Open the drilldown 4. Ensure that when the drill-down starts: - - The overview begins to generate - The model graphs are displayed - Model card information is displayed for Bertozzi2020 and Fang2020 -5. When the overview is generated, it should compare both the structure of the AMR models and the metadata information. + - There is a "Concept context comparison" section + - There is a "Tabular context comparison" section + - There is a "Concept graph comparison" section +6. Clear the goal and click on the "Compare" button. When the overview is generated, it should compare both the structure of the AMR models and the metadata information. - It should have a title that states it is comparing all 3 models - It should have a summary of the comparison - It should compare the structure of ALL the models - It should compare the metadata information for Bertozzi2020 and Fang2020 only +7. Add a goal of comparison and click on the compare button + - The summary should address the goal and make a recommendation ### 4. Compare models all with model cards @@ -56,11 +65,13 @@ Report any issues into GitHub: [open an issue](https://github.com/DARPA-ASKEM/te - The overview begins to generate - The model graphs are displayed - Model card information is displayed for all models -5. When the overview is generated, it should only compare the metadata information from each model and not look at the structure. +5. Clear the goal and click on the "Compare" button. When the overview is generated, it should only compare the metadata information from each model and not look at the structure. - It should have a title that states it is comparing all 3 models - It should have a summary of the comparison - It should compare the structure of ALL the models - It should compare the metadata information for ALL the models +6. Add a goal of comparison and click on the compare button + - The summary should address the goal and make a recommendation ### 5. Working with the Compare models drilldown: NOTEBOOK 1. Switch to the **Notebook** tab.