Skip to content

Commit

Permalink
Update compare-models.md
Browse files Browse the repository at this point in the history
  • Loading branch information
dgauldie authored Dec 20, 2024
1 parent f7ef3a4 commit 994c9ae
Showing 1 changed file with 17 additions and 6 deletions.
23 changes: 17 additions & 6 deletions testing/manual/compare-models.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,26 +26,35 @@ Report any issues into GitHub: [open an issue](https://github.com/DARPA-ASKEM/te
4. Attach the Bertozzi2020, Fang2020, and Tang2020 models to the "Compare models" operator
5. Open the compare models drilldown
6. Ensure that when the drill-down starts:
- The overview begins to generate
- The model graphs are displayed
7. When the overview is generated, it should compare the structure of the AMR models.
- There is a "Concept context comparison" section
- There is a "Tabular context comparison" section
- There is a "Concept graph comparison" section
7. Click on the "Compare" button. When the overview is generated, it should compare the structure of the AMR models.
- It should have a title that states it is comparing all 3 models
- It should have a summary of the comparison
- It should only compare the structure of the models
- It should have detailed comparisons of the structure of the models
- It should have vague comparisons of the metadata of the models
8. Add a goal of comparison such as "which model is best to simulate covid spread in Canada" and click on the compare button
- The summary should now address the goal and make a recommendation
### 3. Compare models with partial model cards
1. Enrich the Bertozzi2020 and Fang2020 models with their respective documents
2. Re-open the "Compare models" operator
3. Open the drilldown
4. Ensure that when the drill-down starts:
- The overview begins to generate
- The model graphs are displayed
- Model card information is displayed for Bertozzi2020 and Fang2020
5. When the overview is generated, it should compare both the structure of the AMR models and the metadata information.
- There is a "Concept context comparison" section
- There is a "Tabular context comparison" section
- There is a "Concept graph comparison" section
6. Clear the goal and click on the "Compare" button. When the overview is generated, it should compare both the structure of the AMR models and the metadata information.
- It should have a title that states it is comparing all 3 models
- It should have a summary of the comparison
- It should compare the structure of ALL the models
- It should compare the metadata information for Bertozzi2020 and Fang2020 only
7. Add a goal of comparison and click on the compare button
- The summary should address the goal and make a recommendation
### 4. Compare models all with model cards
Expand All @@ -56,11 +65,13 @@ Report any issues into GitHub: [open an issue](https://github.com/DARPA-ASKEM/te
- The overview begins to generate
- The model graphs are displayed
- Model card information is displayed for all models
5. When the overview is generated, it should only compare the metadata information from each model and not look at the structure.
5. Clear the goal and click on the "Compare" button. When the overview is generated, it should only compare the metadata information from each model and not look at the structure.
- It should have a title that states it is comparing all 3 models
- It should have a summary of the comparison
- It should compare the structure of ALL the models
- It should compare the metadata information for ALL the models
6. Add a goal of comparison and click on the compare button
- The summary should address the goal and make a recommendation
### 5. Working with the Compare models drilldown: NOTEBOOK
1. Switch to the **Notebook** tab.
Expand Down

0 comments on commit 994c9ae

Please sign in to comment.