Merge branch 'main' of github.com:serval-uni-lu/tabularbench

serval-uni-lu · Aug 19, 2024 · 8b341da · 8b341da
2 parents d7663df + e36a1e3
commit 8b341da
Show file tree

Hide file tree

Showing 3 changed files with 6 additions and 3 deletions.
diff --git a/.github/ISSUE_TEMPLATE/attack_submission.yml b/.github/ISSUE_TEMPLATE/attack_submission.yml
@@ -33,7 +33,7 @@ body:
     attributes:
       label: Detailed Description (Optional)
       description: Provide a detailed description of the attack, if available.
-      placeholder: "A more detailed explanation of the dataset."
+      placeholder: "A more detailed explanation of the attack."
 
   - type: textarea
     id: attack_files

diff --git a/.github/ISSUE_TEMPLATE/model_submission.yml b/.github/ISSUE_TEMPLATE/model_submission.yml
@@ -37,9 +37,11 @@ body:
     
     * Robust accuracy:
     
+    * Robust accuracy under adaptive attacks:
+    
     * Additional data: true/false
     
-    * Evaluation method:
+    * Evaluation method: [CAA/Other...]
     
     * Checkpoint and code: (insert here the URL for the checkpoint and the code. If you don't want
     to share your checkpoint publicly, you can share it for a private submission via an email

diff --git a/docs/source/contribute.md b/docs/source/contribute.md
@@ -14,5 +14,6 @@ We welcome attacks contributions that bring additional insights or challenges to
 ## Roadmap
 
 - 0.1.0: Initial release w/ documentation
-- Jan 2025: Distribution of code to train each tabular generator
+- Oct 2024: Distribution of code to train each tabular generator
+- Jan 2025: Updated benchmark with adaptive robustness score. 
 - March 2025: Implementation of additional distances