Skip to content

Commit

Permalink
experimenting with matrix formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
benironside committed May 29, 2024
1 parent 1430ae4 commit 6475b16
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions docs/serverless/assistant/llm-performance-matrix.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,11 @@ This table describes the performance of various LLMs for different use-cases in
| Assistant - ((esql)) generation| Great | Great | Poor | Excellent| Poor | Excellent |
| Assistant - Alert questions | Excellent | Excellent | Excellent | Excellent| Poor | Good (limited context) |
| Attack Discovery | Excellent | Great | Poor | Poor | Good | Good (limited context) |

| **Feature** | **Model** | | | | | |
|-------------------------------|-----------------------|--------------------|--------------------|------------|-----------------|----------------|
| | **Claude 3: Opus** | **Claude 3: Sonnet** | **Claude 3: Haiku** | **GPT-4o** | **GPT-4 Turbo** | **GPT-4 32K** |
| **Assistant - General** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent |
| **Assistant - ES\|QL Generation** | Great | Great | Poor | Excellent | Poor | Excellent |
| **Assistant - Alert Questions** | Excellent | Excellent | Excellent | Excellent | Poor | Good (limited context) |
| **Attack Discovery** | Excellent | Great | Poor | Poor | Good | Good (limited context) |

0 comments on commit 6475b16

Please sign in to comment.