Skip to content

Commit

Permalink
Fix typo in dot product attention error message (#567)
Browse files Browse the repository at this point in the history
  • Loading branch information
johannes-fischer authored Feb 23, 2024
1 parent 9c31d9d commit 050b835
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/attention.jl
Original file line number Diff line number Diff line change
Expand Up @@ -56,8 +56,8 @@ function dot_product_attention(q::AA3, k::AA3, v::AA3, bias=nothing;
First dimension in query, key and value must be divisible by `nheads`.
Instead:
- size(q): $(size(q))
- size(k): $(size(q))
- size(v): $(size(q))
- size(k): $(size(k))
- size(v): $(size(v))
- nheads: $nheads
"""))
(size(q, 3) == size(k, 3) == size(v, 3)) || throw(ArgumentError("""
Expand Down

0 comments on commit 050b835

Please sign in to comment.