Skip to content

Add DenseMoELayer and wire it up in Mixtral/Deepseek V2 (#2537) #1216

Add DenseMoELayer and wire it up in Mixtral/Deepseek V2 (#2537)

Add DenseMoELayer and wire it up in Mixtral/Deepseek V2 (#2537) #1216

build (cuda)  /  build-and-push

succeeded Sep 24, 2024 in 8m 35s