Code sample showing Intel® Advanced Matrix Extensions (Intel® AMX) functionality on Intel® Xeon® Scalable processor Max Series and 4th gen Intel® Xeon® Scalable processors.
Intel® AMX now introduces new extensions to the x86 Instruction Set Architecture (ISA) to work on matrices and which may accelerate matrix multiplication in AI workloads. It consists of two components:
- A set of 2-dimensional registers (tiles), which can hold sub-matrices from larger matrices in memory.
- An accelerator called Tile Matrix Multiply (TMUL) which contains instructions that operate on tiles.
This code sample demonstrates testing the new instructions using intrinsic functions.
A code walk-through for this sample can be found at: https://www.intel.com/content/www/us/en/developer/articles/code-sample/advanced-matrix-extensions-intrinsics-functions.html
The code sample will multiply matrices A and B of size 16 x 64 containing INT8 values, and accumulate the result to a 16 x 16 matrix C containing INT32 values.
This code sample is simplified to highlight use of new Intel(R) AMX instructions. It shows use of instructions to configure the tiles, load data from memory into tiles, perform one matrix multiplication on tiles data and copy the result from tiles to memory. It should not be used as a basis for production code. Only for demostration purposes.
This code sample is licensed under MIT license.
Perform the following steps:
-
Build the program.
cd src/ make -
Run the program
./test-amxtile -
Clean the program
make clean