Steps to Validate Intel® AMX Performance in 4th Generation Intel® Xeon® Scalable Processors

• Using the 4th Generation Intel® Xeon® Scalable processors from Intel® Developer Cloud.
• Compare quantized (int8) performance against Ice Lake from AWS.
• The performance expected from SPR should be two times better, but it’s only around 30% better.
• Need ways to verify if AMX is enabled.

Refer to this article with code examples that shows how to use the new Intel® Advanced Matrix Extensions (Intel® AMX) on both Intel® Xeon® Scalable processor Max Series and 4th Gen Intel® Xeon® Scalable Processors.

Code Sample: Intel® Advanced Matrix Extensions (Intel® AMX) - Intrinsics Functions