Solution Performance

Neusoft is one of the largest software solution & service providers in China. CareVault is a Smart Medical Cloud Platform, providing AI tools to assist medical and scientific research. One of the major applications of CareVault is Down's Syndrome medical image classification. The application is based on Intel® Optimization for Caffe* and customized Alexnet to predict Down's Syndrome, and the medical image inference processing runs offline.

Visit Neusoft.com ›

Challenges

Image recognition and classification applications are often compute-bound. This negatively impacts deep learning inference throughput, thereby resulting in less than optimal user experiences.

Solution

For medical imaging, a customized Alexnet model was optimized on Intel® Optimization for Caffe*. Compared to FP32, Intel® Deep Learning Boost (Intel DL Boost) (delivered by Vector Neural Network Instructions (VNNI)/INT8) optimizations helped increase deep learning inference throughput by 2.02X (see chart)1 2 3, while meeting Neusoft’s accuracy requirements.

Value

Significantly improved deep learning inference throughput, while meeting accuracy requirements, thus delivering better user experience.

Product and Performance Information

1

Performance results are based on testing by Intel and Neusoft on 12/20/18 and may not reflect all publicly available security updates. No product or component can be absolutely secure.

2

Neusoft Medical Image Classification* (self-defined workload); OS: Red Hat Enterprise Linux* 7.5 Kernel 4.19.3-1.el7.elrepo.x86_64. Testing by Intel and Neusoft completed on Dec 20, 2018. Security Mitigations for Variants 1, 2, 3 and L1TF in place.

TEST SYSTEM CONFIG: 2nd Gen Intel® Xeon® Platinum processor 8260L, 2.3 GHz, 24 cores, turbo, and HT on, BIOS 1.0180, 768GB total memory, 12 slots / 64GB / 2666 MT/s / DDR4 LRDIMM, 1 x 480GB / Intel® SSD Data Center (Intel® SSD DC) S4500; Intel® Optimization for Caffe*.

3

Software and workloads used in performance tests may have been optimized for performance only on Intel® microprocessors. Performance tests, such as SYSmark* and MobileMark*, are measured using specific computer systems, components, software, operations, and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more information go to www.intel.com/benchmarks.