Solution Performance

Cloudwalk is one of Top 3 computer vision technology companies in China, providing solutions and services for the public security and finance sectors. Cloudwalk facial recognition application is used for customer recognition in banking, security, transportation, remote ID recognition and so on. Cloudwalk uses customized Resnet50 for online facial recognition.

Visit Cloudwalk.cn ›

Challenges

Deploying facial recognition solutions in bank, security government or police station faces two bottlenecks: network bandwidth and computing capabilities, that negatively impact deep learning inference throughput and latency, thereby resulting in less than optimal user experiences.

Solution

For facial recognition, a customized Resnet50 (FP32 and INT8) model was optimized on Intel Caffe.  Compared to FP32, Intel® DL Boost (delivered by Vector Neural Network Instructions (VNNI)/INT8) optimizations helped achieve a speedup of 3.3X in inference latency, for the same batch size and same instance (see chart)123.  The application also meets Cloudwalk’s desired accuracy requirement (of accuracy loss being less than 0.03%).

Value

Significantly reduced deep learning inference latency, delivering better user experience – Cloudwalk customers will benefit from improved performance (i.e., lower latency), while maintaining SLAs for accuracy loss.

Product and Performance Information

1

Performance results are based on testing by Intel and Cloudwalk on 12/18/18 and may not reflect all publicly available security updates. No product or component can be absolutely secure.

2

Cloudwalk Facial Recognition* (self-defined workload); OS: CentOS* 7.5 Kernel 3.10.0-957.1.3.el7.x86_64. Testing by Intel and Cloudwalk completed on Dec 18, 2018. Security Mitigations for Variants 1, 2, 3 and L1TF in place. 

TEST SYSTEM CONFIG: 2nd Gen Intel® Xeon® Platinum processor 8260L, 2.3 GHz, 24 cores, turbo and HT on, BIOS 1.0180, 192GB total memory, 12 slots / 16GB / 2666 MT/s / DDR4 LRDIMM, 1 x 480GB / Intel® SSD Data Center (Intel® SSD DC) S4500 + 1 x 1TB / Intel® SSD DC P4500; Intel® Optimization for Caffe*.

3

Software and workloads used in performance tests may have been optimized for performance only on Intel® microprocessors. Performance tests, such as SYSmark* and MobileMark*, are measured using specific computer systems, components, software, operations, and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more information go to www.intel.com/benchmarks.