Wireless Network-Ready PCB Defect Detection Reference Implementation

Overview

Deploy an industrial AI application for product quality checks using the Intel® Smart Edge Open platform. Includes support for two types of defect detection: missing components and short circuits due to solder bridge formed during the assembly process. 

To run the reference implementation, you will need to first download and install the Intel® Smart Edge Open Developer Experience Kit.

Once you have installed the Intel® Smart Edge Open Developer Experience Kit, select Configure & Download to download the reference implementation and the software listed below.  

Configure & Download

Target System Requirements

Intel® Smart Edge Open Nodes

• One of the following processors
  • Intel® Xeon® scalable processor.
• At least 64 GB RAM
• At least 265 GB hard drive
• An Internet connection
• Ubuntu* 20.04 LTS
• IP camera or pre-recorded video(s)

How It Works

The Printed Circuit Board (PCB) defects detection is a reference implementation enabled for detection of defects in the components assembly in a factory environment. The IP Camera will record the video of the assembled boards moving over a conveyor belt. These IP cameras will stream the video to EII video processing applications namely Video Ingestion, Video Analytics, Time Series analysis, etc. using the RTSP streaming protocol. The captured video is analyzed and filters out selected images for further defect analysis. 

The Intel® Smart Edge Open Developer Experience Kit platform infrastructure is used to deploy the application pods of EII performing image processing functionality. The purpose of this reference implementation is to showcase how the Intel® Smart Edge Open Developer Experience Kit platform can be used for deploying Industrial AI applications for product quality check. There are two types of defect detection supported in this demo: missing component detection and short circuit due to solder bridge formed during the assembly process. 

The video file used in this reference implementation is pcb_d2000.avi which is sent from the camera stream pod as RTSP stream. This PCB defects detection reference implementation includes five types of application pods in the Intel® Smart Edge Open Developer Experience Kit Edge Nodes.

Edge Insights for Industrial from Intel is a set of pre-validated ingredients for integrating video and time-series data analytics on edge compute nodes.

• Etcd 
  The Etcd pod stores the key, value of Video-Ingestion, Video-Analytics, and Visualizer pod access information. It manages the configuration data, state data, and metadata for Kubernetes.
• Camera Stream
  The Camera Stream pod simulates IP cameras in the real environment, it is used to send recorded video pcb_d2000.avi file as an RTSP stream like an IP camera. On LTE/5G Network real-time deployment, replace Camera Stream pod with a real IP camera.
• Video Ingestion
  The Video Ingestion pod is mainly responsible converting the video received from camera stream into frames, it filters the frames and ingests these video frames into the EII stack for further processing and defect analysis.
• Video Analytics
  The Video Analytics pod is mainly responsible for receiving frames from the Video Ingestion pod and performs classifier converting to Universal Disk Format (UDF) and does the required inferencing on the chosen/support hardware (CPU, VPU) using OpenVINO™ toolkit. In this PCB demo, udfs filter configured as pcb. pcb_filter which will detect a defect on the board has any solder short or missing part. Video Analytics identifies the defects and marks the defect on the images.
• Visualizer
  The Visualizer pod mainly displays the frames on GUI display received from Video Analytics pod.

The block diagram provided here shows the video/image flow through the application.

Get Started

Prerequisites

To run the reference implementation, you will need to first download and install the Intel® Smart Edge Open Developer Experience Kit.

Ensure that the following conditions are met properly to ensure a smooth installation process for a reference implementation done through Edge Software Provisioner (ESP) Intel® Smart Edge Open Developer Experience Kit package.

1. Hardware Requirements
   Make sure you have a fresh ESP Intel® Smart Edge Open Developer Experience Kit installation with the Hardware specified in the Target System Requirements section.

2. Install Python dependent libraries 

   pip3 install –-user Cython 
   sudo apt-get install python-dev 
   sudo apt-get install python3-dev

    

3. Confirm the steps below were followed for ESP Intel® Smart Edge Open Developer Experience Kit​ installation:
   1. Proxy Settings
      If you are behind a proxy network, ensure that proxy addresses are configured in the system.  

      export http_proxy=<proxy-address>:<proxy-port>
      export https_proxy=<proxy-address>:<proxy-port> 

      1. Ensure /etc/wgetrc file is configured with required proxy settings as follows: 

         https_proxy=<proxy-address>:<proxy-port> 
         http_proxy=<proxy-address>:<proxy-port> 
         ftp_proxy =<proxy-address>:<proxy-port> 
         use_proxy = on

          

   2. Date and Time 
      Make sure that the date and time are in sync with current local time.  

   3. To generate and install the public key on your host log in as root and execute below commands 

      ssh-keygen 
      ssh-copy-id smartedge-open@<smartedge-open-node-ip-address> 

       

   4. Create NON-Root User 

      1) To create a user smartedge-open execute the command:  

      $ useradd -s /bin/bash -d /home/smartedge-open/ -m -G sudo smartedge-open  
      $ passwd smartedge-open

       2) Change password for user smartedge-open: 

      New password: \< have to provide password as “smartedge-open” \> 
      Retype new password: \< have to provide password as “smartedge-open” \>
      passwd: all authentication tokens updated successfully

       3) A password for the given user is required: passwd “smartedge-open”  

      4) As some tasks require root privileges, the non-root user needs to have a possibility to become a root: 

      $echo “smartedge-open ALL=(ALL) NOPASSWD:ALL” | sudo tee /etc/sudoers.d/smartedge-open

       

   5. Generate and install the public key on your host by logging in as root and executing below commands: 

      ssh-keygen 
      ssh-copy-id smartedge-open@<host-name>

       

Install the Reference Implementation

Select Configure & Download to download the reference implementation and then follow the steps below to install it.  

Configure & Download

1. Make sure that the Target System Requirements are met properly before proceeding further.  
   • For single-device mode, only one machine is needed. (Both controller and edge node will be on the same device.) 
   • For multi-device mode, make sure you have at least two machines (one for controller and other for Edge Node).
     NOTE: Multi-device mode is not supported in the current release. 
2. Open a new terminal as a root user. 

3. Confirm server should be configured with ESP Intel® Smart Edge Open Developer Experience Kit as prerequisite. 

4. Move the downloaded zip package to /home/<non-root-user> folder. 

   mv <path-of-downloaded-directory>/wireless-network-ready-pcb-defect-detection.zip /home/<non-root-user>

    

5. Go to the /root directory using the following command and unzip the RI: 

   cd /home/<non-root-user> 
   unzip wireless-network-ready-pcb-defect-detection.zip 

6. Go to wireless-network-ready-pcb-defect-detection/ directory: 

   cd wireless-network-ready-pcb-defect-detection

7. Change permission of the executable edgesoftware file: 

   chmod 755 edgesoftware 

8. Run the command below to install the Reference Implementation: 

   ./edgesoftware install 

    

9. During the installation, you will be prompted for the Product Key. The Product Key is contained in the email you received from Intel confirming your download.  
   NOTE: Installation logs are available at: /var/log/esb-cli/Wireless_NetworkReady_PCB_defect_detection_/Wireless_NetworkReady_PCB_defect_detection/install.log  

   

10. When the installation is complete, you see the message Installation of package complete and the installation status for each module.  

11. If Intel® Smart Edge Open Developer Experience Kit is installed, running the following command should show output similar to the image below. All the pods should be either in the running or completed stage. 

kubectl get pods -A

Note: The status of the Visualizer pod might be CrashLoopBackOff. This is an expected behavior and can be ignored. 

12. If PCB Defect Detection is installed, running the following command should show output as follows: 

    smartedge-open@:/$ kubectl get pods -n smartedge-apps 
    NAME                                                  READY   STATUS    RESTARTS   AGE 
    deployment-etcd-ui-b594fbdb7-ftfk8            1/1     Running      0          51m 
    deployment-video-analytics-86c68fbb5b-mbrgz   1/1     Running      0          51m 
    deployment-video-ingestion-5c7ff7c559-cpwfx   1/1     Running      0          51m 
    deployment-webvisualizer-676d9cb487-28mss     1/1     Running      0          51m 
    ia-etcd-54cdfd9d95-trknn                      2/2     Running      0          51m

    

     

13. Run the below command to make sure the network policy is created:

Note: In Intel® Smart Edge Open, the default network policy blocks ingress traffic to all pods, hence the pcb defect detection pod network policy is created to allow the ingress traffic. 

smartedge-open@:/$ kubectl get networkpolicies -n smartedge-apps 
NAME                POD-SELECTOR          AGE 
allow-pcb-ingress   app=webvisualizer     78m

14. Run the command below to check the Docker* images and their details. 

    smartedge-open@:/$ docker images | grep ia_ 
    openedgeinsights/ia_video_ingestion      2.6           7e07ff0b3451   6 weeks ago     2.86GB 
    openedgeinsights/ia_web_visualizer       2.6           5bbe38bd3e84   6 weeks ago     2.21GB 
    openedgeinsights/ia_video_analytics      2.6           ffe3b44354e1   6 weeks ago     2.82GB 
    openedgeinsights/ia_etcd_ui              2.6           cd272efd64dc   6 weeks ago     545MB 
    openedgeinsights/ia_etcd_provision       2.6           2683c27dd3c6   2 months ago    197MB 
    openedgeinsights/ia_etcd                 2.6           2e8ec01a3d93   2 months ago    119MB

     

15. List the reference implementation deployed module using the following command: 

    ./edgesoftware list

    

     

16. Uninstall the reference implementation module using the following command: 

    ./edgesoftware uninstall <pcb-module-id>

    

     

17. Run the command below to make sure the network policy is deleted after uninstallation: 

    smartedge-open@:/$ kubectl get networkpolicies. 
    NAME                     POD-SELECTOR             AGEs 
    block-all-ingress        <none>                   3d18h

     

Visualize the Output

To visualize the results, open Google* Chrome and navigate to Web Visualizer and EtcdUI on the following ports: 

WebVisualizer: 
http://<smartedge-open-node-ip-address>:30009 

To access the visualizer, log in with the username = admin and password = admin@123

PCB Defects Detection Results

You can view reference input and output videos of the PCB defect detection demo in GitHub. 

Refer to the PCB defects detection results section to cross-verify the results on your setup. 
 

Summary and Next Steps

The PCB demo sample application when deployed on Intel® Smart Edge Open Developer Experience Kit creates an impactful edge computing use case that utilizes the capability of Intel® Smart Edge Open Developer Experience Kit and Edge Insights for Industrial (EII). 

Learn More

To continue learning, see the following guides and software resources:

• Intel® Smart Edge Open Architecture
• Intel® Edge Insights for Industrial

Troubleshooting

Pods Status Check

Verify that the pods are Ready as well as in Running state using the following command:

kubectl get pods -A

If they are in ImagePullBackOff state, manually pull the images using:

docker login
docker pull <image-name>

If any pods are not in Running state, use the following command:

kubectl describe -n <namespace> pod <pod_name>

Installation Failure

If the Intel® Smart Edge Open Developer Experience Kit installation has failed on pulling the namespace pods like Grafana, Telemetry, TAS, etc., reboot the system. After rebooting, execute the following command:

reboot
su 
swapoff -a 
systemctl restart kubelet (Wait till all pods are in “Running” state.)
./edgesoftware install

Pod Status shows "ContainerCreating" for a long time

If pod status shows ContainerCreating or Error or CrashLoopBackOff for 5 minutes or more, run the following commands:

reboot
su 
swapoff -a 
systemctl restart kubelet (Wait till all pods are in “Running” state.)
./edgesoftware install 

Uninstallation Failure   

If uninstall command (./edgesoftware uninstall < module id >) fails, manually uninstall PCB Defect Detection deployment and network policy, which are specific to pcb defect detection pod: 

helm uninstall pods -n smartedge-apps   
kubectl delete networkpolicy allow-pcb-ingress

Installation and Debug Log Info File Path 

Installation log info of Intel® Smart Edge Open Developer Experience Kit will be available at:  

/var/log/esb-cli/Smart_Edge_Open_Developer_Experience_Kits_1.0.0/Smart_Edge_Open_Developer_Experience_Kits/install.log 

Installation log info of Wireless Network Ready PCB Defect Detection module will be available at: 

/var/log/esb-cli/Wireless_NetworkReady_PCB_defect_detection_3.0.0/Wireless_Network_Ready_PCB_defect_detection/install.log

Support Forum 

If you're unable to resolve your issues, contact the Support Forum.  

Execute the command below to consolidate a list of the log files in tar.gz compressed format, e.g., Wireless_NetworkReady_PCB_defect_detection.tar.gz.  

tar -czvf Wireless_NetworkReady_PCB_defect_detection.tar.gz /var/log/esb-cli/Wireless_NetworkReady_PCB_defect_detection_3.0.0/Wireless_NetworkReady_PCB_defect_detection/ /var/log/esb-cli/Smart_Edge_Open_Developer_Experience_Kits_1.0.0/Smart_Edge_Open_Developer_Experience_Kits/