Infineon PSoC™ 6 Artificial Intelligence Evaluation Kit

The PSoC™ 6 AI Evaluation Kit is a hardware platform focused on Machine Learning (ML), that allows you to evaluate Imagimob Studio, Ready Models (opens in a new tab), pre-trained models from the Starter projects, and other software products. This kit features a PSoC™ 6 MCU, a CYW43439 Wi-Fi/Bluetooth® combo module, a 512-Mb NOR flash, an onboard programmer/debugger (KitProg3), PDM-PCM digital microphone interface, Full-Speed USB device, two user LEDs, and one user button. The board supports operating voltages from 1.8 V to 3.3 V for the PSoC™ 6 MCU. The kit provides various sensors such as 6-axis motion sensor (BMI270), magnetometer (BMM350), barometric pressure sensor (DPS368), and RADAR sensor (BGT60TR13C) for data collection and creating the machine learning models. For more information, refer to CY8CKIT-062S2-AI (opens in a new tab).

Kit contents

The kit includes the following:

• PSoC™ 6 AI Evaluation Board (CY8CKIT-062S2-AI)
  
• Inlay card (a printed QR code points to a getting started webpage)

Requirements

Following softwares are required for getting started:

• ModusToolbox™ Software (opens in a new tab) version 3.1 or later (for developing PSoC™ 6 MCU based applications)
• Imagimob Studio (for developing machine learning models)
• UART terminal software such as Tera Term or Minicom

Out-of-box application

The kit is pre-programmed with mtb-example-imagimob-streaming-protocol (opens in a new tab) code example, that demonstrates sensor data collection from the USB port into Imagimob Studio for labeling and machine learning model creation. It is designed to collect data from the motion sensor (BMX160 or BMI160 or BMI270) at 50 Hz sample rate, magnetometer sensor (BMM350) at 50 Hz sample rate, pressure sensor (DPS368) at 50 Hz sample rate, radar sensor (BGT60TR13C) at 100000 Hz sample rate, and PDM/PCM audio data at 16 kHz. Implementation details are available in README (opens in a new tab).

Testing OOB application with Imagimob Studio

Creating project in Imagimob Studio

1. Open Imagimob Studio and select File> New Project. The New Project window appears.

   
   
   

2. Under Graph UX > Generic, select Empty Project.

3. In New Project Name, enter the name of the project.

4. In Location, specify the location where you want to create the workspace and the project directory.

5. Click OK to create the project. The project directory is downloaded to the workspace in Studio.

   
   

Connecting and setting up Serial Capture and Predefined Labels units

Imagimob Studio provides the functionality to collect and label the real-time data simultaneously. Let’s set up the Serial Capture unit for collecting data and Predefined unit for labeling data on the canvas.

Setting up the Serial Capture

1. Connect the board to the laptop or PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable.

2. Expand EmptyProject directory and double-click the Main.imunit to open the canvas.

3. Expand Library > Devices and drag and drop the Serial Capture unit onto the canvas.

4. Expand Visualization and drag and drop the Data Track unit onto the canvas.

5. Goto Serial Capture > Properties and select USB Serial Device port. To check the COM port at which the board is connected, open Device Manager > Ports and look for USB Serial Device.

6. Click on the red icon in the Serial Capture node and drag over to the gray icon in the Data Track node. This creates a connection between the two nodes.

   
   
   

After setting up the Serial Capture, you can utilize the same graph to label the real-time data, by adding a Predefined Labels unit onto the canvas. Define the classes in the Predefined Labels node for one time and utilize the defined classes to label the data on a click of button.

Setting up the Predefined Labels

1. Expand Project and drag and drop the Predefined Labels unit onto the canvas. The Predefined Labels unit displays the default classes.

2. Define the classes in Predefined Labels node by entering every class in a new line.

   
   

   After defining the classes, start collecting and labeling data simultaneously.

Real-time data collection and data labeling

1. Navigate to the toolbar and click the Start button to open the session file (main.imsession). An empty session file opens displaying the pre-defined classes in the Labels bar.

2. Click the Record button to start capturing the real-time data.

   
   
   

3. In the Labels bar, select a class to start adding labels to the streaming data.

4. Deselect the same class to stop adding the labels. Similarly, you can enable or disable the other classes and label the data.

5. Click the Record button to stop collecting the data.

6. Select File > Save to save the session file, data track and label track. The Save New Session window appears.

   
   
   

7. In Location, click the three dot and select the desired location to save the files.

8. In Session Name, enter the name of the session file.

9. Under Track Options, set the following:

   • In Wave Format Encoding, select the encoding format for the audio tracks
   • In Track Name, double-click the column to edit the track name, if required
   • In File Name, double-click the columns to edit the track name, if required

10. Select the save checkbox corresponding to the tracks you want to save.

11. Click OK to save the files.

12. Repeat the instructions from step 2 to collect and save data in multiple session files.

    After collecting the data, add data to the required classification project and start with the machine learning workflow in Studio. Refer to Create Classification project and Add data to project to know more.

Testing OOB application with serial terminal

1. Connect the board to the PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable. This enables a serial port for sensor data collection.

2. Ensure that the power LED (D1) turns ON, indicating the board is powered.

3. In the terminal application, open the serial connection to the device. It should present itself as USB serial device. Connect to this port with the following settings:

   • Baud rate: 115200
   • Data: 8 bit
   • Parity: None
   • Stop bit: 1 bit
   • Flow control: None
   
   
   

4. Set the terminal settings as follows:

   • Newlines should be transmitted as CR+LF
   • Enable local echo
   
   
   

5. Type config? and press Enter key (to send CR+LF) and verify that the device responds with a JSON structure describing the protocol configuration.

   
   
   

6. Type subscribe,1,16000 and verify that the device streams audio data. Notice that sample collection stops after 5 seconds. The garbled text on the terminal is the audio data.

7. Type subscribe,2,50 and verify that the device streams IMU data. Notice that sample collection stops after 5 seconds. The garbled text on the terminal is the IMU data.