Real-Time Data Streaming with PSoC™ 6 AI Evaluation Kit using new streaming firmware

This topic provides information on how to collect data from various sensors present in the PSoC™ 6 AI Evaluation Kit into DEEPCRAFT™ Studio. You can add additional data to your existing projects or build your own dataset from scratch. You can collect both labeled and unlabeled data, depending on your project requirements.

What type of data can be collected using the PSoC™ 6 AI Evaluation Kit?

After you have flashed the streaming firmware, you can collect various types of data from multiple sensors, including:

• Audio Data: Pulse Density Modulation (PDM) and Pulse Code Modulation (PCM) audio data can be collected from the microphone at sample rates of of 8 kHz or 16 kHz.
• Inertial Measurement Unit (IMU) Data: Data from the 6-axis IMU (accelerometer and gyroscope) can be sampled at frequencies of 50 Hz, 100 Hz, 200 Hz or 400 Hz. This allows for acceleration and gyroscopic angular rate sensing in each spatial direction. The IMU sensor can be configured to collect data from only the accelerometer, only the gyroscope, or both.
• Magnetometer Data: The 3-axis magnetometer provides data at a sample rate of 50 Hz, 100 Hz, 200 Hz or 400 Hz, enabling geomagnetic field direction and strength sensing.
• Barometric Pressure Data: Data from the barometric pressure sensor can be sampled at a frequency of 8 Hz, 16 Hz, 32 Hz, 64 Hz or 128 Hz, capturing changes in atmospheric pressure.
• Radar Data: Radar data can be utilized for various applications, including macro presence detection, micro presence detection, gesture recognition and other use cases.

How to collect and label real-time data from the sensors?

Collecting and labeling data in real-time is straigtforward using Graph UX in DEEPCRAFT™ Studio. Follow these steps to efficiently collect and label your data:

Step 1: Connecting PSoC™ 6 AI Evaluation Kit to PC/laptop

Connect the PSoC™ 6 AI Evaluation Kit to the laptop or PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable. After connecting the kit, navigate to Node Explorer Window> Library> Boards to check if the board is connected properly. The PSoC™ 6 AI Evaluation Kit, along with all the sensors should be displayed under the Boards unit.

Step 2: Creating a Graph UX Project

You can create an Empty Graph UX Project or Live Data Collection Starter Graph UX Project containing an example graph. Refer to How to get started with Graph UX? for instructions on creating the Graph UX project.

If you select Live Data Collection Starter Graph UX project to collect data, set up the input node and start collecting data but if you select Empty Graph UX project to collect data, you need to create the data collection graph. Follow the steps below to create the data collection graph.

Step 3: Creating Data Collection and Data Labeling Graph

For creating a simple version of the data collection graph, you need an input node and an visualization node to visual the data from the input node.

1. Select the Input node to stream data

Input nodes are designed to collect data from various sensors that are present on the kit such as microphone, IMU (accelerometer or gyroscope), magnetometer, pressure sensor and radar sensor that pass on the data to other nodes in the graph. The Input nodes are placed at beginning of the graph. You can collect data using multiple input nodes at a time.

• Microphone node: for streaming audio data
• IMU node: for streaming accelerometer and gyroscope data
• Magnetometer node: for streaming magnetometer data
• Pressure sensor node: for streaming data related to barometric pressure
• Radar Node: for streaming radar data

2: Set-up the Visualization Nodes

The Visualization Nodes help in visualizing the data collected from the Input nodes as tracks in session file.

• Data Track: for visualizing the sensor data collected from Microphone, IMU, DPS, Magnetometer and Radar node.
• Label Track: for visualizing and labeling the collected data.
• Video Track: for visualizing video data collected from the Local Camera node. (Applicable only if you set the Local Camera node to collect video data.)

Depending on the type of data you want to collect and how you plan to collect it, you can create different data collection graphs.

Step 4: Real-time data collection and data Labeling

Refer to the topics below for detailed instructions on setting up the sensors and collecting and labeling real-time data:

• To collect data using the Microphone, connect the Microphone node to the data track. For setting up the microphone node and collecting data using microphone, refer to Collecting and labeling data using Microphone sensor.

• To collect data using the IMU sensor, connect the IMU node to the data track. For setting up IMU node and collecting data using IMU sensor, refer to Collecting and labeling data using IMU sensor.

• To collect data using the Magnetometer sensor, connect the Magnetometer node to the data track. For setting up Magnetometer node and collecting data using Magnetometer sensor, refer to Collecting and labeling data using Magnetometer sensor.

• To collect data using the Barometric pressure sensor, connect the DPS node to the data track. For setting up DPS node and collecting data using Barometric pressure sensor, refer to Collecting and labeling data using Barometric Pressure sensor.

• To collect data using the Radar sensor, connect the Radar node to the data track. For setting up Radar node and collecting data using Radar sensor, refer to Collecting and labeling data using Radar sensor.