| description |
|---|
Getting Started with machine learning on the Renesas CK-RA6M5 Cloud Kit and Edge Impulse. |
Created By: Swapnil Verma
Public Project Link: https://studio.edgeimpulse.com/public/233106/latest
The Renesas CK-RA6M5 Cloud Kit enables users to securely connect to the cloud and explore the features of the Cortex M33-based Renesas RA6M5 group of MCUs and cloud services. This development board can run machine-learning models and is officially supported by Edge Impulse.
This is a Getting Started Guide for the Renesas CK-RA6M5 board with Edge Impulse. Here we will connect the board to the Edge Impulse Studio, collect sensor data directly from the board, prepare a machine learning model using the collected data, deploy the model back to the board, and perform inferencing locally on the board. Let's get started!
The Cloud Kit comes with the following items in the box:
- The CK-RA6M5 development board
- RYZ014A PMOD (CAT-M1 Cellular Module)
- SIM card
- Antenna
- 2 Micro USB to A cables
- Micro USB A/B to A adapter cable
- Documentation
Each CK-RA6M5 board comes preinstalled with a quick-start project. Let's run that quick-start project to verify our board is working properly.
- Make sure that (a) J22 is set to link pins 2-3 (b) J21 link is closed and (c) J16 link is open.
- Connect J14 and J20 on the CK-RA6M5 board to USB ports on the host PC using the 2 micro USB cables supplied.
- The power LED (LED6) on the CK-RA6M5 board lights up white, indicating that the CK-RA6M5 board is powered on.
Immediately after the power on, the four user LEDs will take on the following states:
- LED1 Red – Off
- LED2 RGB – Off
- LED3 Green – Steady, full intensity
- LED4 Blue – Blinking at 1hz frequency
Press the user button (S2) on the board to change the blinking frequency of the user LED4 (blue). With every press of the first user button (S2), the frequency will switch from 1 Hz to 5 Hz to 10 Hz and cycle back.
In order to connect the CK-RA6M5 board to the Edge Impulse Studio, we need to upgrade the board's firmware. Please follow the official Edge Impulse guide to update its firmware:
Firmware Update Guide - https://docs.edgeimpulse.com/docs/development-platforms/officially-supported-mcu-targets/renesas-ck-ra6m5
Once the board is flashed with Edge Impulse firmware, the real magic starts.
To begin, you'll need to create an Edge Impulse account and a project in the Edge Impulse Studio. Please follow the below steps to do so:
- Navigate to the Edge Impulse Studio and create an account. If you already have an account then please login using your credentials.
- After login, please create a new project, give it a suitable name, and select an appropriate Project type.
- After creating a new project, navigate to the Devices Tab.
The next step is connecting our Renesas CK-RA6M5 board to the Edge Impulse Studio, so we can ingest sensor data for the machine learning model. Please follow the below steps to do so:
- Connect the Renesas CK-RA6M5 board to the computer by following the steps mentioned in the Quick Start section.
- Open a terminal or command prompt and type
edge-impulse-daemon. The Edge Impulse daemon will start and prompt for user credentials. - After providing user credentials, it will prompt you to select an Edge Impulse project. Please navigate and select the project created in the previous steps, using the arrow keys.
- After selecting the project, it will ask you to give the connected board a name. It is useful when you want to connect multiple boards to the same project.
- Now the board should be connected to the selected project. The
edge-impulse-daemonwill tell you which project the board is connected to. We can also verify by checking the Devices tab of that project.
It will also list all the sensors available for data gathering.
Edge Impulse provides multiple options for data acquisition. In this Getting Started Guide, we will look at the direct data ingestion from the board using edge-impulse-daemon. Please follow the below steps for data acquisition:
- Navigate to the Data Acquisition tab in the Edge Impulse Studio.
- Here you will find the Device we connected in the previous step and the sensor list. Please select the suitable sensor from the drop-down menu. For this project, I have selected the Microphone sensor and used default parameters.
- Add a Label name for the sample you are about to collect. I am collecting clap and whistle sounds therefore I will use clap and whistle as labels.
- Clicking Start Sampling will start the sample collection process. Once the sample is collected, it will be automatically uploaded to the Edge Impulse Studio.
When enough samples are collected, balance the data and if required clean the data as well.
After data collection, the next step is machine learning model preparation. To do so, please navigate to the Impulse design tab and add relevant preprocessing and learning blocks to the pipeline.
- Edge Impulse Studio will automatically add an input block and it will recommend a suitable preprocessing and a learning block based on the data type. I have used the recommended ones in this project with the default arguments.
- After Impulse design is complete, save the design and navigate to the preprocessing tab (MFE in this case) for the feature generation.
Click on the Save parameters button, then navigate to the Generate features tab and click Generate features button for data preprocessing.
- After feature generation, please navigate to the Learning Tab (Classifier in this case) to design the neural network architecture. I have used the default architecture and parameters recommended by the Edge Impulse Studio. After selecting a suitable configuration, click on the Start training button.
- Once the training is complete, please navigate to the Model testing tab, and click Classify all button.
After testing is finished, the Edge Impulse Studio will show the model accuracy, and other parameters.
Even though it is a simple example, the Edge Impulse Studio prepared an excellent machine learning model just by using the default recommended parameters, in just a couple of minutes.
In this step, we will deploy our prepared model to the Renesas CK-RA6M5 board, so we can perform inference locally on the board.
- Please navigate to the Deployment tab, select the Renesas CK-RA6M5 board using the search bar, and click on the Build button.
- After the build is finished, the new firmware will be downloaded automatically to your computer, and the Edge Impulse Studio will provide next-step instructions.
- Please extract the folder and double-click the
flash_<operating-system>file. This will flash the newly created firmware on the CK-RA6M5 board. This firmware contains the machine learning model we prepared in the above steps.
The next step is testing!! Let's see how well our model performs when run locally on the Renesas CK-RA6M5 board:
{% embed url="https://www.youtube.com/watch?v=THdl2YIPggY" %}
And, that's it. I hope this Getting Started Guide will be useful for you when using the Renesas CK-RA6M5 with Edge Impulse.
If you have any questions, please check out the Edge Impulse Forum.