1.6.2.1. Edge AI Gallery - User Guide¶
1.6.2.1.1. Overview¶
This section is applicable for the tisdk-edgeai-image only. It has a QT based Out of Box application setup so that user can test the prepackaged models, with sample images, videos and optionally with a connected camera. The Demo also allows users to add their custom models, images, and videos to extend the functionality.
All of the necessary equipment requirement and instructions are provided here.
1.6.2.1.2. Hardware Prerequisites¶
- TI J721S2 Device
- PC (Windows or Linux, to use serial terminal console)
- HDMI Monitor (to view the Demo on Display)
- IMX219 Camera
- USB Mouse
- SD card (minimum 16GB)
- Ethernet connection (if serial terminal console is not accessible)
1.6.2.1.3. Launching and Using the edge AI gallery¶
The edge AI gallery launches on Linux startup. Follow the below instructions to use it.
- Connect the Display, IMX219 Camera, Mouse, Ethernet and Power on the board. The application will launch when the Device is fully booted.
- Once started, You can click on one of the
Image Classification
,Object Detection
orSemantic Segmentation
to validate the models with a fixed GStreamer pipeline.
- To switch to a new pipeline, click on the same button again to stop the currently running pipeline.
- To create and run a custom pipeline, click on
Custom
button. You’ll be provided with a popup menu to choose the below options.- Input Type: Image, Video or Camera
- Input: Image/Video file or Camera Device (For Image or Video files, the path displayed next to the dropdown heading is where you can add your custom files)
- Model: Models available in the file system (The path displayed next to the dropdown heading is where you can add your custom models)
Select the 3 options as described above and click on
Start
to generate and start the pipeline.Note
As the note suggests, it might take a while for custom pipeline to start.
Click on
Custom
button again to stop the custom pipeline.For ease of use, the IP addr of the device is displayed at the bottom right when Network is connected.
Note
The IP addr is polled only for the first 100 seconds after the application has started.
To close the application and go to the Wallpaper screen, use the close button on the top right corner.
To add new images, videos and models, you should add them in the below directories respectively
- Images - /opt/edgeai-test-data/images/
- Videos - /opt/edgeai-test-data/videos/
- Models - /opt/model_zoo/
To change the videos in the prebuilt pipelines used for
Image Classification
,Object Detection
&Semantic Segmentation
, you can replace the video filesoob-gui-video*.h264
under/opt/oob-demo-assets/
.To add new models to the
Model
dropdown list in Custom popup menu, Add the names of the models in/opt/oob-demo-assets/allowedModels.txt
.Note
For the above changes to take effect, close and relaunch the application.
To relaunch the application, you should run
/etc/init.d/edgeai-launcher.sh start
And to stop the application again, you should run
/etc/init.d/edgeai-launcher.sh start
- For further information on edge AI, refer Edge AI Documentation
1.6.2.1.4. Building the edge AI gallery¶
The edge AI gallery application is enabled by default for the tisdk-edgeai-image
for J721S2.
The source code is available at edgeai-gui-app and can be recompiled with the following steps
To setup the environment, from the root of the SDK installation directory, source environment-setup script.
$ source linux-devkit/environment-setup
Go to the root of edgeai-gui-app repository and run the following command to build the application.
$ qmake; make
Copy the compiled binary to /usr/bin directory of the device
$ scp edgeai-gui-app root@<ip-addr-of-device>:/usr/bin/