Introduction to TIDL Jupyter notebooks examples

Example Jupyter notebooks help to quickly run analytics demos on the C7x-MMA DSP from different open source frameworks. Example notebooks contain OOB demos and custom model notebooks. OOB notebooks demos show how to run inference of a selected model from a list of options. OOB notebooks showcase main framework APIs for running inference, gives an example of pre and post-processing functions and report back performance metrics.

On the other hand, custom models, take a pre-trained classification model and compile it using one of the framework compilers to generate deployable artifacts, which can be run on the target by using frameworks inference APIs.

Analytics OOB demos and frameworks covered:

• Image Classification TFLite
• Image Classification ONNX
• Image Classification DLR
• Image Detection TFLITE
• Image Detection DLR
• Image Segmentation TFlite
• Image Segmentation ONNX
• Image Segmentation DLR

On your EVM:

1. Connect to your EVM
2. Note your EVM ipaddr
   • ifconfig
3. Move to TIDL notebooks
   • ex: /opt/notebooks
4. If this is the first time run below script to get your setup ready and copy "token" from printed information in the EVM. If not the first time, go to step 5
   • ex:./notebook_evm.sh
   • token example: http://j7-evm:8888/?token=5f4dc2f9c60318a8d8f70013a0786d56fd1c17a012a6a630
5. If this is not the first time, It is only needed to setup environment variables and relaunch Jupyter notebook server. No need to re-run notebook_evm.sh
   • export LD_LIBRARY_PATH="/usr/lib"
   • export TIDL_TOOLS_PATH="/opt/jai_tidl_notebooks"
   • export TIDL_RT_PERFSTATS="1"
   • jupyter notebook –allow-root –no-browser –ip=0.0.0.0

In your computer:

1. In a webbrowser open Jupiter notebook using EVM IP address and token
   • ex: http://192.168.1.199:8888/tree
   • if asked paste token
2. Open any of the notebooks and run the cells