3.15. Machine LearningΒΆ

Sitara Machine Learning toolkit brings machine learning to the edge by enabling machine learning inference on all Sitara devices (Arm only, Arm + specialized hardware accelerators). It is provided as part of TI’s Processor SDK Linux, free to download and use. Sitara machine learning today consists of TI Deep Learning (TIDL), Arm NN, TensorFlow Lite, and RNN library.

../_images/Sitara_machine_learning_stack_diagram.png

Fig. 3.3 Sitara Machine Learnining Offering

TI Deep Learning (TIDL)

  • Accelerates deep learning inference on C66x DSP cores and/or on Embedded Vision Engine (EVE) subsystems.
  • Available on AM57x device only.
  • Supports CNN at the moment, and imports Caffe, ONNX, and Tensorflow models.

Arm NN

  • Open source inference engine available from Arm.
  • Runs on all Cortex-A ARM cores (AM3x, AM4x, AM5x, AM6x Sitara devices).
  • Imports Caffe, ONNX, TensorFlow, and TensorFlow Lite models.

TensorFlow Lite

  • Open source deep learning runtime for on-device inference.
  • Runs on all Cortex-A ARM cores (AM3x, AM4x, AM5x, AM6x Sitara devices).
  • Imports Tensorflow Lite models.

RNN Library

  • Provides Long Short-Term Memory (LSTM) and fully connected layers in a standalone library to allow for rapid prototyping of inference applications that require Recurrent Neural Networks.
  • Runs on all Cortex-A ARM cores (AM3x, AM4x, AM5x, AM6x Sitara devices).
  • Integrated into TI’s Processor SDK Linux in an OOB demo for Predictive Maintenance.