1. Robotics SDK Introduction

1.1. Git Repository

Robotics SDK Git Repository

1.3. Overview

The Robotics SDK provides a robotics software development environment for TI Jacinto Processors. It also offers software building blocks and example demos that can be leveraged in robotics software development. The SDK runs in Docker container environments on:

In the next section, you will find detailed steps for setting up Docker container environments for ROS 2 Humble on the Processor SDK Linux for Edge AI. The Robotics SDK allows:

  • Optimized software implementation of computation-intensive software building blocks (including deep-learning, vision, perception, mapping and localization) on deep-learning core (C7x/MMA), DSP cores, hardware accelerators built-in on the processors.

  • Application software development on the target using libraries optimized on the TI Processor along with many open-source libraries and packages including, for example, OpenCV, Point-Cloud Library (PCL), and more.

Figure 1 shows the software libraries and components provided by the Robotics SDK.

Figure 1. Robotics SDK: Software Stack (Note: hardware diagram varies depending on the platform.)

1.3.1. TI Vision Apps Library

The TI Vision Apps Library is included in the pre-built base image for the Processor SDK Linux for Edge AI. The library provides a set of APIs, including:

  • TI OpenVX kernels and software infrastructure

  • Imaging and vision applications

  • Perception applications

  • Advanced driver-assistance systems (ADAS) applications

1.3.2. Open-Source Deep-Learning Runtime

The Processor SDK Linux for Edge AI also supports the following open-source deep-learning runtime libraries:

  • TVM/Neo-AI-DLR

  • TFLite Runtime

  • ONNX Runtime

For more details on open-source deep-learning runtime on TI Processors, please check TI Edge AI Cloud. The Robotics SDK provides a versatile vision CNN node optimized for TI Processors that supports many deep-learning models for object detection, semantic segmentation, and 6D pose estimation operations.

Figure 2 shows a representative deep-learning and compute-intensive demo application developed with the Robotics SDK.

Figure 2. Example Demo Application with Robotics SDK

1.4. Setting Up Robotics SDK Docker Container Environment

This section describes how to set up the Robotics SDK on top of the Processor SDK Linux for Edge AI. To get started, please refer to our Setting Up Robotics SDK guide.

1.5. Sensor Driver Nodes

The following ROS nodes for cameras have been tested and are supported by the SDK:

1.7. Scope of Robotics SDK

* Visual location is supported only on TDA4VM, AM68A, and AM69A.

1.8. Limitations and Known Issues

See known_issues.md for a list of limitations and known issues.

1.9. Change Log

See CHANGELOG.md for the change log.

1.10. Questions & Feedback

If you have any questions or feedback, please visit TI E2E.