Robotics SDK

Overview

The Jacinto Robotics SDK provides software development environment on the latest TDA4 class of SoCs, and also provides software building blocks and example demos that can be leveraged in robotics software development. The SDK runs in Docker container environments on Processor SDK Linux for Edge AI 8.1.0. We provide detailed steps for setting up Docker container environments for ROS Noetic and ROS 2 Foxy on the Processor SDK Linux for Edge AI (see next section). The Robotics SDK allows:

  • Optimized software implementation of computation-intensive software blocks (including deep-learning, vision, perception, mapping and localization) on deep-learning core (C7x/MMA), DSP cores, hardware accelerators built-in on the TDA4 processors.

  • Direct compilation of application software on the target using APIs optimized on the TDA4 cores and hardware accelerators along with many open-source libraries and packages including, for example, OpenCV, Point-Cloud Library (PCL), and many more.

Figure 1 shows the software libraries and components that the Robotics SDK provides.

../_images/tiovx_ros_sw_stack.png

Figure 1. Robotics Software Development Kit: Software Stack

TI Vision Apps Library

TI Vision Apps Library is included in the pre-built base image for the Processor SDK Linux for Edge AI. The library provides a set of APIs including:

  • TI OpenVX kernels and software infrastructure

  • Imaging and vision applications

  • Advanced driver-assistance systems (ADAS) applications

  • Perception applications

Open-Source Deep-Learning Runtime

The Processor SDK Linux for Edge AI also supports the following open-source deep-learning runtime:

  • TVM/Neo-AI-DLR

  • TFLite Runtime

  • ONNX Runtime

For more details on open-source deep-learning runtime on TDA4x, please check TI Edge AI Cloud. The Robotics SDK provides a versatile vision CNN node optimized on TDA4x that supports many deep-learning models for object detection and semantic segmentation operations.

Figure 2 shows a representative deep-learning and compute-intensive demo application developed with the Robotics SDK.

../_images/tiovx_ros_demo_diagram.svg

Figure 2. Example Demo Application with Robotics SDK

Setting Up Robotics SDK Docker Container Environment

This section describes how to set up the Robotics SDK on top of the Processor SDK Linux for Edge AI. Check out our Setting Up Robotics SDK to get started.

Note: git.ti.com has some issue in rendering markdown files. We highly recommend to use the section in the User Guide Documentation

Sensor Driver Nodes

Following ROS nodes for cameras are tested and supported by the SDK.

Scope of Robotics SDK

../_images/scope_of_release_08_01_00.png

Limitations and Known Issues

See known_issues.md

Change Log

See CHANGELOG.md

Questions & Feedback

If you have questions or feedback, please use TI E2E.