4.11. Release notes - 08_00_00

4.11.1. Features

Note

New features vs previous release are marked in bold

4.11.1.1. Hardware support

  1. J721E Alpha and Beta EVM support with Leo and Hera PMIC processor board

  2. J721E ES1.1 support

  3. J721E HS support

  4. Fusion1 RevC daughter card with UB960 FPDLink deserializer

  5. IMX390 2MP CSI2 image sensor + UB953 FPDLink serializer

  6. AR0233 2.5MP CSI2 image sensor + UB953 FPDLink serializer

  7. AR0820 8MP CSI2 image sensor + UB953 FPDLink serializer

  8. GESI(Gateway/Ethernet Switch/Industrial) daughter card (for additional ethernet and CAN ports)

  9. Infotainment daughter card (for HDMI output)

4.11.1.2. Software features

Important

Below is a summary of key features. Refer individual SDK Components release notes for more details

4.11.1.2.1. Vision Apps (ADAS, Vision, DL demos)

  • OpenVX based demos for ADAS, Vision, deep learning applications

    • TI-RTOS on C7x, C6x, R5F and Linux on A72

    • Integrates all major PSDK RTOS and PSDK LINUX SW components like TIDL, MMALIB, PDK, OpenVX, ETHFW, OpenGL, video codec, C6x algorithms, imaging/sensors, IPC, Linux, TI-RTOS, SPL/uboot.

    • Integrates all major HW components like CSI2 camera, eDP/HDMI display, UART, I2C, ethernet, SD card

  • Deep Learning demos

    • Image Classification demo

      • File based

      • Camera based

    • Standalone Semantic Segmentation application

      • File based

      • Camera based

    • Standalone Object Detection application

      • File based

      • Camera based

    • Auto valet parking (AVP) demo

      • semantic segmentation, Parking spot detect and Vehicle detect algorithms

      • 1 channel, 3 algo mode (AVP1 demo)

      • 3 channel, 3 algo mode - combined network for parking spot and vehicle detect (AVP2 demo)

      • 3 channel, 5 algo mode - combined network for parking spot and vehicle detect + Three task network for Semantic Segmentation, Motion Segmentation and Depth Estimation (AVP3 demo)

    • DKAZE-based Visual Localization application

    • Debug support for the ability to debug intermediate layer information from TIDL node

  • Surround view demos

    • 3D surround view using GPU on 4x 2MP 30fps live camera input

    • 3D surround view calibration application

  • 3D Surround view + AVP2 demo running simultaneously

    • 3D surround view using GPU on 4x2MP 30fps live camera input

    • 3 channel, 3 algo mode - combined network for parking spot and vehicle detect (AVP2 demo)

  • ADAS/Vision demos

    • Dense optical flow (DOF) demo

    • Stereo disparity engine demo

    • Single and multi camera to display (CSI2RX + VISS + LDC + MSC + Display) demo

    • Block based processing example kernel on C66x using UDMA/DRU

    • C7x algorithm offload demo (with DMA acceleration)

  • Perception Toolkit (PTK) Demos

    • Camera based SFM and occupancy grid mapping using Dense optical flow HW engine

    • Radar and lidar occupancy grid mapping

    • Camera SFM, radar, lidar fusion for occupancy grid mapping

  • CV Demos

    • Structure from motion

  • OpenVX target nodes

    • image pre-processing (YUV 2 RGB) nodes for DL demos

    • image post-processing and visualization nodes for deep learning, DOF, Stereo demos

    • lidar, radar, camera SFM nodes for PTK demos

    • OpenGL nodes for surround view

  • Profiling, logging and other utility APIs

  • All included MCU tasks are split between MCU2_0 (ETHFW, VPAC HWA) and MCU2_1 (DMPAC HWA), leaving MCU3_0 and MCU3_1 free on main island

4.11.1.2.2. Gateway Demos

  • CAN-Ethernet gateway demo to showcase routing between CAN-to-CAN, CAN-to-Ethernet, Ethernet-to-Ethernet and Ethernet-to-CAN using IEEE 1722 protocol

4.11.1.2.3. Platform Development Kit (PDK)

  • RTOS device drivers running on R5F, C6x, C7x, A72

  • Supported drivers and modules

    • Board diagnostic library

    • ENET CPSW (2G and 9G), CPTS, SGMII/QSGMII, LWIP

    • CSL-FL (Chip support library)

    • GPIO

    • I2C

    • IPC (inter processor communication)

    • McASP

    • MMCSD with FATFS (A72 with RTOS)

    • OSAL

    • SBL secondary bootloader

    • SCI Client (DMSC interface)

    • SPI driver (SPI, QSPI, OSPI, Hyperflash)

    • UART

    • UDMA and DRU

    • DSS display (DSI, eDP and HDMI, BT601 discrete sync mode, m2m)

    • DSS FVID2 Writeback M2M Driver with color space conversion support

    • CSI2-RX camera - support for runtime addition/removal of channels

    • CSI2-TX

    • VPAC and DMAC (VHWA), Flexconnect (VISS->MSC for YUV420)

    • PMIC Driver for LP8764x(Hera)

    • FreeRTOS Support on R5

    • KeyWriter - SBL example application

4.11.1.2.4. MCU Software (MCUSW)

  • AutoSAR MCAL driver and demo applications running on R5F

  • AutoSAR MCAL driver for Adc, Can, CDD IPC, Dio, Eth, Gpt, Pwm, Epwm Spi, Icu & Wdg

  • MCU Demo Applications

    • CAN Profiling Application (SYSBIOS/FreeRTOS)

    • CDD IPC Profiling Application (SYSBIOS/FreeRTOS)

    • SPI IPC Profiling Application (SYSBIOS)

    • MCU Only Demo: ACTIVE to MCU ONLY to ACTIVE mode switching

4.11.1.2.5. TI Deep learning Product (TIDL) and MMALIB

  • TensorFlow Lite Runtime with Delegate API support for heterogeneous execution on ARM+C7x_MMA

  • ONNX Runtime with Execution Provider support for heterogeneous execution on ARM+C7x_MMA

  • NEO-AI-DLR support - TVM model compilation for heterogeneous execution on ARM+C7x_MMA

  • TIDL deep learning inference engine library running on C7x/MMA

  • MMALIB for accelerating convolution, deconvolution layers on MMA (used by TIDL internally)

  • Supports Caffe, ONXX, TFlite network exchange formats

  • Supported layers: Convolution, deconvolution, pooling, ReLU, Elt-wise, Inner product, Soft-max, and many more, refer TIDL user guide (LINK)

  • Support for Additional layers - Sigmoid layer, Standalone Pad layer, Color conversion (YUV420SP to RGB) Layer, Depth to Space (Pixel Shuffle) Layer

  • Custom / User defined layer Call-back to plugin user specific layers

  • TIDL network import tool and graph visualizer tool

  • Post Training Quantization options for 8-bit, 16-bit and mixed precision inference

  • Optimized performance for higher resolutions (upto 2 MP)

  • Optimized Object detection Post Processing Layer

  • Improved Model zoo for camera applications

  • Performance improvement of Object Detection Models for ONNX Runtime

  • Performance improvement of data transfer and format conversion routines between ARM and DSP for TFLite and ONNX Runtime

  • Optimal support of 5x5 depthwise convolution with stride 2

  • Support of batch processing

  • Improved Jupyter notebooks for better debug capabilities

  • Improved graph visualization for complete model with annotation of target (C7x or ARM) for each sub graph

4.11.1.2.6. TI OpenVX (TIOVX)

  • OpenVX v1.1 compliant implementation with graph pipelining and user data object extension support

  • OpenVX API on A72 running Linux/QNX

  • OpenVX target kernels on C7x, C6x, R5F, A72

  • OpenVX v1.1 C6x kernels

  • OpenVX nodes for

    • TIDL (C7x-MMA)

    • VISS (R5F)

    • LDC (R5F)

    • MSC (multi-scalar) (R5F)

    • Pyramid (using MSC) (R5F)

    • Dense Optical Flow (R5F)

    • Stereo Disparity Engine (R5F)

    • BLNF (bilateral noise filter) (R5F)

    • CSI2-RX camera (R5F)

    • CSI2-TX (R5F)

    • Display (eDP and HDMI) (R5F)

    • Display M2M (R5F)

  • OpenVX tutorials for getting started

  • PyTIOVX tools for target kernel code generation

  • Performance Analyzer tool for run time logging of OpenVX graphs

  • VISS node supports heterogeneous cameras

4.11.1.2.7. TI OpenVX (TIOVX) with ROS Development Framework

  • TI Vision Apps Library deployed on the J721e target that enables building applications directly on the target

  • Docker container environment on J721e for TIOVX + ROS development framework

  • Demo applications developed in TIOVX + ROS framework

    • Stereo vision processing node accelerated on LDC and SDE

    • CNN semantic segmentation node with TIDL running on C7x/MMA

  • Available on a public GIT repository here.

4.11.1.2.8. Imaging

  • IMX390 2MP sensor driver (30/60fps) with IQ tuning

  • AR0233 2.5MP sensor driver with IQ tuning

  • AR0820 8MP sensor driver with IQ tuning

  • TI Auto-exposure and auto white-balance algorithms

    • AEWB framework improvements to image quality and performance

  • Support for UB960 broadcast mode

  • Live Tuning Runtime interaction with PC tuning tool over Ethernet

  • Sensor framework supports heterogeneous cameras

4.11.1.2.9. Ethernet Switch Firmware (ETHFW)

  • Ethernet firmware interface API

  • Ethernet switch firmware running on R5F for CPSW9G

  • Layer 2 switching

  • FreeRTOS for Main R5F Core 0

  • lwIP TCP/IP stack integration

  • NDK integration (will be discontinued starting in next release)

  • Remote switch configuration server

  • GUI switch configuration tool

  • Inter VLAN routing

  • IP next header filtering

  • Rate limiting

  • CPSW Proxy/Server layer for remote core integration

  • Integration with AutoSAR Eth Virtual MAC driver

  • PTP Support

4.11.1.2.10. TI Autonomous Driving Algorithms (TIADALG)

  • Image pre-processing APIs for color plane conversion and separation YUV to RGB for DL applications (C6x optimized)

  • Camera Pose estimation API using solve pnp technique (C6x optimized)

  • Visual localization algorithm (C6x optimized)

  • Structure from Motion algorithm

4.11.1.2.11. TI-RTOS

  • SysBIOS for R5F, C6x, C7x

  • Network developer kit (NDK) on R5F

Note

This is the last release with TI-RTOS (SysBIOS) and TI NDK stack support.

4.11.1.2.12. FreeRTOS

  • FreeRTOS for R5F

  • lwIP TCP/IP stack integration for R5F

4.11.1.2.13. Code Gen Tools (CGT)

  • TI Compiler, assembler, linker for R5F, C6x, C7x

  • GCC compiler for A72 (needs to be downloaded separately)

4.11.2. Device Support and Validation Information

SoC

Build Host (OS)

Run Target (OS)

Test Plaform

J721E

x86_64 (Linux Ubuntu 18.04)

R5F, C6x, C7x running TI-RTOS

A72 running Linux or QNX

J721E EVM with daughter cards

PC emulation mode (1)

x86_64 (Linux Ubuntu 18.04)

x86_64 (Linux Ubuntu 18.04)

x86_64 (Linux Ubuntu 18.04)

(1) Requires download of addon package from mySecure Software

4.11.3. Upgrade and Compatibility

In this section, we only highlight a few significant changes in this SDK. For full list of upgrade and compatibility topics, please refer to individual components release notes SDK Components.

4.11.3.1. Video Codecs

RTOS based video codec support has been REMOVED from the PSDK RTOS starting in 08.00.00 release. Codecs can be accessible via Linux SDK, or by using PSDK RTOS 07.03.00.

4.11.3.2. TI-RTOS vs. FreeRTOS

While TI-RTOS (Sysbios) is still the OS supported on C6X and C7x DSPs, FreeRTOS is the default OS for R5F libraries and binaries starting in 08.00.00 release. In 08.01.00 release, FreeRTOS will be the default build for ALL R5F, C6x, and C7x DSPs, and TI-RTOS (Sysbios) will no longer be supported or packaged as part of the SDK.

4.11.3.3. NDK vs. LwIP

LwIP is the default network stack starting in 08.00.00 release for when FreeRTOS is running on R5F. NDK is still packaged for if TI-RTOS is enabled on R5F. In 08.01.00 release, LwIP will be the default network stack for R5F and NDK will no longer be supported or packaged as part of the SDK.

4.11.3.4. System Firmware Architecture Upgrade (PDK)

The 7.1 release introduced the new architecture for System firmware where the TI Foundational Security (TIFS) is running on the DMSC and Power Management & Resource Management (collectively known as Device Management (DM)) runs as a library on the MCU1_0 R5F. Refer to following pages for more details:

4.11.3.5. ENET LLD (PDK)

The 7.1 release added Low-level driver support for CPSW Ethernet peripherals has been migrated from CPSW LLD to Enet LLD. This change comes with API name changes. More details of this change can be found in the Upgrade and Compatibility section of the PDK Release Notes: LINK

4.11.4. Known Issues

Refer to individual SDK Components release notes for known issues in each component

4.11.5. Change Requests

ID

Head Line

Original Fix Version

New Fix Version

Components

JACINTOREQ-1518

PDK: R5 SafeRTOS CPU support

08.00.00

08.01.00

PDK

JACINTOREQ-1441

PDK: C7x FreeRTOS CPU support

08.00.00

08.01.00

PDK

JACINTOREQ-1537

Power Benchmarking in TI Cloud requirement

08.00.00

08.01.00

TIDL

JACINTOREQ-1536

LDC2 DCC Plugin

08.00.00

08.01.00

IMAGING

JACINTOREQ-1526

MCUSS Demo: IPC SPI Master Slave Demo FreeRTOS Porting

08.00.00

08.01.00

MCUSW

JACINTOREQ-1525

Flex connect (VISS->LDC Nodes)

08.00.00

08.01.00

TIOVX

JACINTOREQ-1504

PDK: PCIE and USB Descope

08.00.00

None

PDK

JACINTOREQ-1576

Support for Embedded data on separate CSI channel (0x12) from sensor in Capture Node

08.00.00

None

TIOVX

JACINTOREQ-1244

RTOS-Based Codecs and OpenVX codec nodes descope

08.00.00

None

VIDEO_CODEC, TIOVX, Vision Apps

JACINTOREQ-1540

Single demo application with heterogeneous cameras (can be done using different existing demos running concurrently)

08.00.00

None

Vision Apps

JACINTOREQ-1500

Linux loading of gateway demo via remoteproc

08.00.00

None

Gateway Demos

JACINTOREQ-1465

Windows build/installer for RTOS SDK

08.00.00

None

SDK Package

4.11.5.1. Errata workarounds

Record ID

Summary

Workaround

ErrataID

ETHFW-795

[CPTS] GENF (and ESTF) Reconfiguration Issue

GENF/ESTF length values are read to check for earlier configuration. If already configured, current configuration is returned with a warning.

i2083

PDK-4489

RAT : Error interrupt triggered even when error logging disable set

If the RAT error logging is disabled, then the error interrupt should also be disabled by software.

i2062

PDK-6894

DDR: Valid VRef range must be defined during LPDDR4 Command Bus Training

i2160

PDK-8226

R5FSS: The same interrupt cannot be nested back-2-back within another interrupt

This can be achieved by reserving the highest priority level (Priority-0), and using that priority for a dummy interrupt (any one out of 512 interrupts available in R5), and calling this dummy interrupt inside every ISR. Further, the R5 core itself need not enter this dummy ISR (it can be masked), only the handshake with VIM around this dummy ISR needs to happen. This issue is addressed in J721E SR1.1.

i2162

PDK-8375

OSPI Boot Mode Failure with MCU2_1 Core

STOG should be left in disabled/bypass mode. This issue is addressed in J721E SR1.1.

i2121

PRSDK-6362

MMC: MMC1/2 Speed Issue

i2090

PRSDK-8660

VTM: Software reads from on-die Temperature Sensors can be corrupted

i2053

TIDL-523

C7x MMA HWA_STATUS reports errors before application starts

i2087

TIDL-533

C7x: The C7x memory system and cpu may stall indefinitely, in the presence L1D snoops caused due to streaming engine reads, cache misses from MSMC or DDR, L1D victims, and some other specific conditions in a small time window.

i2065

4.11.6. Additional Reports

For additional reports like test report, traceability refer [LINK] (or ${PSDK RTOS_PATH}/psdk_rtos/docs/additional_reports in package)