Multi Camera VPAC Application

Table of Contents

• Introduction
• Supported plaforms
• Data flow (RAW12 input)
• Steps to run the application on J7 EVM (Linux + RTOS mode)
• Steps to run the application on J7 EVM (QNX + RTOS mode)

Introduction

This application demonstrates the use of VISS node and TI's 2A (AE & AWB) algorithm in multi-channel mode. The dataflow is

1. Configure image sensors using sensor driver f/w APIs
2. Acquire RAW images from camera sensors
3. Process the images on VISS
4. Run AE (Auto Exposure) and AWB (AutoWhiteBalance) algorithms, using H3A output from VISS
5. Run LDC on the output of VISS
6. Scale LDC output using MSC and arrange in a mosaic
7. Display the mosaic using Display Sub-System

Any number of cameras from 1-8 can be selected by the user, subject to constraints of sensor driver. The application assumes that all cameras are identical.

Supported plaforms

Platform	Linux x86_64	Linux+RTOS mode	QNX+RTOS mode	SoC
Support	NO	YES	YES	J721e / J721S2 / J784S4

Data flow (RAW12 input)

Steps to run the application on J7 EVM (Linux + RTOS mode)

1. Build the application and related libraries as mentioned in Build Instructions for Linux+RTOS mode
2. Connect four D3-IMX390 RCM sensor boards on cam0, cam1, cam2 and cam3 input ports of the Fusion1 board.
3. Use the is_interactive flag to run the demo in an interactive mode which allows the user to print performance characteristics on the UART console.
4. Run the app as shown below

   cd /opt/vision_apps
   source ./vision_apps_init.sh
   ./run_app_multi_cam.sh

5. The processed output for one of the captured channel is displayed through DSS on HDMI or eDP display - Display interface selection through compile time setting in the file platform/j721e/rtos/common/app_cfg_mcu2_0.h

Steps to run the application on J7 EVM (QNX + RTOS mode)

1. Build the application and related libraries as mentioned in Build Instructions for QNX+RTOS mode
2. Connect four D3-IMX390 RCM sensor boards on cam0, cam1, cam2 and cam3 input ports of the Fusion1 board.
3. Use the is_interactive flag to run the demo in an interactive mode which allows the user to print performance characteristics on the UART console.
4. In the case of J784S4, use the bypass_split_graph flag to determine whether or not to use both VPAC's available on J784S4. The split configuration mode splits the output from the capture node into 2 parallel pipelines running on each VPAC instance. The pipelines merge together in the mosaic node and are rendered onto the display using the display node. For other SoC's, this configuration is also enabled by default, but it will only execute on a single VPAC.
5. Run the app as shown below

   cd /ti_fs/vision_apps
   . ./vision_apps_init.sh
   ./run_app_multi_cam.sh

6. The processed output for one of the captured channel is displayed through DSS on HDMI or eDP display - Display interface selection through compile time setting in the file platform/j721e/rtos/common/app_cfg_mcu2_0.h