Vision Apps User Guide
Multi Camera VPAC Application

Introduction

This application demonstrates the use of VISS node and TI's 2A (AE & AWB) algorithm in multi-channel mode. The dataflow is

  1. Configure image sensors using sensor driver f/w APIs
  2. Acquire RAW images from camera sensors
  3. Process the images on VISS
  4. Run AE (Auto Exposure) and AWB (AutoWhiteBalance) algorithms, using H3A output from VISS
  5. Run LDC on the output of VISS
  6. Scale LDC output using MSC and arrange in a mosaic
  7. Display the mosaic using Display Sub-System

Any number of cameras from 1-8 (up to 12 with J784S4 + Fusion2 board) can be selected by the user, subject to constraints of sensor driver. The application assumes that all cameras are identical.

Supported plaforms

Platform Linux x86_64 Linux+RTOS mode QNX+RTOS mode SoC
Support NO YES YES J721e / J721S2 / J722S / J784S4

Data flow (RAW12 input)

app_multi_cam_data_flow.png

Steps to run the application on J7 EVM (Linux + RTOS mode)

  1. Build the application and related libraries as mentioned in Build Instructions for Linux+RTOS mode
  2. Connect up to 8 D3-IMX390 RCM camera modules to cam0 - cam7 ports of the Fusion1 board.
    1. For J784S4 + Fusion2 board, connect up to 12 D3-IMX390 RCM camera modules to cam0 - cam11 ports.
  3. Use the is_interactive flag to run the demo in an interactive mode which allows the user to print performance characteristics on the UART console.
  4. Run the app as shown below
    cd /opt/vision_apps
    source ./vision_apps_init.sh
    ./run_app_multi_cam.sh
  5. The processed output for one of the captured channel is displayed through DSS on HDMI or eDP display - Display interface selection through compile time setting in the file platform/j721e/rtos/common/app_cfg_mcu2_0.h

Steps to run the application on J7 EVM (QNX + RTOS mode)

  1. Build the application and related libraries as mentioned in Build Instructions for QNX+RTOS mode
  2. Connect up to 8 D3-IMX390 RCM camera modules to cam0 - cam7 ports of the Fusion1 board.
    1. For J784S4 + Fusion2 board, connect up to 12 D3-IMX390 RCM camera modules to cam0 - cam11 ports.
  3. Use the is_interactive flag to run the demo in an interactive mode which allows the user to print performance characteristics on the UART console.
  4. In the case of J784S4, use the bypass_split_graph flag to determine whether or not to use both VPAC's available on J784S4. The split configuration mode splits the output from the capture node into 2 parallel pipelines running on each VPAC instance. The pipelines merge together in the mosaic node and are rendered onto the display using the display node. For other SoC's, this configuration is also enabled by default, but it will only execute on a single VPAC.
  5. Run the app as shown below
    cd /ti_fs/vision_apps
    . ./vision_apps_init.sh
    ./run_app_multi_cam.sh
  6. The processed output for one of the captured channel is displayed through DSS on HDMI or eDP display - Display interface selection through compile time setting in the file platform/j721e/rtos/common/app_cfg_mcu2_0.h