4.1. ZED Stereo Camera ROS Node

This is a stereo camera ROS node for the ZED camera, based on the OpenCV VideoCapture API. The ROS node publishes left and right raw images and their camera_info.

4.1.1. Usage

Obtain the factory camera calibration data file for your ZED camera with a script provided.
```
cd $SDK_DIR/tools/stereo_camera
./download_calib_file.sh <serial_number>
```
Replace <serial_number> with the serial number of the ZED camera (found on the original box). Place the downloaded calibration data file (SNxxxx.conf) under the $SDK_DIR/ros1/drivers/zed_capture/config folder.
Generate camera_info YAML files and undistortion/rectification look-up-table (LUT) files, which are required in offloading the undistortion/rectification on the VPAC/LDC hardware accelerator. It is recommended to perform the following steps in the Robotics SDK ROS 1 container on the Ubuntu PC, and then “scp” the output artifacts to the target Linux filesystem, under /opt/robotics_sdk/ros1/drivers/zed_capture/config.

Run the following script:
```
cd $SDK_DIR/tools/stereo_camera
python3 generate_rect_map.py -i SNxxxx.conf -m <camera_mode> -p <output_folder_path>
```
- Replace SNxxxx.conf with the factory calibration data file obtained from Step 1.
- <camera_mode> is the camera mode. Valid camera mode are: 2K, FHD, FHD2, HD, HD2, VGA (see Launch File Parameters section for description). If the -m argument is not provided, the tool will iterate by default for the following three camera modes: HD, HD2, FHD, and FHD2.
This script parses the calibration data and generates the following files under <output_folder_path>:
- <SN_string>_<camera_mode>_camera_info_{left,right}.yaml: camera_info for left and right raw image,
- <SN_string>_<camera_mode>_remap_LUT_{left,right}.bin: undistortion/rectification remap LUT for left and right raw images.

Build the ZED camera ROS node

cd $ROS_WS
colcon build --base-paths /opt/robotics_sdk/ros2 --cmake-force-configure
source install/setup.bash

Launch the ZED camera node: Update zed_sn_str in launch/zed_capture_launch.py, or pass as a launch argument as follows:
```
ros2 launch zed_capture zed_capture_launch.py zed_sn_str:=SNxxxxx
```

4.1.2. Stereo Camera Calibration

For cases where the ZED cameras needs to be recalibrated for some reason, we provides a OpenCV based calibration tool. For more information, refer to Stereo Camera Calibration.

4.1.3. Launch File Parameters

Parameter	Description	Value
zed_sn_str	ZED camera serial number string, which should start with ‘SN’ followed by the serial number	string
cam_id	Camera device number. Use `cam_id = X` if the device shows up as `/dev/video-usb-camX` on the target	string
camera_mode	ZED camera mode	‘2K’ (2208x1242)
_	_	‘FHD’ (1920x1080)
_	_	‘FHD2’ (1920x1024)
_	_	‘HD’ (1280x720)
_	_	‘HD2’ (1280x720)
_	_	‘VGA’ (672x376)
frame_rate	Frame rate at which raw images are published	int
encoding	Image encoding	‘yuv422’ (default) or ‘bgr8’

‘FHD2’ is a newly added mode that provides a resolution of 1920x1024 resolution that is supported by the stereo depth engine (SDE) hardware accelerator. The images are obtained by cropping top and bottom evenly the original 1080p images captured from the ‘FHD’ mode.

‘HD2’ is a newly added mode that provides a resolution of 720p for experiments that need a longer focal length than the native ‘HD’. The images are obtained by center-cropping the original 1080p images captured from the ‘FHD’ mode.

When encoding is set to ‘yuv422’, the pixel format YUV422::YUYV from the ZED camera is converted to YUV422::UYVY format, considering the compatibility with LDC hardware accelerator.