NVIDIA Xavier - JetPack 5.0.2 - Components - VisionWorks

NVIDIA®Jetson Xavier™
Introduction
SoM Overview Carrier Boards NVIDIA Xavier Developer Kit Connect Tech Rogue Connect Tech Mimic Software Support NVIDIA JetPack
JetPack 5.0.2
Getting Started Installing JetPack Flashing the board with GUI installer JetPack Components Compiling Source Code Flashing the Board from Cmdline Performance Tuning Evaluating Performance Set Values Manually Tuning Power Maximizing Performance
Development in the Board
Getting into the Board Using Serial Console Using SSH Using Ubuntu Login Installing Packages
Video Capture and Display
Description Supported Cameras Imx219 Driver Software Support Using GStreamer Using Libargus
Processors
HD Audio and Video Subystem Video Encoder Video Decoder JPEG Encoder and Decoder Video Image Compositor Audio Processing Engine Deep Learning Accelerator Volta GPU Description Using CUDA Using OpenGL
Interfaces
I2C SD/eMMC Controller USB Controller
GStreamer Pipelines
Capture and Display H264 H265 VP9 MPEG4 Simultaneous Streams Compositor
Deep Learning
TensorRT Using TensorRT integrated with Tensorflow Parsing a Tensorflow model for TensorRT Parsing Caffe model for TensorRT Building TensorRT API examples Deep Learning Accelerator Software Support Deep Learning Tutorials Jetson Inference Jetson Reinforcement
RidgeRun Products
GstPTZR GstCUDA GstColorTransfer GstWebRTC GstRtspSink GstInterpipe GstInference GStreamer Daemon GstShark
Reference Documentation
Contact Us

VisionWorks is a software development package for computer vision (CV) and image processing. It implements and extends the Khronos OpenVX standard and has optimizations using the Xavier's GPU.

Samples and Demos

VisionWorks is installed with the JetPack and includes samples that can be used as a starting point for development. The source code is located in /usr/share/visionworks/sources/ and should be moved using the following commands

/usr/share/visionworks/sources/install-samples.sh ~/
cd ~/VisionWorks-1.6-Samples/
make -j4 # add dbg=1 to make debug build

this will compile all the samples and save them into the ~/VisionWorks-1.6-Samples/bin directory, individual samples can be compiled from their own directory but the executable will be stored in the same directory as when all samples are built from the top directory.

Sample	Description
Feature Tracker	A local feature tracking demo using the Harris or FAST feature detector and tracks them using Lucas-Kanade algorithm.
Stereo Matching	Uses the Semi-Global Matching algorithm to evaluate disparity and display the stereo matching.
CUDA Layer Object Tracker	Uses pyramidal Optical Flow to perform object tracking.
Hough Transform	Detects circles and lines via the Hough Transform.
Video Stabilizer	Uses the Harris feature detector and sparse pyramidal optical flow to estimate and stabilize a frame's motion.
Motion Estimation	Implements the NVIDIA Iterative Motion Estimation algorithm to estimate motion in a frame.
OpenCV and NPP Interop	Shows interoperability of VisionWorks with the NPP and OpenCV library. It takes two images, blurs them and performs alpha blending between them.
OpenGL Interop	Shows interoperability of VisionWorks and OpenGL.
Video Playback	Shows basic image and video I/O.
NVIDIA Gstreamer Camera Capture	Shows NVIDIA GStreamer camera access.