Difference between revisions of "FPD-Link III Virtual Channel ID"

From RidgeRun Developer Connection
Jump to: navigation, search
Line 15: Line 15:
  
 
= Virtual Channel ID =
 
= Virtual Channel ID =
The FPD Link III Interface is able to manage up to 4 cameras with virtual channels as separate streams. The DS90UB960-Q1 chip includes four FPD-Link III inputs simultaneously from DS90UB953-Q1 serializers. Data received from the four input ports is aggregated onto one or two 4-lane CSI-2 interfaces. The MIPI CSI-2 protocol transports virtual channels to separate different data flows interleaved in the same data stream. The CSI-2 TX supports up to four concurrent virtual channels. For each FPD-Link III input port, separate mapping may be done for each input VC-ID to any of the four VC-ID values. This function sends the output as a time-multiplexed CSI-2 stream, where the video sources are differentiated by the virtual channel.
+
The FPD Link III Interface is able to manage up to 4 cameras with virtual channels as separate streams. The DS90UB960-Q1 chip includes four FPD-Link III inputs simultaneously from DS90UB953-Q1 serializers. Data received from the four input ports is aggregated onto one or two 4-lane CSI-2 interfaces. The CSI-2 TX supports up to four concurrent virtual channels. For each FPD-Link III input port, separate mapping may be done for each input VC-ID to any of the four VC-ID values.
 +
 
 +
[[Image:Vcid-map.png|thumb|center|800px|Figure 1. Four FPD Link III cameras use case.]]
 +
 
 +
The MIPI CSI-2 protocol transports virtual channels to separate different data flows interleaved in the same data stream. This function sends the output as a time-multiplexed CSI-2 stream, where the video sources are differentiated by the virtual channel.
 +
 
 +
[[Image:Vcid-csi2.png|thumb|center|800px|Figure 2. Interleaved data flows.]]
  
 
== Synchronization ==
 
== Synchronization ==
 
The frame synchronization can be set through an external signal or internally generated by the deserializer. FrameSync signaling on the four back channels is synchronous. Thus, the FrameSync signal arrives at each of the four serializers with limited skew.
 
The frame synchronization can be set through an external signal or internally generated by the deserializer. FrameSync signaling on the four back channels is synchronous. Thus, the FrameSync signal arrives at each of the four serializers with limited skew.
  
 +
[[Image:Fpd-sync.png|thumb|center|800px|Figure 3. Internally FrameSync operation.]]
  
 
= GStreamer examples =
 
= GStreamer examples =

Revision as of 17:12, 18 July 2019

Introduction

The Flat Panel Display Link III http://www.ti.com/lit/an/slyt581/slyt581.pdf is an interface used in automotive applications to transport video from point to point. This interface enables the transport of high-definition digital video, as well as a bidirectional control channel, over a low-cost cable, either twisted pair or coax. Not long ago, cameras were a novel feature in an automobile, mostly used in larger vehicles to aid in seeing behind the vehicle while backing up. Today, backup cameras are included even in low-cost, sub-compact cars. As automobiles develop, there will be more and more applications for cameras in the vehicle, and the cameras will become more and more sophisticated.

Applications:

  • Automotive ADAS
    • Rear View Cameras (RVC)
    • Surround View Systems (SVS)
    • Camera Monitoring Systems (CMS)
    • Forward Vision Cameras (FC)
    • Driver Monitoring Systems (DMS)
    • Sensor Fusion
  • Security and Surveillance

Virtual Channel ID

The FPD Link III Interface is able to manage up to 4 cameras with virtual channels as separate streams. The DS90UB960-Q1 chip includes four FPD-Link III inputs simultaneously from DS90UB953-Q1 serializers. Data received from the four input ports is aggregated onto one or two 4-lane CSI-2 interfaces. The CSI-2 TX supports up to four concurrent virtual channels. For each FPD-Link III input port, separate mapping may be done for each input VC-ID to any of the four VC-ID values.

Error creating thumbnail: Unable to save thumbnail to destination
Figure 1. Four FPD Link III cameras use case.

The MIPI CSI-2 protocol transports virtual channels to separate different data flows interleaved in the same data stream. This function sends the output as a time-multiplexed CSI-2 stream, where the video sources are differentiated by the virtual channel.

Figure 2. Interleaved data flows.

Synchronization

The frame synchronization can be set through an external signal or internally generated by the deserializer. FrameSync signaling on the four back channels is synchronous. Thus, the FrameSync signal arrives at each of the four serializers with limited skew.

Error creating thumbnail: Unable to save thumbnail to destination
Figure 3. Internally FrameSync operation.

GStreamer examples

FPD Link III DS90UB960 DS90UB953 - IMX390

The following pipelines were tested using a Jetson AGX Xavier

  • Multiple capture (1280x800@30 fps)
gst-launch-1.0 v4l2src device=/dev/video0 !  'video/x-raw, format=(string)UYVY, width=(int)1280, height=(int)800, framerate=(fraction)30/1' ! queue ! mix.sink_0 v4l2src device=/dev/video1 !  'video/x-raw, format=(string)UYVY, width=(int)1280, height=(int)800, framerate=(fraction)30/1' ! queue ! mix.sink_1 videomixer name=mix background=1 sink_0::xpos=0 sink_0::ypos=0  sink_1::xpos=1280 sink_1::ypos=0 ! queue ! xvimagesink sync=false
  • Capture and display (1280x800@30 fps)
gst-launch-1.0 v4l2src device=/dev/video0 !  "video/x-raw, format=(string)UYVY, width=(int)1280, height=(int)800, framerate=(fraction)30/1" ! nvvidconv ! "video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)RGBA" ! nvoverlaysink sync=false
  • Recording H.264 (1280x800@30 fps)
gst-launch-1.0 v4l2src device=/dev/video0 ! "video/x-raw, format=(string)UYVY, width=(int)1280, height=(int)800, framerate=(fraction)30/1" ! nvvidconv ! omxh264enc ! mpegtsmux ! filesink location=gstreamer_test.ts -e


Linux Drivers

Ridgerun has developed Linux drivers for FPD Link III based systems, this drivers now have support for MIPI CSI-2 virtual channel. If you are interested in our FPD Link III SERDES Linux Drivers, please visit the following page: [FPD Link III SERDES Linux Drivers] or feel free to contact us.

Contact Us

Please visit our Main Website for the RidgeRun online store or Contact Us for pricing information of the engineering support and services.
You can also send an email to support@ridgerun.com for technical support, more information about the features or for a evaluation version (if available).

RR Contact Us.png