Difference between revisions of "NVIDIA Jetson Orin Nano/Camera Sensors Support/IMX708"

From RidgeRun Developer Connection
Jump to: navigation, search
 
(26 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
 
<noinclude>
 
<noinclude>
 
{{NVIDIA Jetson Orin Nano/Head|next=|metakeywords=|metadescription=}}
 
{{NVIDIA Jetson Orin Nano/Head|next=|metakeywords=|metadescription=}}
 
</noinclude>
 
</noinclude>
 +
 +
  
 
This wiki provides information about the IMX708 camera sensor driver developed by RidgeRun. The information provided was tested on:
 
This wiki provides information about the IMX708 camera sensor driver developed by RidgeRun. The information provided was tested on:
 
<pre>
 
<pre>
* JetPack: 5.1.1
+
* Jetson Orin Nano developer kit from NVIDIA
* Jetson Linux: 35.3.1
+
* JetPack version: 5.1.1
* One IMX708 Rapsberry Pi Camera Module V3
+
* Linux for Tegra version: 35.3.1
 +
* 1x IMX708 Rapsberry Pi Camera Module V3
 
</pre>
 
</pre>
 
The Raspberry Pi Camera V3 camera module (IMX708) is compatible with the Jetson Orin Nano developer kit from NVIDIA. RidgeRun developed a driver to fulfill the needs of the market, The driver has the next characteristics:
 
  
 
{| class="wikitable" style="margin: auto;"
 
{| class="wikitable" style="margin: auto;"
Line 17: Line 19:
  
  
{| class="wikitable"
+
=Raspberry Pi Camera Module 3 & driver features=
 +
The Raspberry Pi Camera V3 camera module (IMX708) is compatible with the Jetson Orin Nano developer kit from NVIDIA. The IMX708 is a cost-effective camera module capable of capturing a resolution higher than 4K. Table 1 shows a few interesting characteristics of the camera module. The driver developed by RidgeRun has the specifications shown in Table 2. If you need to extend the driver to meet your project needs, feel free to [https://www.ridgerun.com/contact contact us].
 +
 
 +
 
 +
{| class="wikitable" style="margin: auto;"
 +
|+ Table 1: Raspberry Pi Module 3 specs
 
|-
 
|-
! Element !! Description
+
! Parameter !! Description
 
|-
 
|-
 
| Image sensor || IMX708
 
| Image sensor || IMX708
Line 35: Line 42:
 
| Color Filter || Color
 
| Color Filter || Color
 
|-
 
|-
| Common Video Mode || 1080p50*, 720p100*, 480p120*
+
| Minimun Focus Distance || 5 cm
|-
 
| Output Format || RAW10
 
|-
 
| Binning Support || Yes*
 
 
|-
 
|-
| HDR Support || Yes*
+
| Binning Support || Yes
 
|-
 
|-
| Auto-Focus (PDAF) || Yes*
+
| HDR Support || Yes
 
|-
 
|-
| Minimun Focus Distance || 5 cm
+
| Auto-Focus (PDAF) || Yes
|-
 
| Controls || Exposure, gain, HDR, etc *
 
|-
 
| Compatible hardware || Raspberry Pi, Orin Nano**
 
 
|}
 
|}
  
  
<span style="font-size:10px">*These values come from common sensor documentation, but they are not currently supported by Ridgerun IMX708 Orin Nano driver. Contact us to start working with you in your driver specifications needs.</span> <br>
+
<br>
<span style="font-size:10px">**The compatibility is restricted to 4608x2592@14.35 fps. To have access to more resolution modes or controls, [https://www.ridgerun.com/contact contact us].</span>
+
{| class="wikitable" style="margin: auto;"
 
+
|+ Table 2: Driver specs
 
 
RidgeRun has been working intensively to port the IMX708 image sensor to the Jetson Orin Nano, as fast as possible due to the market needs. Right now, we are offering to the embedded software developer community a functional driver. The driver has the specification detailed below.
 
 
 
{| class="wikitable"
 
|-
 
! Element !! Description
 
|-
 
| Video output || 4608x2592@14.35fps
 
|-
 
| Output Format || RAW10
 
|-
 
| Binning Support || Yes*
 
 
|-
 
|-
| HDR Support || Yes*
+
! Parameter !! Description
 
|-
 
|-
| Auto-Focus (PDAF) || Yes*
+
| Pixel Depth || RAW10
 
|-
 
|-
| Controls || Exposure, gain, HDR, etc *
+
| Resolution || 4608 x 2592
 
|-
 
|-
| Number of cameras streaming at the same time || 1**
+
| Framerate || 14.35
 
|}
 
|}
  
<span style="font-size:10px">*[https://www.ridgerun.com/contact Contact us]  to develop this features according to your needs</span> <br>
 
<span style="font-size:10px">**[https://www.ridgerun.com/contact Contact us] to work with you and extend the functionality to more attached cameras.</span>
 
  
Example Video
+
You can use V4L2 or GStreamer to capture using the RidgeRun driver. Figure 2 below is a screenshot of the video obtained using the following GStreamer pipeline on the Orin Nano:
 +
<pre>
 +
nvidia@ubuntu:~$ GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 nvarguscamerasrc sensor_id=1 -e ! 'video/x-raw(memory:NVMM),width=4608,height=2592,framerate=14/1, format=NV12' ! nvvidconv ! x264enc tune=zerolatency insert-vui=true pass=quant quantizer=32 speed-preset=ultrafast bitrate=5000 ! mpegtsmux ! filesink location=output_office_cam1.mp4
 +
</pre>
  
 
{| class="wikitable" style="margin: auto;"
 
{| class="wikitable" style="margin: auto;"
|[[File:IMX708-ORIN-NANO-VIDEO.gif|thumb| center | 500px | Figure 1: Raspberry Pi 3 Camera Module 3 recording (4608x2592@14.35fps)]]  
+
|[[File:IMX708-ORIN-NANO-VIDEO.gif|thumb| center | 500px | Figure 2: Raspberry Pi 3 Camera Module 3 recording (4608x2592@14.35fps)]]  
 
|}
 
|}
 +
 +
 +
= Installation Instructions =
 +
 +
Please refer to [https://developer.ridgerun.com/wiki/index.php/Raspberry_Pi_Camera_Module_3_IMX708_Linux_driver_for_Jetson this guide] to have a complete guide to install the driver in the Jetson Orin Nano. We widely recommend reading the whole guide in order to get a better understanding on what is the installation guide flow. Once you have read the wiki, consult the [https://developer.ridgerun.com/wiki/index.php/Raspberry_Pi_Camera_Module_3_IMX708_Linux_driver_for_Jetson Index] and visit the exact section you need.
  
 
<noinclude>
 
<noinclude>
 
{{NVIDIA Jetson Orin Nano/Foot||}}
 
{{NVIDIA Jetson Orin Nano/Foot||}}
 
</noinclude>
 
</noinclude>
 +
 +
{{ContactUs}}
 +
 +
[[Category:Jetson]][[Category:Jetson V4L2 Drivers]][[Category:Sony]]

Latest revision as of 10:22, 8 August 2023



  Index  


Nvidia-preferred-partner-badge-rgb-for-screen.png





This wiki provides information about the IMX708 camera sensor driver developed by RidgeRun. The information provided was tested on:

* Jetson Orin Nano developer kit from NVIDIA
* JetPack version: 5.1.1
* Linux for Tegra version: 35.3.1
* 1x IMX708 Rapsberry Pi Camera Module V3
Figure 1: Raspberry Pi 3 Camera Module 3 connected to a NVIDIA® Jetson Orin Nano™


Raspberry Pi Camera Module 3 & driver features

The Raspberry Pi Camera V3 camera module (IMX708) is compatible with the Jetson Orin Nano developer kit from NVIDIA. The IMX708 is a cost-effective camera module capable of capturing a resolution higher than 4K. Table 1 shows a few interesting characteristics of the camera module. The driver developed by RidgeRun has the specifications shown in Table 2. If you need to extend the driver to meet your project needs, feel free to contact us.


Table 1: Raspberry Pi Module 3 specs
Parameter Description
Image sensor IMX708
Optical Size 1/2.43(7.4mm sensor diagonal)
Number of effective pixels Height = 4608, Width = 2592
Pixel Size 1.4μm × 1.4μm
Interface MIPI CSI-2 Interface
Shutter Type Rolling Shutter
Color Filter Color
Minimun Focus Distance 5 cm
Binning Support Yes
HDR Support Yes
Auto-Focus (PDAF) Yes



Table 2: Driver specs
Parameter Description
Pixel Depth RAW10
Resolution 4608 x 2592
Framerate 14.35


You can use V4L2 or GStreamer to capture using the RidgeRun driver. Figure 2 below is a screenshot of the video obtained using the following GStreamer pipeline on the Orin Nano:

nvidia@ubuntu:~$ GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 nvarguscamerasrc sensor_id=1 -e ! 'video/x-raw(memory:NVMM),width=4608,height=2592,framerate=14/1, format=NV12' ! nvvidconv ! x264enc tune=zerolatency insert-vui=true pass=quant quantizer=32 speed-preset=ultrafast bitrate=5000 ! mpegtsmux ! filesink location=output_office_cam1.mp4
Figure 2: Raspberry Pi 3 Camera Module 3 recording (4608x2592@14.35fps)


Installation Instructions

Please refer to this guide to have a complete guide to install the driver in the Jetson Orin Nano. We widely recommend reading the whole guide in order to get a better understanding on what is the installation guide flow. Once you have read the wiki, consult the Index and visit the exact section you need.



  Index  




RidgeRun Resources

Quick Start Client Engagement Process RidgeRun Blog Homepage
Technical and Sales Support RidgeRun Online Store RidgeRun Videos Contact Us

OOjs UI icon message-progressive.svg Contact Us

Visit our Main Website for the RidgeRun Products and Online Store. RidgeRun Engineering informations are available in RidgeRun Professional Services, RidgeRun Subscription Model and Client Engagement Process wiki pages. Please email to support@ridgerun.com for technical questions and contactus@ridgerun.com for other queries. Contact details for sponsoring the RidgeRun GStreamer projects are available in Sponsor Projects page. Ridgerun-logo.svg
RR Contact Us.png