Difference between revisions of "OpenGL Accelerated HTML Overlay/Performance/NVIDIA Jetson"

From RidgeRun Developer Connection
Jump to: navigation, search
(→‎Graphical Rendering by OpenGL)
 
(60 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
<noinclude>
 
<noinclude>
−
{{OpenGL Accelerated HTML Overlay/Head|previous=|next=|metakeywords=Contact Us}}
+
{{OpenGL Accelerated HTML Overlay/Head|previous=Examples/GStreamer_Usage|next=Performance/NXP_i.MX_6|metakeywords=Contact Us}}
 
</noinclude>
 
</noinclude>
−
= Library API performance =
 
−
The API has to major components: the hardware-accelerated graphical rendering done by OpenGL and the web rendering engine done by Webkit GTK.
 
−
In the following section you will find the performance for the API separated into this two sections.
 
  
−
== Graphical Rendering by OpenGL ==
+
__TOC__
  
 +
== Library performance ==
 +
The library has two major components: the hardware-accelerated graphical rendering done by OpenGL and the web rendering engine done by Webkit GTK.
 +
In the following section, you will find the performance for the library separated into these two sections.
 +
 +
=== Graphical Rendering by OpenGL ===
 +
<br>
 +
In this section, we present results about the performance of HTML Overlay tested in the following setup:
 +
 +
* Board: NVIDIA Jetson Xavier NX
 +
* Jetpack: 5.1
 +
 +
All the packages and dependencies are retrieved from the default APT repositories.
 +
 +
<br>
 
The following table shows the CPU usage, GPU usage, processing time and FPS.
 
The following table shows the CPU usage, GPU usage, processing time and FPS.
−
 
+
<br>
−
* Jetson power mode: 10W_DESKTOP
+
<br>
 
<center>
 
<center>
−
{| class="wikitable"  
+
{| class="wikitable" style="text-align:center;"
 +
|-
 +
! style="font-weight:bold; text-align:left;" | Board
 +
! colspan="12" style="font-weight:bold;" | NVIDIA Jetson Xavier NX
 +
|- style="font-weight:bold;"
 +
| style="text-align:left;" | Resolution
 +
| colspan="4" style="background-color:#9aff99;" | 4K
 +
| colspan="4" style="background-color:#ffce93;" | +1080p
 +
| colspan="4" style="background-color:#38fff8;" | +720p
 +
|- style="font-weight:bold;"
 +
| style="text-align:left;" | Measurement
 +
| style="background-color:#9aff99;" | CPU usage (%)
 +
| style="background-color:#9aff99;" | GPU usage (%)
 +
| style="background-color:#9aff99;" | Processing time (ms)
 +
| style="background-color:#9aff99;" | FPS
 +
| style="background-color:#ffce93;" | CPU usage (%)
 +
| style="background-color:#ffce93;" | GPU usage (%)
 +
| style="background-color:#ffce93;" | Processing time (ms)
 +
| style="background-color:#ffce93;" | FPS
 +
| style="background-color:#38fff8;" | CPU usage (%)
 +
| style="background-color:#38fff8;" | GPU usage (%)
 +
| style="background-color:#38fff8;" | Processing time (ms)
 +
| style="background-color:#38fff8;" | FPS
 
|-
 
|-
−
! rowspan="2" |  
+
| style="font-weight:bold; text-align:left;" | Power Configuration
−
! colspan="4" style="text-align:center; background-color:#ffce93;" | Jetson NX (+1080p)
+
| colspan="12" | 10 W Desktop Mode
 
|-
 
|-
−
| style="background-color:#ffd6a5;" | CPU usage (%)
+
| style="font-weight:bold; text-align:left;" | Upload
−
| style="background-color:#ffd6a5;" | GPU usage (%)
+
| style="background-color:#9aff99;" | 6.34
−
| style="background-color:#ffd6a5;" | Processing time (ms)
+
| style="background-color:#9aff99;" | 36.99
−
| style="background-color:#ffd6a5;" | FPS
+
| style="background-color:#9aff99;" | 11.46
 +
| style="background-color:#9aff99;" | 87.24
 +
| style="background-color:#ffce93;" | 7.25
 +
| style="background-color:#ffce93;" | 19.64
 +
| style="background-color:#ffce93;" | 14
 +
| style="background-color:#ffce93;" | 71.4
 +
| style="background-color:#38fff8;" | 4.44
 +
| style="background-color:#38fff8;" | 15.72
 +
| style="background-color:#38fff8;" | 7.293
 +
| style="background-color:#38fff8;" | 137
 
|-
 
|-
−
| Upload
+
| style="font-weight:bold; text-align:left;" | Draw
−
| style="background-color:#ffd6a5;" | 7.25
+
| style="background-color:#9aff99;" | 0.16
−
| style="background-color:#ffd6a5;" | 19.64
+
| style="background-color:#9aff99;" | 11.96
−
| style="background-color:#ffd6a5;" | 14
+
| style="background-color:#9aff99;" | 4.329
−
| style="background-color:#ffd6a5;" | 71.4
+
| style="background-color:#9aff99;" | 231
 +
| style="background-color:#ffce93;" | 0.36
 +
| style="background-color:#ffce93;" | 7.71
 +
| style="background-color:#ffce93;" | 2.5
 +
| style="background-color:#ffce93;" | 395
 +
| style="background-color:#38fff8;" | 0.40
 +
| style="background-color:#38fff8;" | 5.67
 +
| style="background-color:#38fff8;" | 2.077
 +
| style="background-color:#38fff8;" | 481
 
|-
 
|-
−
| Draw
+
| style="font-weight:bold;text-align:left;" | Download
−
| style="background-color:#ffd6a5;" | 0.36
+
| style="background-color:#9aff99;" | 7.70
−
| style="background-color:#ffd6a5;" | 7.71
+
| style="background-color:#9aff99;" | 29.08
−
| style="background-color:#ffd6a5;" | 2.5
+
| style="background-color:#9aff99;" | 15.053
−
| style="background-color:#ffd6a5;" | 395
+
| style="background-color:#9aff99;" | 66.43
 +
| style="background-color:#ffce93;" | 5
 +
| style="background-color:#ffce93;" | 14.73
 +
| style="background-color:#ffce93;" | 8.4
 +
| style="background-color:#ffce93;" | 118
 +
| style="background-color:#38fff8;" | 3.14
 +
| style="background-color:#38fff8;" | 6.53
 +
| style="background-color:#38fff8;" | 4.552
 +
| style="background-color:#38fff8;" | 220
 
|-
 
|-
−
| Download
+
| style="font-weight:bold; text-align:left;" | Power Configuration
−
| style="background-color:#ffd6a5;" | 5
+
| colspan="12" | 20 W + Jetson Clocks (Max Power)
−
| style="background-color:#ffd6a5;" | 14.73
+
|- style="vertical-align:middle;"
−
| style="background-color:#ffd6a5;" | 8.4
+
| style="font-weight:bold; text-align:left;" | Upload
−
| style="background-color:#ffd6a5;" | 118
+
| style="background-color:#9aff99;" | 4.25
 +
| style="background-color:#9aff99;" | 6.40
 +
| style="background-color:#9aff99;" | 11.357
 +
| style="background-color:#9aff99;" | 88
 +
| style="background-color:#ffce93;" | 1.45
 +
| style="background-color:#ffce93;" | 2.21
 +
| style="background-color:#ffce93;" | 2.997
 +
| style="background-color:#ffce93;" | 334
 +
| style="background-color:#38fff8;" | 0.77
 +
| style="background-color:#38fff8;" | 1.30
 +
| style="background-color:#38fff8;" | 1.492
 +
| style="background-color:#38fff8;" | 670
 +
|- style="vertical-align:middle;"
 +
| style="font-weight:bold; text-align:left;" | Draw
 +
| style="background-color:#9aff99;" | 0.09
 +
| style="background-color:#9aff99;" | 1.59
 +
| style="background-color:#9aff99;" | 0.773
 +
| style="background-color:#9aff99;" | 1294
 +
| style="background-color:#ffce93;" | 0.09
 +
| style="background-color:#ffce93;" | 0.82
 +
| style="background-color:#ffce93;" | 0.478
 +
| style="background-color:#ffce93;" | 2092
 +
| style="background-color:#38fff8;" | 0.10
 +
| style="background-color:#38fff8;" | 0.66
 +
| style="background-color:#38fff8;" | 0.443
 +
| style="background-color:#38fff8;" | 2309
 +
|- style="vertical-align:middle;"
 +
| style="font-weight:bold; text-align:left;" | Download
 +
| style="background-color:#9aff99;" | 2.73
 +
| style="background-color:#9aff99;" | 6.43
 +
| style="background-color:#9aff99;" | 6.489
 +
| style="background-color:#9aff99;" | 154.1
 +
| style="background-color:#ffce93;" | 0.94
 +
| style="background-color:#ffce93;" | 2.13
 +
| style="background-color:#ffce93;" | 1.947
 +
| style="background-color:#ffce93;" | 514
 +
| style="background-color:#38fff8;" | 0.57
 +
| style="background-color:#38fff8;" | 0.84
 +
| style="background-color:#38fff8;" | 1.071
 +
| style="background-color:#38fff8;" | 933.7
 
|}
 
|}
 
</center>
 
</center>
  
−
* Jetson power mode: 20W_6CORE, jetson clocks activated
+
=== Web rendering by WebkitGTK ===
 +
The following table shows the CPU usage, GPU usage, processing time and FPS.
  
 +
<br>
 
<center>
 
<center>
−
{| class="wikitable"
+
{| class="wikitable" style="text-align:center;"
−
|-
 
−
! rowspan="2" |
 
−
! colspan="4" style="text-align:center; background-color:#ffce93;" | Jetson NX (+1080p)
 
 
|-
 
|-
−
| style="background-color:#ffd6a5;" | CPU usage (%)
+
! style="font-weight:bold; text-align:left;" | Board
−
| style="background-color:#ffd6a5;" | GPU usage (%)
+
! colspan="12" style="font-weight:bold;" | NVIDIA Jetson Xavier NX
−
| style="background-color:#ffd6a5;" | Processing time (ms)
+
|- style="font-weight:bold;"
−
| style="background-color:#ffd6a5;" | FPS
+
| style="text-align:left;" | Resolution
 +
| colspan="4" style="background-color:#9aff99;" | 4K
 +
| colspan="4" style="background-color:#ffce93;" | +1080p
 +
| colspan="4" style="background-color:#38fff8;" | +720p
 +
|- style="font-weight:bold;"
 +
| style="text-align:left;" | Measurement
 +
| style="background-color:#9aff99;" | CPU usage (%)
 +
| style="background-color:#9aff99;" | GPU usage (%)
 +
| style="background-color:#9aff99;" | Processing time (ms)
 +
| style="background-color:#9aff99;" | FPS
 +
| style="background-color:#ffce93;" | CPU usage (%)
 +
| style="background-color:#ffce93;" | GPU usage (%)
 +
| style="background-color:#ffce93;" | Processing time (ms)
 +
| style="background-color:#ffce93;" | FPS
 +
| style="background-color:#38fff8;" | CPU usage (%)
 +
| style="background-color:#38fff8;" | GPU usage (%)
 +
| style="background-color:#38fff8;" | Processing time (ms)
 +
| style="background-color:#38fff8;" | FPS
 
|-
 
|-
−
| Upload
+
| style="font-weight:bold; text-align:left;" | Power Configuration
−
| style="background-color:#ffd6a5;" | 1.45
+
| colspan="12" | 10 W Desktop Mode
−
| style="background-color:#ffd6a5;" | 2.21
 
−
| style="background-color:#ffd6a5;" | 2.997
 
−
| style="background-color:#ffd6a5;" | 334
 
 
|-
 
|-
−
| Draw
+
| style="font-weight:bold; text-align:left;" | Draw
−
| style="background-color:#ffd6a5;" | 0.09
+
| style="background-color:#9aff99;" | 9.2
−
| style="background-color:#ffd6a5;" | 0.82
+
| style="background-color:#9aff99;" | 0
−
| style="background-color:#ffd6a5;" | 0.478
+
| style="background-color:#9aff99;" | 215.425
−
| style="background-color:#ffd6a5;" | 2092
+
| style="background-color:#9aff99;" | 4.64
 +
| style="background-color:#ffce93;" | 9.2
 +
| style="background-color:#ffce93;" | 0
 +
| style="background-color:#ffce93;" | 52.525
 +
| style="background-color:#ffce93;" | 19
 +
| style="background-color:#38fff8;" | 6.77
 +
| style="background-color:#38fff8;" | 0
 +
| style="background-color:#38fff8;" | 23.095
 +
| style="background-color:#38fff8;" | 43.3
 
|-
 
|-
−
| Download
+
| style="font-weight:bold; text-align:left;" | Power Configuration
−
| style="background-color:#ffd6a5;" | 0.94
+
| colspan="12" | 20 W + Jetson Clocks (Max Power)<ref name=performace_note>The reduced results with the 20W power mode is expected since the CPU is running at a reduced clock of 1.4GHz compared to the 1.9GHz </ref>
−
| style="background-color:#ffd6a5;" | 2.13
+
|- style="vertical-align:middle;"
−
| style="background-color:#ffd6a5;" | 1.947
+
| style="font-weight:bold; text-align:left;" | Draw
−
| style="background-color:#ffd6a5;" | 513
+
| style="background-color:#9aff99;" | 6.1
 +
| style="background-color:#9aff99;" | 0
 +
| style="background-color:#9aff99;" | 281.714
 +
| style="background-color:#9aff99;" | 3.55
 +
| style="background-color:#ffce93;" | 6.3
 +
| style="background-color:#ffce93;" | 0
 +
| style="background-color:#ffce93;" | 69.137
 +
| style="background-color:#ffce93;" | 14.46
 +
| style="background-color:#38fff8;" | 5.6
 +
| style="background-color:#38fff8;" | 0
 +
| style="background-color:#38fff8;" | 28.515
 +
| style="background-color:#38fff8;" | 35.1
 +
|- style="vertical-align:middle;"
 
|}
 
|}
 
</center>
 
</center>
  
−
= GStreamer plugin performance =
+
* Note: When on mode 20W+Jetson Clocks the frequency of operation is 1.4 GHz and for 10w+Desktop mode the frequency of operation is 1.9 GHz. This is shown for the measurements for processing time in each mode.
 +
* Note: There is no GPU consumption since we are using a flag that disables the use of GPU for WebkitGTK.
 +
<source lang=bash>
 +
export WEBKIT_DISABLE_COMPOSITING_MODE=1
 +
</source>
 +
 
 +
== GStreamer plugin performance ==
 +
 
 +
The plugin was tested with an example overlay and a camera, using a Jetson Xavier NX with Jetpack 5.1.1. The measurements were taken with the following pipeline, using gst-perf:
 +
<pre>
 +
gst-launch-1.0 -ve nvarguscamerasrc num-buffers=300 ! "video/x-raw(memory:NVMM),height=$H,width=$W,framerate=30/1" ! nvvidconv flip-method=2 ! queue ! htmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=10 ! perf ! queue ! nvvidconv ! xvimagesink
 +
</pre>
 +
<br>
  
−
The plugin was tested with an example overlay and a camera, using a Jetson Xavier NX with Jetpack 5.1.1 and with the 10W-4 core desktop power mode.
+
<center>
−
The overlay used:
+
{| class="wikitable"
−
<source lang=html>
+
|-
 +
! Board
 +
! colspan="12" style="text-align:center; font-weight:bold;" | Jetson Xavier NX
 +
|- style="font-weight:bold;"
 +
| style="font-weight:normal;" | Resolution
 +
| style="text-align:center; background-color:#a0f8f5;" | +720p
 +
| style="text-align:center; background-color:#f8dab4;" | +1080p
 +
| style="text-align:center; background-color:#f8dab4;" | +4k
 +
|-
 +
| style="font-weight:normal;" | FPS(10W-4core)
 +
| style="background-color:#a0f8f5;" | 166.6167
 +
| style="background-color:#f8dab4;" | 54.7143
 +
| style="background-color:#f8dab4;" | 13.4852
 +
|-
 +
| style="font-weight:normal;" | FPS(20W-6core & jetson-clocks)<ref name=performace_note/>
 +
| style="background-color:#a0f8f5;" | 120.5662
 +
| style="background-color:#f8dab4;" | 56.2988
 +
| style="background-color:#f8dab4;" | 12.7323
 +
|}
 +
</center>
 +
===Used overlay===
 +
The user overlay (click [https://drive.google.com/file/d/1iflIbRJxrRg5m9s0ZhfCOWusdoCVbIF7/view?usp=sharing View Source] on the wiki to see the html):
 
<html>
 
<html>
 
<head>
 
<head>
Line 92: Line 255:
 
       margin-right: 3px;
 
       margin-right: 3px;
 
     }
 
     }
−
     .row {
+
     .row {height: 50%;}
−
      height: 50%;
 
−
    }
 
 
     @keyframes flickerAnimation {
 
     @keyframes flickerAnimation {
−
       0% {
+
       0% {opacity: 1;}
−
        opacity: 1;
+
       50% {opacity: 0;}
−
      }
+
       100% {opacity: 1;}
−
       50% {
 
−
        opacity: 0;
 
−
      }
 
−
       100% {
 
−
        opacity: 1;
 
−
      }
 
 
     }
 
     }
 
     @-o-keyframes flickerAnimation {
 
     @-o-keyframes flickerAnimation {
−
       0% {
+
       0% {opacity: 1;}
−
        opacity: 1;
+
       50% {opacity: 0;}
−
      }
+
       100% {opacity: 1;}
−
       50% {
 
−
        opacity: 0;
 
−
      }
 
−
       100% {
 
−
        opacity: 1;
 
−
      }
 
 
     }
 
     }
 
     @-moz-keyframes flickerAnimation {
 
     @-moz-keyframes flickerAnimation {
−
       0% {
+
       0% {opacity: 1;}
−
        opacity: 1;
+
       50% {opacity: 0;}
−
      }
+
       100% {opacity: 1;}
−
       50% {
 
−
        opacity: 0;
 
−
      }
 
−
       100% {
 
−
        opacity: 1;
 
−
      }
 
 
     }
 
     }
 
     @-webkit-keyframes flickerAnimation {
 
     @-webkit-keyframes flickerAnimation {
−
       0% {
+
       0% {opacity: 1;}
−
        opacity: 1;
+
       50% {opacity: 0;}
−
      }
+
       100% {opacity: 1;}
−
       50% {
 
−
        opacity: 0;
 
−
      }
 
−
       100% {
 
−
        opacity: 1;
 
−
      }
 
 
     }
 
     }
 
     #rec {
 
     #rec {
Line 209: Line 346:
 
</script>
 
</script>
 
</html>
 
</html>
−
 
−
</source>
 
−
 
−
[[File:Overlayfullimage.jpg|1200px|frameless|center|HTML Overlay library ]]
 
−
[[File:Overlayfullimage.jpg|1200px|frameless|center|HTML Overlay library ]]
 
−
[[File:Overlayfullimage.jpg|1200px|frameless|center|HTML Overlay library ]]
 
  
 
<noinclude>
 
<noinclude>
−
{{OpenGL Accelerated HTML Overlay/Foot||}}
+
{{OpenGL Accelerated HTML Overlay/Foot|Examples/GStreamer_Usage|Performance/NXP_i.MX_6}}
 
</noinclude>
 
</noinclude>

Latest revision as of 14:42, 1 September 2023



Previous: Examples/GStreamer_Usage Index Next: Performance/NXP_i.MX_6
Nvidia-preferred-partner-badge-rgb-for-screen.png
NXP Partner Program Registered Vertical.jpg
OpenGL Accelerated HTML Overlay
Logo-exported.png
Basics
Getting Started
Library User Manual
GStreamer
Examples
Performance
Contact Us




Library performance

The library has two major components: the hardware-accelerated graphical rendering done by OpenGL and the web rendering engine done by Webkit GTK. In the following section, you will find the performance for the library separated into these two sections.

Graphical Rendering by OpenGL


In this section, we present results about the performance of HTML Overlay tested in the following setup:

  • Board: NVIDIA Jetson Xavier NX
  • Jetpack: 5.1

All the packages and dependencies are retrieved from the default APT repositories.


The following table shows the CPU usage, GPU usage, processing time and FPS.

Board NVIDIA Jetson Xavier NX
Resolution 4K +1080p +720p
Measurement CPU usage (%) GPU usage (%) Processing time (ms) FPS CPU usage (%) GPU usage (%) Processing time (ms) FPS CPU usage (%) GPU usage (%) Processing time (ms) FPS
Power Configuration 10 W Desktop Mode
Upload 6.34 36.99 11.46 87.24 7.25 19.64 14 71.4 4.44 15.72 7.293 137
Draw 0.16 11.96 4.329 231 0.36 7.71 2.5 395 0.40 5.67 2.077 481
Download 7.70 29.08 15.053 66.43 5 14.73 8.4 118 3.14 6.53 4.552 220
Power Configuration 20 W + Jetson Clocks (Max Power)
Upload 4.25 6.40 11.357 88 1.45 2.21 2.997 334 0.77 1.30 1.492 670
Draw 0.09 1.59 0.773 1294 0.09 0.82 0.478 2092 0.10 0.66 0.443 2309
Download 2.73 6.43 6.489 154.1 0.94 2.13 1.947 514 0.57 0.84 1.071 933.7

Web rendering by WebkitGTK

The following table shows the CPU usage, GPU usage, processing time and FPS.


Board NVIDIA Jetson Xavier NX
Resolution 4K +1080p +720p
Measurement CPU usage (%) GPU usage (%) Processing time (ms) FPS CPU usage (%) GPU usage (%) Processing time (ms) FPS CPU usage (%) GPU usage (%) Processing time (ms) FPS
Power Configuration 10 W Desktop Mode
Draw 9.2 0 215.425 4.64 9.2 0 52.525 19 6.77 0 23.095 43.3
Power Configuration 20 W + Jetson Clocks (Max Power)[1]
Draw 6.1 0 281.714 3.55 6.3 0 69.137 14.46 5.6 0 28.515 35.1
  • Note: When on mode 20W+Jetson Clocks the frequency of operation is 1.4 GHz and for 10w+Desktop mode the frequency of operation is 1.9 GHz. This is shown for the measurements for processing time in each mode.
  • Note: There is no GPU consumption since we are using a flag that disables the use of GPU for WebkitGTK.
export WEBKIT_DISABLE_COMPOSITING_MODE=1

GStreamer plugin performance

The plugin was tested with an example overlay and a camera, using a Jetson Xavier NX with Jetpack 5.1.1. The measurements were taken with the following pipeline, using gst-perf: 

gst-launch-1.0 -ve nvarguscamerasrc num-buffers=300 ! "video/x-raw(memory:NVMM),height=$H,width=$W,framerate=30/1" ! nvvidconv flip-method=2 ! queue ! htmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=10 ! perf ! queue ! nvvidconv ! xvimagesink


Board Jetson Xavier NX
Resolution +720p +1080p +4k
FPS(10W-4core) 166.6167 54.7143 13.4852
FPS(20W-6core & jetson-clocks)[1] 120.5662 56.2988 12.7323

Used overlay

The user overlay (click View Source on the wiki to see the html):

REC
Montreal City, Canada



Previous: Examples/GStreamer_Usage Index Next: Performance/NXP_i.MX_6


  1. ↑ 1.0 1.1 The reduced results with the 20W power mode is expected since the CPU is running at a reduced clock of 1.4GHz compared to the 1.9GHz
Retrieved from "http://developer.ridgerun.com/wiki/index.php?title=OpenGL_Accelerated_HTML_Overlay/Performance/NVIDIA_Jetson&oldid=50532"