NVIDIA JetPack is a comprehensive software development kit (SDK) designed specifically for NVIDIA’s Jetson series of embedded AI and computing platforms. JetPack includes a wide range of software components such as the operating system, CUDA toolkit, deep learning, and vision libraries, as well as accelerated codec tools, enabling developers to efficiently develop, deploy, and optimize AI applications on Jetson devices. With pre-built cloud-native software services, JetPack accelerates the development and deployment of advanced edge AI applications, including generative AI, computer vision, and advanced robotics.

Key Features

• Operating System: A customized operating system based on Ubuntu Linux.
• CUDA Toolkit: Supports NVIDIA’s high-performance parallel computing framework.
• Deep Learning Frameworks: Pre-installed with popular deep learning frameworks like TensorFlow and PyTorch.
• Computer Vision Libraries: Includes computer vision libraries like OpenCV and VisionWorks.
• Multimedia Processing: Provides accelerated tools for video and audio encoding and decoding.
• Tools and Examples: Includes various development and debugging tools, as well as example codes and applications.

Features and Advantages

• Comprehensive Development Support: JetPack encompasses everything from the operating system (Ubuntu), CUDA toolkit, TensorRT, cuDNN, to deep learning and computer vision libraries. These components allow developers to perform end-to-end development from the device driver layer to the application layer.
• Optimization and Acceleration: It offers deep learning inference acceleration technologies tailored for the Jetson platform, such as TensorRT and the DeepStream SDK, which significantly enhance the performance of AI models on edge devices.
• Machine Learning Support: JetPack supports various common machine learning frameworks like TensorFlow, PyTorch, and ONNX Runtime, enabling developers to quickly deploy and optimize models on Jetson devices.
• Multimedia Support: JetPack includes multimedia processing tools like NVIDIA’s Jetson multimedia API, which supports efficient video encoding, decoding, and image processing.
• Rich Development Tools: It comes with numerous development and debugging tools, such as Nsight Systems and Nsight Graphics, which help developers perform performance analysis and debug graphical applications.
• Cross-Platform Support: JetPack allows developers to easily transition from desktop systems to embedded systems and develop and deploy across multiple Jetson platforms, including Jetson Xavier NX, Jetson AGX Xavier, and Jetson Nano.

JetPack SDK Installation and Setup

NVIDIA SDK Manager is an all-in-one tool that bundles developer software and provides a point-to-point solution for setting up the development environment for NVIDIA SDKs.

To learn more about how to install and set up JetPack SDK, please visit the following link: How to Install and Set Up JetPack SDK.

NVIDIA Jetson Linux 36.3

Jetson Linux 36.3 is a production-quality release that supports all Jetson AGX Orin, Jetson Orin NX, and Jetson Orin Nano production modules, as well as the Jetson AGX Orin Developer Kit and the Jetson Orin Nano Developer Kit. This release includes the Linux kernel 5.15, a root filesystem based on Ubuntu 22.04, a UEFI-based bootloader, and OP-TEE as the trusted execution environment.

For more details, please visit the Jetson Linux Developer Guide

Cloud-Native Capabilities of the Jetson Platform

NVIDIA Jetson’s cloud-native capabilities significantly enhance the development efficiency and flexibility of edge AI devices. By utilizing container orchestration, Kubernetes, and Metropolis microservices, developers can quickly build, deploy, and scale their AI applications. NVIDIA offers a wealth of resources and tools to support this process, establishing Jetson as a powerful platform for edge AI development.

For more details, please visit the NVIDIA Jetson Cloud-Native Page

 

Jetson Platform Services

NVIDIA Jetson platform services offer powerful support for developing edge AI devices by integrating cloud-native technologies and comprehensive development tools. These services streamline the deployment and management of AI applications, making it easier to handle complex AI workloads efficiently in edge environments. The Jetson platform is well-suited for various application scenarios, helping developers achieve high performance in AI tasks at the edge.

Jetson Platform Services features:

• 15+ services, including generative AI services, foundation services, and more
• Streaming generative AI services for vision language model and zero-shot detection with APIs for dynamic prompting and stream update
• DeepStream-based AI perception service for object detection and tracking with APIs for stream update
• Media management and storage service with support for streaming protocol such as RTSP and WebRTC
• Core foundation services like IoT Gateway, API Gateway, monitoring, and system bus
• IoT services for secure edge-to-cloud connectivity and remote API invocation

For more details, please visit the NVIDIA Jetson Platform Service