Balena.io Blog

5 posts tagged with “cuda”

Comparing performance of Jetson GPUs on balena

The NVIDIA Jetson is a popular IoT device for machine learning on the edge, and balenaOS supports over a dozen different models including the new Orin series. There’s plenty of benchmarks, specifications and marketing material available to ascertain the relative computing power of all the different NVIDIA Jetson devices. You’ll often find charts that compare AI performance in TOPS, GPU cores, CUDA…

September 06, 2023 / 5 min

article

Running An AI Model On The Jetson GPU And CPU Simultaneously

There’s a popular breakfast dish in Philadelphia known as scrapple, which consists of pork scraps and trimmings - all the leftover parts of meat after butchering that could not be used or sold elsewhere to avoid waste. An AI project that we presented last year reminds me of scrapple because its goal is the same - leave no waste and utilize every bit of computing power of a NVIDIA Jetson Nano. This…

July 14, 2023 / 5 min

article

Using NVIDIA Jetson NGC containers on balenaOS

Balena’s container-based technology streamlines development, deployment, and management of IoT Linux devices. However, when those devices include NVIDIA Jetson-based AI carrier boards and modules, there is the additional challenge of configuring an ML software stack such as PyTorch or TensorFlow and all of its underlying dependencies. BSP drivers, JetPack versions and CUDA libraries must match…

May 05, 2023 / 15 min

article

How to use NVIDIA Jetson devices on balena

The Jetson line of modules brings accelerated AI to edge devices, allowing for truly innovative uses for IoT devices. The balena platform supports these modules (Nano, TX2, Xavier, Orin), enabling you to deploy, maintain, and update fleets of one to hundreds of thousands with ease. This is the third update of our series about how to use Jetson devices on the balena platform. How to use edge AI…

January 11, 2023 / 17 min

article

How to use NVIDIA Jetson devices on balena

Access the full capabilities of Jetson devices in balenaCloud. Recent versions of balenaOS provide easy access to JetPack components, giving your containers access to the GPU’s power. Learn how to build a project to start accessing a world of AI tools, including CUDA and OpenCV, below. How to use edge AI tools with NVIDIA and balenaOS Hardware refresher Nvidia Jetson is a series of embedded…

December 15, 2020 / 14 min

1 - 5 of 5