Webinar: Technical Overview of GPU Inference Pipeline

We will demonstrate how to quick-start and use Triton on real word applications on-prem, on the cloud, or in a mixed environment.

This email was sent

July 21, 2023 11:01am EDT

Is this your brand on Milled? Claim it.

Matte tone:

Technical Overview of GPU Inference Pipeline

July 26, 2023 - 4:00 PM CEST

TensorRT and Triton Inference Server

In this webinar series, we will do an in-depth presentation of Triton and its main components. We also will demonstrate how to quick-start and use Triton on real word applications on-prem, on the cloud, or in a mixed environment. In addition, we provide you with the scripts and code to jumpstart your Triton expertise. TensorRT is an optimizing compiler of neural networks for inference. NVIDIA TensorRT-based applications perform up to 36X faster than CPU-only platforms during inference, enabling you to optimize neural network models trained on all major frameworks, calibrate for lower precision with high accuracy, and deploy to hyperscale data centers, embedded platforms, or automotive product platforms.

By attending this webinar, you’ll learn:

Rapid Prototyping and Testing of ML Models With PyTriton
Overview of TensorRT and its integration with Pytorch and TensorFlow
A complete, reproducible demo of how one can take a Pytorch model, compile with TensorRT and inference in production in Triton.
Review and Real Enterprise Customer Cases