Posts by Dhruv Singal
Data Science
Aug 03, 2022
Deploying GPT-J and T5 with NVIDIA Triton Inference Server
This is the second part of a two-part series about NVIDIA tools that allow you to run large transformer models for accelerated inference. For an introduction to...
16 MIN READ
Data Center / Cloud
Apr 06, 2021
N Ways to SAXPY: Demonstrating the Breadth of GPU Programming Options
Back in 2012, NVIDIAN Mark Harris wrote Six Ways to Saxpy, demonstrating how to perform the SAXPY operation on a GPU in multiple ways, using different languages...
9 MIN READ
Simulation / Modeling / Design
Sep 25, 2020
Deploying Models from TensorFlow Model Zoo Using NVIDIA DeepStream and NVIDIA Triton Inference Server
If you’re building unique AI/DL application, you are constantly looking to train and deploy AI models from various frameworks like TensorFlow, PyTorch,...
10 MIN READ
Data Science
Aug 27, 2020
Accelerating Machine Learning on a Linux Laptop with an External GPU
With the introduction of Intel Thunderbolt 3 in laptops, you can now use an external GPU (eGPU) enclosure to use a dedicated GPU for gaming, production, and...
6 MIN READ