CUDA Toolkit
The NVIDIA® CUDA® Toolkit provides a development environment for creating high-performance, GPU-accelerated applications. With it, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data centers, cloud-based platforms, and supercomputers. The toolkit includes GPU-accelerated libraries, debugging and optimization tools, a C/C++ compiler, and a runtime library.
The Features of CUDA 12
Built-In Capabilities for Easy Scaling
Using built-in capabilities for distributing computations across multi-GPU configurations, you can develop applications that scale from single-GPU workstations to cloud installations with thousands of GPUs.
Learn More
New Release, New Benefits
CUDA 12 introduces support for the NVIDIA Hopper™ and Ada Lovelace architectures, Arm® server processors, lazy module and kernel loading, revamped dynamic parallelism APIs, enhancements to the CUDA graphs API, performance-optimized libraries, and new developer tool capabilities.
Learn More
Support for Hopper
Support for the Hopper architecture includes next-generation Tensor Cores and Transformer Engine, the high-speed NVIDIA NVLink® Switch, mixed-precision modes, second-generation Multi-Instance GPU (MIG), advanced memory management, and standard C++/Fortran/Python parallel language constructs.
Learn More
Tutorials
CUDA Developer Tools is a series of tutorial videos designed to get you started using NVIDIA Nsightâ„¢ tools for CUDA development. It explores key features for CUDA profiling, debugging, and optimizing.
CUDA Compatibility
Watch VideoCUDA Upgrades for Jetson Devices
Watch VideoProfiling and Debugging Applications
Watch VideoInstalling CUDA Toolkit on Windows and WSL
Watch VideoGTC Digital Webinars
Dive deeper into the latest CUDA features.
Inside the NVIDIA Hopper Architecture
Explore what's new with the NVIDIA Hopper architecture and its implementation in the NVIDIA H100 Tensor Core GPU.
Watch NowCUDA—New Features and Beyond
Learn what's new in the CUDA Toolkit, including the latest and greatest features in the CUDA language, compiler, libraries, and tools—and get a sneak peek at what's coming up over the next year.
Watch Now
CUDA on NVIDIA Hopper GPU Architecture
Learn how to leverage the NVIDIA Hopper architecture’s capabilities to take your algorithms to the next level of performance.
Watch NowCustomer Stories
See how developers, scientists, and researchers are using CUDA today.
Using HPC to Explore the Universe
Wes Armour, director at the Oxford e-Research Centre, discusses the role of GPUs in processing large amounts of astronomical data collected by the Square Kilometre Array and how CUDA is the best-suited option for their signal processing software.
Watch Video
Opening a New Era of Drug Discovery With Amber
David Cerutti and Taisung Lee from Rutgers University share how Amber, harnessing CUDA, is advancing multiple scientific domains and opening a new era of drug discovery and design.
Watch Video
Visualizing and Simulating Atomic Structures
John Stone, senior research programmer at the Beckman Institute at the University of Illinois, Urbana-Champaign, discusses how CUDA and GPUs are used to process large datasets to visualize and simulate high-resolution atomic structures.
Watch Video
CUDA Ecosystem
Explore the top compute and graphics packages with built-in CUDA integration.
Free Tools and Trainings for Developers
Get exclusive access to hundreds of SDKs, technical trainings, and opportunities to connect with millions of like-minded developers, researchers, and students.
Learn more
Resources
CUDA Documentation and Release Notes
Documentation library containing in-depth technical information on the CUDA Toolkit.
CUDA 12 Features Revealed
A technical blog on the CUDA Toolkit 12.0’s features and capabilities.
CUDA Toolkit in the NGC Catalog
CUDA containers are available to download from NGC™—along with other NVIDIA GPU-accelerated SDKs and AI models—to help accelerate your applications.
Learn more
All CUDA Technical Blogs
An archive of CUDA technical blogs covering key features and capabilities, written by engineers for engineers.
Learn more
CUDA-Xâ„¢ Libraries
A suite of AI, data science, and math libraries developed to help developers accelerate their applications.
Learn more
Training
Self-paced or instructor-led CUDA training courses for developers through the NVIDIA Deep Learning Institute (DLI).
Learn more
Nsight Developer Tools
NVIDIA Nsight Compute and Nsight System suite of tools designed to help developers optimize and increase performance of their applications.
Learn more
Sample CUDA Code
GitHub repository of sample CUDA code to help developers learn and ramp up development of their GPU-accelerated applications.
NVIDIA Developer Forums
An information exchange to help developers get answers to their technical questions directly from NVIDIA engineers.
Bug Submission
NVIDIA Engineering’s own bug tracking tool and database where developers can submit technical bugs.
Learn more