Samples for CUDA Developers which demonstrates features in CUDA Toolkit

cuda cuda-kernels cuda-driver-api cuda-opengl

Rob Armstrong 14b1bfdcc4 Replace README references to "CUDA Toolkit 12.5" with general "CUDA Toolkit"		2 months ago
..
.vscode	add and update samples for CUDA 11.6	4 years ago
CMakeLists.txt	Update all sample CMakeLists.txt to include ENABLE_CUDA_DEBUG flag to enable cuda-gdb	4 months ago
README.md	Replace README references to "CUDA Toolkit 12.5" with general "CUDA Toolkit"	2 months ago
asyncAPI.cu	Apply consistent code formatting across the repo. Add clang-format and pre-commit hooks.	3 months ago

README.md

asyncAPI - asyncAPI

Description

This sample illustrates the usage of CUDA events for both GPU timing and overlapping CPU and GPU execution. Events are inserted into a stream of CUDA calls. Since CUDA stream calls are asynchronous, the CPU can perform computations while GPU is executing (including DMA memcopies between the host and device). CPU can query CUDA events to determine whether GPU has completed tasks.

Key Concepts

Asynchronous Data Transfers, CUDA Streams and Events

Supported SM Architectures

SM 5.0 SM 5.2 SM 5.3 SM 6.0 SM 6.1 SM 7.0 SM 7.2 SM 7.5 SM 8.0 SM 8.6 SM 8.7 SM 8.9 SM 9.0

Supported OSes

Linux, Windows

Supported CPU Architecture

x86_64, armv7l

CUDA APIs involved

CUDA Runtime API

cudaProfilerStop, cudaMalloc, cudaMemcpyAsync, cudaFree, cudaMallocHost, cudaProfilerStart, cudaDeviceSynchronize, cudaEventRecord, cudaFreeHost, cudaMemset, cudaEventDestroy, cudaEventQuery, cudaEventElapsedTime, cudaGetDeviceProperties, cudaEventCreate

Prerequisites

Download and install the CUDA Toolkit for your corresponding platform.