Samples for CUDA Developers which demonstrates features in CUDA Toolkit

cuda cuda-kernels cuda-driver-api cuda-opengl

Rob Armstrong 14b1bfdcc4 Replace README references to "CUDA Toolkit 12.5" with general "CUDA Toolkit"		2 months ago
..
.vscode	add and update samples for CUDA 11.6	4 years ago
CMakeLists.txt	Update all sample CMakeLists.txt to include ENABLE_CUDA_DEBUG flag to enable cuda-gdb	3 months ago
README.md	Replace README references to "CUDA Toolkit 12.5" with general "CUDA Toolkit"	2 months ago
bf16TensorCoreGemm.cu	Apply consistent code formatting across the repo. Add clang-format and pre-commit hooks.	3 months ago

README.md

bf16TensorCoreGemm - bfloat16 Tensor Core GEMM

Description

A CUDA sample demonstrating __nv_bfloat16 (e8m7) GEMM computation using the Warp Matrix Multiply and Accumulate (WMMA) API introduced with CUDA 11 in Ampere chip family tensor cores for faster matrix operations. This sample also uses async copy provided by cuda pipeline interface for gmem to shmem async loads which improves kernel performance and reduces register presssure.

Key Concepts

Matrix Multiply, WMMA, Tensor Cores

Supported SM Architectures

SM 8.0 SM 8.6 SM 8.7 SM 8.9 SM 9.0

Supported OSes

Linux, Windows

Supported CPU Architecture

x86_64, aarch64

CUDA APIs involved

CUDA Runtime API

cudaMemcpy, cudaFree, cudaGetErrorString, cudaGetLastError, cudaEventSynchronize, cudaFuncSetAttribute, cudaEventRecord, cudaMemset, cudaMalloc, cudaEventElapsedTime, cudaGetDeviceProperties, cudaEventCreate

Dependencies needed to build/run

CPP11

Prerequisites

Download and install the CUDA Toolkit for your corresponding platform. Make sure the dependencies mentioned in Dependencies section above are installed.