Change the repository type filter
All
Repositories list
641 repositories
barney
Public- C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows
- Ongoing research training transformer models at scale
cuCollections
Public- CUDA Core Compute Libraries
- BioNeMo Framework: For building and adapting AI models in drug discovery at scale
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
stdexec
Public- GPU accelerated decision optimization
- Open-source deep-learning framework for exploring, building and deploying AI weather/climate workflows.
- NVIDIA Federated Learning Application Runtime Environment
TensorRT-LLM
PublicTensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.- NeMo Retriever extraction is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extraction uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images that you can use in downstream generative applications.
NVSentinel
Public- AIStore: scalable storage for AI applications
JAX-Toolbox
Public