Structured Text Generation

BlackJAX is a Bayesian Inference library designed for ease of use, speed and modularity.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

PyTorch native quantization and sparsity for training and inference

TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, etc. It compresses deep learning models for downstream d…

Use Python for lattice QCD research based on the QUDA library.

Normalizing flow for generating lattice field configurations

Zero Bubble Pipeline Parallelism

Tile primitives for speedy kernels

Doug's Diversions

Normalizing flows in PyTorch

CoreNet: A library for training deep neural networks

RDMA and SHARP plugins for nccl library

A tool to create a directory from a recipe

ripgrep recursively searches directories for a regex pattern while respecting your gitignore

Zero-Shot Speech Editing and Text-to-Speech in the Wild

Scalable data pre processing and curation toolkit for LLMs

A PyTorch Native LLM Training Framework

A benchmark to evaluate language models on questions I've previously asked them to solve.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

This repository contains the experimental PyTorch native float8 training UX

Minimalistic large language model 3D-parallelism training

Fly through your shell history. Great Scott!

Compressed numerical arrays that support high-speed random access

A high-throughput and memory-efficient inference and serving engine for LLMs

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Mamba SSM architecture

MLX: An array framework for Apple silicon

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing