On-device AI across mobile, embedded and edge for PyTorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Port of Facebook's LLaMA model in C/C++

MiniCPM on Android platform.

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Universal LLM Deployment Engine with ML Compilation

The YOLOv5 object detection android example

ncnn benchmark on various single board computers

The style transfer android example

CAIN, Channel Attention Is All You Need for Video Frame Interpolation implemented with ncnn library

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its…

The squeezenet image classification android example

kaldi-asr/kaldi is the official location of the Kaldi project.

Real-time speech recognition and voice activity detection (VAD) using next-gen Kaldi with ncnn without Internet connection. Support iOS, Android, Linux, macOS, Windows, Raspberry Pi, VisionFive2, L…

Suno AI's Bark model in C/C++ for fast text-to-speech

Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

High Performance Web Platform Based on Nginx and LuaJIT

deeplearning.ai（吴恩达老师的深度学习课程笔记及资源）

吴恩达老师的机器学习课程个人笔记

LLM training in simple, raw C/CUDA

Armbian Linux build framework generates custom Debian or Ubuntu image for x86, aarch64, riscv64 & armhf

The minimal opencv for Android, iOS, ARM Linux, Windows, Linux, MacOS, HarmonyOS, WebAssembly, watchOS, tvOS, visionOS

Stable Diffusion and Flux in pure C/C++

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。