本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
-
Updated
Dec 17, 2024 - HTML
#
llm-training
Here are 293 public repositories matching this topic...
Low-code framework for building custom LLMs, neural networks, and other AI models
learning data-science machine-learning natural-language-processing computer-vision deep-learning neural-network natural-language ml deep pytorch machinelearning llama deeplearning mistral fine-tuning data-centric llm llm-training llama2
-
Updated
Dec 23, 2024 - Python
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
data-science machine-learning deep-learning gpu job-scheduler cloud-management spot-instances cloud-computing job-queue hyperparameter-tuning cost-optimization distributed-training multicloud ml-infrastructure tpu cost-management finops ml-platform llm-serving llm-training
-
Updated
Dec 24, 2024 - Python
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
agent chatbot conversational-ai peft baichuan msagent large-language-models llm supervised-finetuning llava llm-training chatglm2 internlm llama2 qwen chatglm3 mixtral llama3 phi3
-
Updated
Dec 16, 2024 - Python
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
ai chatbot llama gpt generative fine-tuning finetuning llm generative-ai chatgpt llm-training llama2
-
Updated
Nov 1, 2024 - Python
Efficient Triton Kernels for LLM Training
-
Updated
Dec 23, 2024 - Python
Code examples and resources for DBRX, a large language model developed by Databricks
-
Updated
May 1, 2024 - Python
dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.
python training kubernetes aws machine-learning cloud azure gpu gcp orchestration k8s fine-tuning llms llmops llm-training llm-inference
-
Updated
Dec 25, 2024 - Python
DLRover: An Automatic Distributed Deep Learning System
-
Updated
Dec 24, 2024 - Python
Nvidia GPU exporter for prometheus using nvidia-smi binary
ai monitoring gaming prometheus nvidia cryptocurrency prometheus-exporter nvidia-smi nvidia-gpu llm llm-training
-
Updated
Dec 22, 2024 - Go
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
deep-learning optimizer pytorch artificial-intelligence moe resnet vit diffusion mae fairseq cuda-programming bert-model gpt2 transformer-xl timm convnext adan llms dreamfusion llm-training
-
Updated
Jul 2, 2024 - Python
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
open-source transformers bert huggingface large-language-models llm-training llm-inference open-source-llm llm-tutorials
-
Updated
Dec 23, 2024 - Jupyter Notebook
irresponsible innovation. Try now at https://chat.dev/
machine-learning deep-learning artificial-intelligence distillation distillation-model llm llm-agent llm-training llm-inference llm-local
-
Updated
May 14, 2024 - Python
LLM (Large Language Model) FineTuning
pytorch gpt-3 large-language-models llm llm-serving gpt3-turbo llm-training llm-inference open-source-llm llama2 llm-finetuning mistral-7b
-
Updated
May 19, 2024 - Jupyter Notebook
The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
-
Updated
Oct 11, 2024 - Python
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
classification data-augmentation ai-safety fine-tuning aisafety rag large-language-models llm llm-training
-
Updated
Dec 2, 2023 - Jupyter Notebook
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
-
Updated
Dec 17, 2024 - Python
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
pytorch multi-modal gemma pipeline-parallelism transformers-models tensor-parallelism llava llm-training internlm flash-attention zero3 llm-framework sequence-parallelism internlm2 ring-attention deepspeed-ulysses llama3 910b
-
Updated
Dec 20, 2024 - Python
Improve this page
Add a description, image, and links to the llm-training topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-training topic, visit your repo's landing page and select "manage topics."