Pinned Loading

1. RLHF-trainer RLHF-trainer Public

   Supervised Finetune and Align LLMs using RLHF (RM and PPO).

   Python

2. Transformer-from-scratch Transformer-from-scratch Public

   Transformer from scratch using Pytorch [https://arxiv.org/pdf/1706.03762]

   Python 2 1

3. Data-Generation-with-OpenAI Data-Generation-with-OpenAI Public

   Generating synthetic data for model training using OpenAI API.

   Python

4. LoRA-from-scratch LoRA-from-scratch Public

   Low-Rank Adaptation of LLMs implemented using PyTorch

   Python