Pinned Loading

1. Griffin Griffin Public

   Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

   Python 12 1

2. The-Swarm-Corporation/swarms-cloud The-Swarm-Corporation/swarms-cloud Public

   Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.

   Python 29 10

3. swarm-drone-hrtx swarm-drone-hrtx Public

   Drone swarm simulation environment operated through HRTX self attention (multi input multi output multi modality)

   Python 1 1

4. SuperAlignment SuperAlignment Public

   Simple Implementation of Teacher-Student superalignment. Arxiv paper: https://arxiv.org/pdf/2402.03749.pdf

   Python 1

5. TransformerWeightsTransfer TransformerWeightsTransfer Public

   This project demonstrates how to create a Linear State Space Model (LSSM) by transferring weights from a pretrained LLaMA model. The LSSM is a simplified linear approximation of the LLaMA model's M…

   Python 1

6. 365-repo-challenge 365-repo-challenge Public

   In the year 2025, I will publish 1 repo a day. Roadmap and automated publishing to release the backlog of projects once a day.