This repository showcases how to run Mixtral-8x7B models in colab or consumer desktops.
To try this demo, please use the demo notebook: ./notebooks/demo.ipynb or
forked from dvmazur/mixtral-offloading
-
Notifications
You must be signed in to change notification settings - Fork 0
Run Mixtral-8x7B models in Colab or consumer desktops
License
JRCuster/mixtral-offloading
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Run Mixtral-8x7B models in Colab or consumer desktops
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Jupyter Notebook 98.2%
- Python 1.8%