Skip to content

Files

Failed to load latest commit information.

Latest commit

 Cannot retrieve latest commit at this time.

History

History
 
 

mamba

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

candle-mamba: Mamba implementation

Candle implementation of Mamba [1] inference only. Mamba is an alternative to the transformer architecture. It leverages State Space Models (SSMs) with the goal of being computationally efficient on long sequences. The implementation is based on mamba.rs.

Compared to the mamba-minimal example, this version is far more efficient but would only work for inference.

Running the example

$ cargo run --example mamba-minimal --release -- --prompt "Mamba is the"