Support for AWS Neuron Inferentia GPU #522
virajkanwade
started this conversation in
Ideas
Replies: 3 comments
-
$ lspci -d '1d0f:' | grep NeuronDevice |
Beta Was this translation helpful? Give feedback.
0 replies
-
/sys/module/neuron/version |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This would add the ability to run ollama on inf2 instance types in AWS.
Beta Was this translation helpful? Give feedback.
All reactions