Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huggingface Not Working #588

Open
charan200415 opened this issue Dec 8, 2024 · 5 comments
Open

Huggingface Not Working #588

charan200415 opened this issue Dec 8, 2024 · 5 comments

Comments

@charan200415
Copy link

Describe the bug

When I Run ottodev with huggingface till some messages functions its working fine but after few messages that chat is no longer working with hugging face ,i thought may be token limit but when i use with new chat its working fine and the error is with the qwen model and some other models of hugging but when i use hermes llama 3.1 8b its working fine may be for qwen and other models they need modification hope these will be fixed

Link to the Bolt URL that caused the error

http://127.0.0.1:8788/chat/1

Steps to reproduce

1.use the ottodev with hugging chat
2.in same chat ask qwen models for modifications and all for sometime
3.after few messages hugging models of some apps arent working

Expected behavior

hugging face qwen and some models not working

Screen Recording / Screenshot

{ABDFDBB5-3052-4824-B987-E85AB84F951E}
coming like this when i send messages after a while it coming like below
{958FBC9C-B6BF-46CD-8C81-31E9C54AA3A6}

Platform

  • OS: Windows 11
  • Browser: Chrome
  • Version: Chrome Version 131.0.6778.109 (Official Build) (64-bit)
  • ottodev version is latest one

Provider Used

No response

Model Used

qwen 2.5 coder 32b hugging model

Additional context

No response

@BuczM
Copy link

BuczM commented Dec 9, 2024

same issue, im on mac silicon using pinokio. Everything works at the beginning. then after a while, it stops responding. but if i open a new chat, it works there again. qwen coder 32b huggingface

@mauriciogalamba
Copy link

Same issue here, even if start a new chat and import folder to continue, just not respond.
Starting a new clean chat work fine ... so always starting from zero, and after a few requests, just stop responding.
I'm using Windows 11, tried with direct install, new cloned from git, also using docker, and using WSL... always the same.

Anyone have solved this?

@charan200415
Copy link
Author

Nope , needed some help

@setuuma
Copy link

setuuma commented Jan 2, 2025

Same issue here

@jamesk411
Copy link

same here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants