Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

why can not find MOE finetune.py file #147

Open
yAoOw opened this issue Nov 22, 2024 · 3 comments
Open

why can not find MOE finetune.py file #147

yAoOw opened this issue Nov 22, 2024 · 3 comments

Comments

@yAoOw
Copy link

yAoOw commented Nov 22, 2024

where is the moirai-moe finetune file?

@liuxu77
Copy link
Contributor

liuxu77 commented Nov 27, 2024

Hi @yAoOw, thanks for asking. It does not available now, we will update on this later.

@yAoOw
Copy link
Author

yAoOw commented Dec 4, 2024

好的,我知道了

@yAoOw yAoOw closed this as completed Dec 4, 2024
@yAoOw yAoOw reopened this Dec 5, 2024
@yAoOw
Copy link
Author

yAoOw commented Dec 5, 2024

Hi @yAoOw, thanks for asking. It does not available now, we will update on this later.

Can I use the finetune.py file for non-MoE models, modify it, and then use it for fine-tuning? Or is it impossible to fine-tune MoE models based on the existing code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants