Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check the existence of f16_model_path_base in quantize.py #574

Merged
merged 1 commit into from
Mar 28, 2023

Conversation

dotpy314
Copy link
Contributor

Before this enhancement, quantize.py always returns successful as:

% python quantize.py -m /no/exist/path 7B
Succesfully quantized all models.

With the f16_model_path_base check, it can give the right response.

@anzz1
Copy link
Contributor

anzz1 commented Mar 28, 2023

Nice job! 👍

@anzz1 anzz1 merged commit 28ba975 into ggerganov:master Mar 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants