Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Somewhat not following the instructions #14

Open
SeungyounShin opened this issue Aug 30, 2023 · 1 comment
Open

Somewhat not following the instructions #14

SeungyounShin opened this issue Aug 30, 2023 · 1 comment
Assignees
@SeungyounShin
Labels
bug Something isn't working

Comments

@SeungyounShin
Copy link
Owner 

          Agreed, it makes me think the benchmark could've been leaked into the fine-tune and overfitted.

@SeungyounShin I'm having issues getting the model to stick to a predictable format for python code but it's not very good at following instructions-- what is the format for identifying code within is completion?

Originally posted by @itsPreto in #13 (comment)
@SeungyounShin
Copy link
Owner Author

Hi @itsPreto,

It seems there might have been a bit of confusion. I fine-tuned the model using [CODE_START_TOK] and [/CODE_END_TOK] among a few other special tokens to help it discern when to generate code.

Can you share screen shot of gradio or some details of your prompt?

@SeungyounShin SeungyounShin self-assigned this Aug 30, 2023
@SeungyounShin SeungyounShin added the bug Something isn't working label Aug 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@SeungyounShin SeungyounShin

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@SeungyounShin