Skip to content

Commit

Permalink
update acknowledgement
Browse files Browse the repository at this point in the history
  • Loading branch information
ChiYeungLaw authored Jun 15, 2023
1 parent 1728634 commit 4062cac
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions WizardCoder/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,7 @@ for ((i = 0; i < $gpu_num; i++)); do
if (($index % $gpu_num == 0)); then wait; fi
done
```

3. Run the post processing code `src/process_humaneval.py` to collect the code completions from all answer files.
```bash
output_path=preds/T${temp}_N${pred_num}
Expand All @@ -199,6 +200,8 @@ python process_humaneval.py --path ${output_path} --out_path ${output_path}.json
evaluate_functional_correctness ${output_path}.jsonl
```

Acknowledgement: The evaluation code `humaneval_gen.py` and bash script are modified from the great works of [CodeT5](https://github.com/salesforce/CodeT5).

## Citation

Please cite the repo if you use the data or code in this repo.
Expand Down

0 comments on commit 4062cac

Please sign in to comment.