Skip to content

Commit

Permalink
Category Details Update - Reproducibility #32
Browse files Browse the repository at this point in the history
  • Loading branch information
neural-loop committed May 19, 2024
1 parent 31e7d50 commit 5134df3
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -7,5 +7,5 @@ section_id: 7.2
description: "Understand the importance of reproducibility in foundation model development. Learn about the challenges of replicating evaluation results and discover best practices for ensuring scientific reproducibility through clear code, documentation, and setup."
highlight: true
image: reproducibility.png
details: "Model releases often go accompanied with claims on evaluation performance, but those results are not always reproducible, or can be misleading. If code is not released, is not comprehensive, is difficult to run, or misses key details, this will cost the scientific community time and effort to replicate and verify the claims. Replication time will also slow progress, and discourage developers from adopting that resource over others."
details: "Model releases accompanied with claims on performance that are not reproducible, code that is unavailable, incomplete, or difficult to run costs the scientific community time and effort. The following resources are valuable to help others replicate and verify the claim"
---

0 comments on commit 5134df3

Please sign in to comment.