Commits

Branch selector

 open_hu_eval

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 26, 2025

• update HuMatchingFIB config and dataset

  jxd0712

  committed
  d4df622

  Copy full SHA for d4df622

Commits on Jan 24, 2025

• [Feature] Add OpenHuEval-HuLifeQA (#4)

  Hoteryoung

  authored
  116a246

  Copy full SHA for 116a246

Commits on Jan 22, 2025

• add HuStandardFIB under new paradigm (#3)

  Show description for 5f72e96
  

  2 peopleauthored and

  Hoteryoung

  committed
  5f72e96

  Copy full SHA for 5f72e96

• add HuMatchingFIB under new paradigm

  

  weixingjian

  authored and

  Hoteryoung

  committed
  6527fdf

  Copy full SHA for 6527fdf

• [Bump] Bump version to 0.4.0 (open-compass#1838)

  MaiziXiao

  authored
  35ec307

  Copy full SHA for 35ec307

Commits on Jan 21, 2025

• [Fix] Update max_out_len logic for OpenAI model (open-compass#1839)

  MaiziXiao

  authored
  03415b2

  Copy full SHA for 03415b2

Commits on Jan 20, 2025

• [Refactor] Code refactoarization (open-compass#1831)

  Show description for a6193b4
  MaiziXiao

  authored
  a6193b4

  Copy full SHA for a6193b4

Commits on Jan 17, 2025

• [Doc] Installation.md update (open-compass#1830)

  thejishnunair

  authored
  ffdc917

  Copy full SHA for ffdc917

• [Update] Update method to add dataset in docs (open-compass#1827)

  Show description for 70da9b7
  Myhs-phz

  authored
  70da9b7

  Copy full SHA for 70da9b7

Commits on Jan 16, 2025

• [Feature] Add support for InternLM3 (open-compass#1829)

  Show description for 531643e
  MaiziXiao

  authored
  531643e

  Copy full SHA for 531643e

Commits on Jan 10, 2025

• added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (open-compass#1815)

  acylam

  authored
  7f2aeef

  Copy full SHA for 7f2aeef

Commits on Jan 9, 2025

• [CI] Fix path conflict (open-compass#1814)

  Show description for 121d482
  zhulinJulia24

  authored
  121d482

  Copy full SHA for 121d482

• [CI] Update daily test metrics threshold (open-compass#1812)

  Show description for abdcee6
  

  zhulinJulia24

  and

  MaiziXiao

  authored
  abdcee6

  Copy full SHA for abdcee6

• [Feature] Support MMLU-CF Benchmark (open-compass#1775)

  Show description for e039f3e
  

  fistyee

  and

  liushz

  authored
  e039f3e

  Copy full SHA for e039f3e

Commits on Jan 7, 2025

• [Update] Update LiveMathBench (open-compass#1809)

  Show description for f1e50d4
  tonysy

  authored
  f1e50d4

  Copy full SHA for f1e50d4

Commits on Jan 6, 2025

• [Update] Update o1 eval prompt (open-compass#1806)

  Show description for 8fdb72f
  tonysy

  authored
  8fdb72f

  Copy full SHA for 8fdb72f

Commits on Jan 3, 2025

• [Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (open-compass#1802)

  Show description for f871e80
  acylam

  authored
  f871e80

  Copy full SHA for f871e80

• [Feature] Add Longbenchv2 support (open-compass#1801)

  Show description for 117dc50
  

  MaiziXiao

  and

  abrohamLee

  authored
  117dc50

  Copy full SHA for 117dc50

Commits on Dec 31, 2024

• [BUMP] Bump version to 0.3.9 (open-compass#1790)

  MaiziXiao

  authored
  f322043

  Copy full SHA for f322043

• [Feature] Add LiveStemBench Dataset (open-compass#1794)

  Show description for 9c980cb
  liushz

  authored
  9c980cb

  Copy full SHA for 9c980cb

• [Fix] Fix generic_llm_evaluator output_path (open-compass#1798)

  Show description for fc0556e
  tonysy

  authored
  fc0556e

  Copy full SHA for fc0556e

• [Feature] Added Bradley-Terry subjective evaluation

  acylam

  authored
  dc6035c

  Copy full SHA for dc6035c

Commits on Dec 30, 2024

• [Feature] Update o1 evaluation with JudgeLLM (open-compass#1795)

  Show description for 98435dd
  tonysy

  authored
  98435dd

  Copy full SHA for 98435dd

• [Feature] Support G-Pass@k and LiveMathBench (open-compass#1772)

  Show description for 8e8d4f1
  jnanliu

  authored
  8e8d4f1

  Copy full SHA for 8e8d4f1

Commits on Dec 27, 2024

• [Update] Add 0shot CoT config for TheoremQA (open-compass#1783)

  MaiziXiao

  authored
  42b54d6

  Copy full SHA for 42b54d6

• [Fix] Fix model summarizer abbr (open-compass#1789)

  Show description for 357ce8c
  bittersweet1999

  authored
  357ce8c

  Copy full SHA for 357ce8c

• [CI] Pypi deploy workflow update (open-compass#1786)

  MaiziXiao

  authored
  ae9efb7

  Copy full SHA for ae9efb7

• [CI] Update deploy python version (open-compass#1784)

  MaiziXiao

  authored
  f103e90

  Copy full SHA for f103e90

Commits on Dec 26, 2024

• [ci] remove daily step retry and update pr score (open-compass#1782)

  Show description for ebeb578
  zhulinJulia24

  authored
  ebeb578

  Copy full SHA for ebeb578

• [Update] Volc status exception handle (open-compass#1780)

  Show description for 56eaac6
  MaiziXiao

  authored
  56eaac6

  Copy full SHA for 56eaac6

Commits on Dec 25, 2024

• [ci] remove testcase into volc engine (open-compass#1777)

  Show description for c48bbde
  zhulinJulia24

  authored
  c48bbde

  Copy full SHA for c48bbde

Commits on Dec 19, 2024

• [Update] Update OC academic 202412 (open-compass#1771)

  Show description for ebefffe
  MaiziXiao

  authored
  ebefffe

  Copy full SHA for ebefffe

• [Update] Customizable tokenizer for RULER (open-compass#1731)

  Show description for d70100c
  changlan

  authored
  d70100c

  Copy full SHA for d70100c

• [Fix] Fix Local Runner Params Save Path (open-compass#1768)

  Show description for 4993028
  jnanliu

  authored
  4993028

  Copy full SHA for 4993028

Commits on Dec 18, 2024

• [Fix] Fix lark reporter issue (open-compass#1769)

  HAOCHENYE

  authored
  9a5adbd

  Copy full SHA for 9a5adbd

Pagination

Previous

Next