Search results

Can't reproduce results from the paper

Status: Open.

#80 In NVIDIA/RULER;

· eldarkurtic opened on Jan 16, 2025

Does it really take 2 days to evaluate llama-3.1-8b at 128k length?

Status: Open.

#79 In NVIDIA/RULER;

· eldarkurtic opened on Jan 16, 2025

Add new cohere R7B model (Interesting architecture and positional encoding)

Status: Open.

#78 In NVIDIA/RULER;

· faresobeid opened on Dec 17, 2024

Rough runtime benchmarks across tasks and context-lengths on any hardware setups

Status: Open.

#76 In NVIDIA/RULER;

· girishbalaji opened on Dec 3, 2024

Evaluate on Jamba-1.5-Mini

Status: Open.

#69 In NVIDIA/RULER;

· coranholmes opened on Sep 24, 2024

Note about Mistral models

Status: Open.

#67 In NVIDIA/RULER;

· inflatebot opened on Sep 20, 2024

Gemini flash 1.5 results

Status: Open.

#43 In NVIDIA/RULER;

· augusto-rehfeldt opened on Jul 31, 2024

gpt-4o results?

Status: Open.

#12 In NVIDIA/RULER;

· the21st opened on May 16, 2024

Raw scores?

Status: Open.

#10 In NVIDIA/RULER;

· WesleyYue opened on May 14, 2024