Repositories list

• evalplus

  Public
  Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

  testingbenchmarkefficiency+ 4program-synthesisgpt-4large-language-modelschatgpt

  Python

  •

  Apache License 2.0

  •116•1.3k•44•1•Updated Jan 6, 2025Jan 6, 2025

• evalplus.github.io

  Public
  HTML

  •

  Apache License 2.0

  •6•11•0•0•Updated Dec 26, 2024Dec 26, 2024

• repoqa

  Public
  RepoQA: Evaluating Long-Context Code Understanding

  Python

  •

  Apache License 2.0

  •3•103•2•2•Updated Nov 1, 2024Nov 1, 2024

• repoqa_release

  Public
  Apache License 2.0

  •1•0•0•0•Updated Oct 7, 2024Oct 7, 2024

• evalperf_release

  Public
  Apache License 2.0

  •0•0•0•0•Updated Aug 6, 2024Aug 6, 2024

• humanevalplus_release

  Public
  Release repository for HumanEval+ data

  Python

  •

  Apache License 2.0

  •1•3•0•0•Updated May 1, 2024May 1, 2024

• mbppplus_release

  Public
  Release repository for MBPP+ data

  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Apr 17, 2024Apr 17, 2024

• Cirron

  Public
  Cirron measures how many CPU instructions and system calls a piece of Python code executes.

  C

  •4•0•0•0•Updated Feb 18, 2024Feb 18, 2024