Issues

• Add system prompt

  ml4sts/benchtools#94 · Filter by author AymanBx opened on Oct 28, 2026

• response formatting for bedrock

  ml4sts/benchtools#93 · Filter by author brownsarahm opened on Jun 10, 2026

• betterbench doc

  ml4sts/benchtools#90 · Filter by author AymanBx opened on May 29, 2026

• move example task defaults from init sequence to assets

  enhancement - maintainability
  ml4sts/benchtools#89 · Filter by author brownsarahm opened on May 20, 2026

• tests

  ml4sts/benchtools#88 · Filter by author brownsarahm opened on May 19, 2026
  

• improve support of task adding

  ml4sts/benchtools#87 · Filter by author brownsarahm opened on May 16, 2026

• LLM embedding as a score

  enhancement - scoring
  ml4sts/benchtools#86 · Filter by author brownsarahm opened on May 15, 2026

• possible refactor

  enhancement - models & loggingfuture
  ml4sts/benchtools#84 · Filter by author brownsarahm opened on Apr 27, 2026

• result aggregation and auto report generation

  future
  ml4sts/benchtools#83 · Filter by author brownsarahm opened on Apr 26, 2026

• suport repetitions of runs

  future
  ml4sts/benchtools#82 · Filter by author brownsarahm opened on Apr 26, 2026

• remove depreacted applymap

  ml4sts/benchtools#79 · Filter by author brownsarahm opened on Apr 25, 2026
  1

  

• add token counts

  ml4sts/benchtools#78 · Filter by author brownsarahm opened on Apr 24, 2026

• improve log structure

  enhancement - models & loggingfuture
  ml4sts/benchtools#71 · Filter by author brownsarahm opened on Apr 23, 2026

• configure prompt_id_generator_fx from text

  ml4sts/benchtools#53 · Filter by author brownsarahm opened on Feb 19, 2026

• better subtask ID

  ml4sts/benchtools#49 · Filter by author brownsarahm opened on Feb 17, 2026
  1

• tasks with assets like images

  ml4sts/benchtools#44 · Filter by author brownsarahm opened on Feb 16, 2026
  2

• Regex evaluator function

  ml4sts/benchtools#37 · Filter by author brownsarahm opened on Feb 15, 2026

• rework about/readme

  ml4sts/benchtools#33 · Filter by author brownsarahm opened on Feb 15, 2026
  

• print

  ml4sts/benchtools#30 · Filter by author brownsarahm opened on Feb 14, 2026

• Importing datasets

  ml4sts/benchtools#26 · Filter by author AymanBx opened on Feb 14, 2026
  

• Agent evaluation

  ml4sts/benchtools#2 · Filter by author brownsarahm opened on Mar 4, 2025