Our benchmark has a failure section. On purpose.
The trail-learning convergence criterion was not met, and it is in the report anyway. A benchmark you can only pass is not a benchmark.
3 min read
Blog
Notes from the forest
Engineering notes on navigation, ingestion, agent memory and honest benchmarking, written by the people who ran the experiments.
Want the long version?
The paper carries the full architecture, the benchmark tables and the findings that failed their criteria.