Offsec Evals: Growing Up In The Dark Forest
If you contribute a public benchmark, are you giving free capability to your competitors?
If you contribute a public benchmark, are you giving free capability to your competitors?
Distributed training sans datacenter.
We tried RL once. It didn’t work. I’m confident it will this time.
An attempt to explain why benchmarks are either bad or secret, and why the bar charts don’t matter so much.
So, you mixed user input and instructions.