They are trained on these "benchmarks", that's why they score better. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		coliveira 6 months ago \| parent \| context \| favorite \| on: Huawei releases an open weight model trained on Hu... They are trained on these "benchmarks", that's why they score better.

elzbardico 6 months ago [–]

If they were trained on those benchmarks they would score 100%

coliveira 6 months ago | [–]

They show how bad they are, they cannot score 100% on benchmarks they were trained on.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact