HumanEval

164 hand-written Python programming problems scored by running unit tests. The classic code-generation benchmark.