GDPval: Measuring AI Performance on Real-World Work

The September 25 2025 dated sources introduce **GDPval**, a novel benchmark created by OpenAI to evaluate the performance of **AI models** on **economically valuable, real-world tasks**. This evaluation spans **44 knowledge work occupations** across the top nine sectors contributing to the U.S. GDP, using tasks meticulously crafted by experienced industry professionals. Results indicate that the best **frontier models** are approaching human expert quality on these tasks, with models like Claude Opus 4.1 and GPT-5 demonstrating strengths in different areas, such as aesthetics and accuracy, respectively. Furthermore, the analysis suggests that integrating AI can potentially lead to **significant speed and cost improvements** in expert workflows, while noting that model performance is still limited by the real-world complexity of multi-draft and ambiguous tasks. Finally, OpenAI is **open-sourcing a subset of tasks** and an automated grader to facilitate further research in tracking AI capabilities.Sources:https://openai.com/index/gdpval/https://cdn.openai.com/pdf/d5eb7428-c4e9-4a33-bd86-86dd4bcf12ce/GDPval.pdf

There are no comments yet.

Please log in to write the first comment.