PhysicsQA Reasoning Dataset

New
License: Apache-2.0 · Updated 2026-11-05
My rating

PhysicsQA is a curated dataset of 370 high-school physics questions sourced from open resources. The questions are deliberately hard: they typically require applying several concepts together, carrying out non-trivial calculations, and performing multi-hop reasoning rather than single-step recall. Each question is paired with a comprehensive step-by-step solution, so the dataset supports both evaluation of LLM physics reasoning and supervised fine-tuning on worked derivations. The questions span a diverse range of topics and complexity levels, giving a more robust basis for analyzing model performance than single-topic sets. PhysicsQA accompanies the paper *Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agents* (arXiv:2412.00821, AAAI 2026).

Format: a single JSON file (PhysicsQA.json) with the question and its worked solution, loadable directly with the datasets and pandas libraries. License: Apache-2.0.

Tags: