Tag: Benchmark

12 entries

RoboCasa

Large-Scale Household Manipulation Simulation Framework / Generalist Robot Training and Benchmark
A large-scale household manipulation simulation framework from UT Austin and NVIDIA; the RoboCasa365 release ships 365 tasks across 2,500+ kitchen scenes with 600+ hours of human and 1,600+ hours of synthetic demonstrations for systematic benchmarking of generalist robot policies.
New MIT (code); CC BY 4.0 (assets and datasets); embeds Apache-2.0 MuJoCo portions Robot SimulationEmbodied AISynthetic Data

ABC Dataset: A Million-Scale Parametric CAD Benchmark

CAD Geometric Deep Learning Dataset / Parametric B-rep Ground-Truth Benchmark
A one-million CAD model dataset released at CVPR 2019, where every model is a collection of explicitly parametrized curves and surfaces providing ground truth for normals, curvature, patch segmentation and shape reconstruction; it is a core benchmark for geometric deep learning and generative CAD.
New MIT for the dataset; CAD model copyright held by original creators; GPL for the processing pipeline CADGeometric Deep LearningB-rep

ClimateLearn: Benchmarking Machine Learning for Weather and Climate

Climate ML Benchmarking Library
An open-source PyTorch library from the UCLA Machine Intelligence Group that standardizes access to ERA5, CMIP6 and PRISM data, baseline models, metrics and visualizations for reproducible large-scale benchmarking of statistical downscaling and temporal forecasting.
New MIT ClimateMachine LearningBenchmark

NIST AM Bench Additive Manufacturing Benchmark

Additive Manufacturing / Benchmark Dataset
The NIST-led additive manufacturing benchmark series tests melt-pool, residual-stress and microstructure models through controlled machines, standardized artifacts and blind challenges, with nine benchmark sets and 85 challenge submissions in 2025.
New Public data (U.S. NIST, public domain) Additive ManufacturingMetal 3D PrintingBenchmark

PDEBench Scientific Machine Learning Benchmark

General SciML / Benchmark
A unified benchmark (Takamoto et al. 2022) spanning 12+ PDE families that turns "is this operator-learning model good" into comparable numbers.
New See LICENSE file BenchmarkDatasetNeural Operator

PDECert Natural-Candidate Pilot Benchmark

ScientificML
A provenance-bearing benchmark for verifying symbolic candidate solutions to PDEs, containing 20 records with generator outputs, verification cases, and human annotations for assessing symbolic solver reliability.
See LICENSE file PDESymbolic SolvingBenchmark

PDEBench

PDE Benchmark / Multi-Equation
Large-scale PDE benchmark covering heat, advection-diffusion and fluid dynamics - supports fair comparison of data-driven and physics-informed methods.
MIT License BenchmarkPDECFD

TIDE

3D Turbulence (DNS Validation)
2026 3D turbulent DNS benchmark with 5 tasks and controlled generalization splits, designed to test extrapolation of turbulence models.
MIT License TurbulenceDNS3D

PDEArena

PDE Benchmark / Differentiable Solver
Microsoft Research's open-source PDE benchmark suite with differentiable solvers and spatiotemporal dynamics data for evaluating long-horizon rollout stability.
MIT PDEBenchmarkDifferentiable Solver

The Well

Multiphysics / PDE - 16 Domains
Unified benchmark spanning 16 physical domains, dubbed the 'ImageNet moment of physical ML', with PyTorch API, pretrained baselines and HF streaming.
Per subset (mostly CC-BY / code MIT) MultiphysicsBenchmarkPyTorch

← All Tags