TAAFT
Free mode
100% free
Freemium
Free Trial
Deals

WildDet3D

By Ai2
WildDet3D is an open-world monocular 3D detection model from Ai2 built for spatial intelligence from a single image. It accepts text prompts, point prompts, and 2D bounding boxes, then predicts full 3D boxes for the requested objects. Its architecture combines a SAM3-based promptable 2D detector, a DINOv2-based geometry backend with a trainable depth decoder, and a 3D detection head that fuses detections with depth-aware features. Ai2 says it generalizes across camera types without fine-tuning, can incorporate sparse depth at inference time, and is released alongside WildDet3D-Data with over 1 million images and 3.7 million verified 3D annotations across more than 13K categories.
New 3d Gen 1
Released: April 8, 2026

Overview

WildDet3D is Ai2’s open model for monocular 3D object detection from a single RGB image. It predicts full 3D bounding boxes, including position, size, and orientation in metric coordinates, and supports flexible prompts such as text queries, point clicks, and 2D boxes. It is designed for open-world spatial understanding across varied cameras and can also use optional depth signals when available.

About Ai2

Ai2 is a 501(c)(3) non-profit AI research institute founded in 2014 by the late Paul Allen (Microsoft co-founder), dedicated to conducting high-impact, open AI research and engineering for the common good, including open language models (OLMo), scientific AI tools (Semantic Scholar, Asta), environmental AI platforms, and embodied robotics research.

Industry: Artificial Intelligence
Company Size: 313
Location: Seattle, Washington, US
Website: allenai.org
View Company Profile

Tools using WildDet3D

No tools found for this model yet.

Last updated: April 16, 2026
0 AIs selected
Clear selection
#
Name
Task