Taobao3D
We are dedicated to advancing and applying 3D and XR technologies, delivering high-performance, scalable solutions that enable next-generation digital experiences.
What we work on
Our work spans the full 3D and XR stack, from algorithm research to engines and applications.
3D Foundation Model
High-fidelity 3D model generation for general product categories.
- Geometry reconstruction: sculpture-grade 3D mesh generation with rich detail and excellent geometric consistency, closely matching real physical structure.
- Material foundation model: PBR material decomposition via a 3D-native material foundation model, producing high-resolution texture maps that faithfully reproduce fine details such as text and logos, with accurate modeling of transparent and translucent materials.
- Multimodal 3D generation: fusing text, image, and video inputs to guide 3D content generation more precisely, significantly improving generalization and geometric fidelity (including structural proportions and occluded-region completion).
- Polygonal mesh generation: directly generating professional-grade 3D meshes in native 3D coordinate space, with component-based modeling for industrial-grade precision.
Photorealistic 3D Avatars
High-fidelity, drivable, and easily editable 3DGS avatar generation and interaction.
- 3DGS drivable reconstruction: fusing multi-view capture, SMPL-X geometry priors, and 3DGS dynamic representation to build photorealistic 3D avatar assets driven by voice, gesture, and motion.
- 4DGS volumetric video: going beyond clothing and hairstyle constraints, capturing complex physical motion of skirts, hair strands, and loose garments via temporal dynamic reconstruction for greater expressiveness and creative freedom.
- Feed-forward 3D avatars: single- and multi-image feed-forward inference, enabling integrated editing such as natural skeletal animation, face makeup, and clothing swaps.
- Business applications: serving the Taobao Vision Future Flagship Store as 3D shopping-guide avatars, and partnering with brands such as PYX and Milan Winter Olympics · Li-Ning as 3D apparel-model avatars.
On-device 3D Engine
An in-house, cross-platform 3D engine — full-featured, easy to use, and battle-tested across many businesses.
- Runtime: supports major graphics backends including Metal, Vulkan, OpenGL, and WebGL, with a TypeScript API to lower the barrier for business development.
- Workflow: a complete production pipeline, from modeling-assistant plugins to automatic model optimization, working closely with the runtime to enable scalable production of high-quality 3D assets.
- 3D Agent: powered by VLMs, AI coding, and 2D/3D generation, and built on AceNNR's in-house engine and workflow, the 3D Agent accelerates low-barrier, lightweight-interaction yet high-quality 3D application development.
- Business applications: shipped across many businesses, including Kuou (3D model preview), Taobao Life (Dunhuang Museum, Disney 100th Anniversary, Taobao Life 2), Mobile Tmall 3D, Tmall New Products, Taobao Vision, and the Chaoying Project.