Clothes are objects that change shape when people wear them.
Garments stretch over shoulders, bunch at elbows, tuck into waistbands and disappear under jackets. Hands, hair and bags cover them. A try-on has to reason about all of it: what is in front of what, and how contact changes shape.
The same questions reach beyond clothing, to how any object that is held, worn or carried interacts with a body. Research datasets of people handling objects capture this in 3D. We study the parts of it that show up in a single photograph, starting with layering and occlusion in outfits.
Questions we are exploring
- How do we decide what belongs in front: hair over a collar, a hand over a pocket, a jacket over a shirt?
- How do we try on several garments at once and control how they are layered and styled?
- How does contact, like a strap on a shoulder or a belt at the waist, change the shape of what is worn?
Further reading
- Zhu et al. M&M VTO: Multi-Garment Virtual Try-On and Editing. CVPR, 2024.
- Lee et al. High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions. ECCV, 2022.
- Bhatnagar et al. BEHAVE: Dataset and Method for Tracking Human Object Interactions. CVPR, 2022.
