Skip to content
Clothsy AI Talk to us

Data and responsibility7 min readFabricVTON Research

Where training data comes from

Most public try-on datasets are licensed for research only. Why provenance, consent and privacy shape how a commercial try-on model has to be built.

A try-on model learns from pairs: a garment, and a person wearing it. Where those images come from decides more than quality. It decides whether a model can be used commercially at all, whether the people in the images agreed to be there, and whether the businesses and shoppers using the product can trust it. This post is about how we think about that, and why it shapes how a commercial try-on model has to be built.

The public datasets

The research field grew up on a few public datasets, and they were essential to its progress. They are also, by design, not for commercial use. The dataset released with VITON-HD is under a Creative Commons non-commercial licence [1]. Dress Code, which extended coverage to lower-body garments and dresses, restricts use to academic, non-commercial research, teaching and publication [2].

Those terms are reasonable for datasets built from fashion imagery for research. For anyone building a product, they mean the most convenient training data is off the table. We read those licences as ruling out training a model we sell to businesses, and we think the field is better for being clear about it.

Provenance

The alternative is slower and more expensive: build data you have the right to use, and keep a record of where every sample came from. In practice that means a mix of sources, such as catalogue images licensed by their owners for training, photo shoots commissioned for the purpose, and synthetic images rendered from 3D garments.

SourcesClear rightsCatalogue images licensed for training, commissioned shoots, synthetic renders.
ChecksLicence and consentConfirm commercial-use terms, and a signed release for every person shown.
RecordPer-sample lineageWhere each image came from and under what terms, kept with the data.
UseTraining setOnly samples that pass every check.

Never in trainingPhotos shoppers upload to try something on.

Figure 1Clean-provenance data. Every training sample should be traceable to a source we have the right to use, and shopper photos stay out of training entirely.

Per-sample lineage sounds like bookkeeping, and it is. It is also what lets you answer, for any image, “where did this come from, and under what terms?” That question comes up in partnerships, in audits and in any serious due diligence, and it is very hard to answer after the fact.

Try-on data is full of people. A person in a training image should have agreed to that use, through a signed release that covers training machine-learning models. That is a higher bar than the permission needed to show a photo on a product page, and it has to be designed into a shoot from the start, not added later.

Shopper photos

There is one source of images we deliberately keep out of training: the photos shoppers upload to try something on. People share those photos to see a product on themselves, not to improve anyone’s model. The try-on is what they asked for, and that is all the photo is used for. Our shopper privacy notice sets out exactly how those photos are handled.

Labelling what is generated

A try-on image is generated. It shows how a garment could look, not a photograph of a real fitting, and it should be presented that way. Open standards for content provenance, such as C2PA’s Content Credentials, let images carry a record of their origin and edits [3]. Regulation is moving the same way: the EU AI Act’s transparency rules in Article 50, which apply from August 2026, include obligations to mark AI-generated images [4].

We think these are good constraints. A model built on clean data, with clear consent, that keeps shoppers’ photos private and labels its output honestly is one that people and businesses can rely on. That is the kind of model we want to build.

References

  1. Choi et al. VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization. CVPR, 2021.
  2. Morelli et al. Dress Code: High-Resolution Multi-Category Virtual Try-On. ECCV, 2022.
  3. Coalition for Content Provenance and Authenticity C2PA: an open technical standard for the origin and edits of digital content. c2pa.org, 2024.
  4. European Union Regulation (EU) 2024/1689 (Artificial Intelligence Act), Article 50. Official Journal of the EU, 2024.

JOIN THE RESEARCH TEAM

Work on the open problems with us.

Students, researchers and engineers. The application takes about two minutes.