Channel: DisneyResearchHub

Category: Science & Technology

Tags: image processingcostume fi‹inginpaintingshape estimationdisney researchaugmented realityimage manipulationmotion capturecostume augmentation

Description: We describe a method to automatically augment a watertight digital costume onto a person’s body from a monocular RGB image. When overlaying a digital costume onto a body using pose matching, several parts of the person’s cloth or skin remain visible due to differences in shape and proportions. In this paper, we present a practical solution to these artifacts which requires minimal costume parameterization work, and a straightforward inpainting approach. To our knowledge, our approach is the first to deliver plausible watertight costumes from RGB imagery only, and is compatible with mobile devices. We believe this can serve as a useful baseline for future improvements and comparisons. Link to publication page: disneyresearch.com/publication/ar-costumes