【DragGan】Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Abstract
Synthesizing visual content that meets users’ needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existing approaches gain controllability of generative adversarial networks (GANs) via manually annotated training data or a prior 3D model, which often lack flexibility, precision, and generality. In this work, we study a powerful yet much less explored way of controlling GANs, that is, to “drag“ any points of the image to precisely reach target points in a user-interactive manner, as shown in Fig.1. To achieve this, we propose DragGAN, which consists of two main components: 1) a feature-based motion supervision that drives the handle point to move towards the target position, and 2) a new point tracking approach that leverages the discriminative generator features to keep localizing the position of the handle points. Through DragGAN, anyone can deform an image with precise control over where pixels go, thus manipulating the pose, shape, expression, and layout of diverse categories such as animals, cars, humans, landscapes, etc. As these manipulations are performed on the learned generative image manifold of a GAN, they tend to produce realistic outputs even for challenging scenarios such as hallucinating occluded content and deforming shapes that consistently follow the object’s rigidity. Both qualitative and quantitative comparisons demonstrate the advantage of DragGAN over prior approaches in the tasks of image manipulation and point tracking. We also showcase the manipulation of real images through GAN inversion.
1 view
588
167
1 month ago 00:04:05 1
Drying Porcini Mushrooms in the Food Dehydrator
1 month ago 00:03:52 1
Warfare Area 3 - Gameplay - Ans32 Game
2 months ago 00:04:00 1
Лицей - Планета 5 (Официальный клип)
2 months ago 00:02:13 1
Majestic Dragons Merge - Game Video - Ans32 Game
2 months ago 00:05:59 1
Damian ’’ & Stephen Marley, Capleton x Drag-On - It Was Written [Reggaeville Vinyl Vibes #79]
4 months ago 01:11:27 6
Best of 2000s Hip Hop R&B Classics. #DJBEAZY | DJ Club Mix Party Mix 2023 Lil Wayne 50cent DMX T.I.
4 months ago 00:33:20 1
Is what’s happening in the West Bank a third intifada? with Abdaljawad Omar
5 months ago 00:03:59 6
Emma D’Arcy and Olivia Cooke on Sex Scene Mishaps and House of the Dragon season 2 | Cosmopolitan UK
6 months ago 00:04:43 8
The (John) Candy - Arthur Rhodes (Official Music Video)
6 months ago 00:03:58 1
Craig David - Don’t Love You No More (I’m Sorry) (Official Video)
7 months ago 00:14:02 3
RICK OWENS SS24 MENS LIDO
7 months ago 00:03:10 1
ANKOR - Ghosts [OFFICIAL VIDEO]
8 months ago 00:00:50 1
FREE: Awesome Fire Breathing Dragon Animation with Sound Effect Green Screen
8 months ago 00:43:16 1
To Pagham And Beyond - Skin Alley (1970) Full Album
9 months ago 00:03:07 1
Male Pelvic Floor Exercises I Daily Stretching Exercises I Strengthen Your Drag 3
10 months ago 00:04:25 1
Gotus - “Take Me To The Mountain“ Official Music Video
10 months ago 00:01:35 29
Arthur’s Whisky | Official Trailer | Starring Diane Keaton, Patricia Hodge and Lulu
11 months ago 00:04:09 1
Hot Toys Dead Strange Figure Unboxing | First Look
11 months ago 00:00:54 1
World Market News of the 29 December with FXOpen #sp500 #dowjones #nasdaqfutures #chinaeconomy