1
Data driven creation
difficulty
Hard to combine pieces, no understanding of visual realism.
Different distribution on different sources.
The richness of real world. (complex) 2D projection on 3d world.
Computer graphics
great creative possibilities
easy to manipulate objects/viewpoint
tremendous expertise and effot to obtain realism.
Photography
Instantly realistic
easy to acquire
hard to manipulate objects/viewpoint.
Want realism, manipulation and ease of capture.
Goal: Help everyone create visual context easily.
Teach machines to create realistic content.
today: pretty real. data-driven graphics.
Ingredients for success today:
big compute (gpus)
big models (dnns)
big data
Highlights:
image to image translation - pix2pix. (GANs) input can be translated into other view.
Style transfer -> image + styleize it by taking a reference image.
View interprolation ( change view)
Text-based image editing.
Diffusion Models. Create photorealistic scenes.
Last updated