im2hyperdrawing

project

im2hyperdrawing
by Youngwook Paul Kwon

overview &
motivation

This work is motivated by an Italian artist Marcello Barenghi's video about hyperrealistic (3D illusion) art in the Internet. Starting an empty paper, it shows the hyperrealistic drawing process. The drawings ends up with photo-like scenes. You can see here:
m&m's
Snikers bar

I also screen capture a few moments from his m&m's video:

Isn't it cool?

My goal is to mimic the process and generate it in faking manner. It is really remarkable for humans to reproduce precisely a photo-like scene that might be in their brain. How about computer? If a computer has an input scene, reproducing it precisely is too easy to the computer. Maybe just one line of MATLAB code. But my question is that:
"Can I generate such an process (video) so that it looks like someone's drawing starting from an empty paper and ending with a photo-like scene (which is actually the original input image)?"
How would it be nice if we can generate the video (e.g., for your photo or a commercial film) without hiring such experienced (and expensive) artists?

algorithm

- Poisson blending
- Mean-shift segmentation
- Canny edge detection
- (incomplete explanation for now)

results

For a current result, you can see the video HERE!

As an input, I took an image of a real can of coke on a paper, as shown in below. This will be the final status of the generated drawing.

Let's generate a drawing process for the can of coke. These are some screen shots from my current results (video).

Now input is a bag of Twix. I also tried to combine with a video for more dramatic scenes. It starts drawing on an empty paper, and finally one grabs the Twix in real. You can see the video HERE!