Skip to main content
JBJB1029
Known Participant
December 13, 2021
Question

How to Convert a Live Action Video into Anime

  • December 13, 2021
  • 7 replies
  • 18054 views

How do I use The Cartoon Effect in Adobe After Effects to Convert a Live-Action Video into an Anime Video (OR is there a Better Way to accomplish this task, and if there is, How do I go about doing it)?

7 replies

Participant
December 1, 2024

How i love ja ja ja ja japan anime Bad desin

Participant
September 19, 2024

"If you're looking to convert a live-action video into anime, there are several ways to go about it. Using specialized software like Adobe After Effects or AI-based tools such as EbSynth can help you achieve that anime-style look. You'll need to focus on frame-by-frame editing to really capture the unique aesthetic of anime. It can be a time-consuming process, but the results are often worth it!

For anyone who loves anime and wants to dive deeper into the world of animated storytelling, feel free to visit Aniwatch for a wide selection of anime series and films. Happy watching!"

Joost van der Hoeven
Community Expert
Community Expert
December 19, 2021

Out of the box:

You can install https://snapcamera.snapchat.com/ on your computer and use the anime lens. Then install a tool like splitcam and apply the lens to an existing video.
https://www.youtube.com/watch?v=0zoZ-Ap4FHc

 

 

JBJB1029
JBJB1029Author
Known Participant
December 20, 2021
quote

Out of the box:

You can install https://snapcamera.snapchat.com/ on your computer and use the anime lens. Then install a tool like splitcam and apply the lens to an existing video.
https://www.youtube.com/watch?v=0zoZ-Ap4FHc

 

 


By @Joost van der Hoeven

And does this video at https://www.youtube.com/watch?v=0zoZ-Ap4FHc explain how to Convert a Live Action Video into Anime?

JBJB1029
JBJB1029Author
Known Participant
December 17, 2021

@Mrtn Ritter(&) @Mylenium, (and @ShiveringCactus), I suggested an Effect for Boris FX to create called "BCC Anime Look": A filter that would be designed to emulate the look of rotoscoped Anime (Japanese: アニメ, IPA: [aɲime]). To give a Live-action Footage [an/that] Anime Look. As you can see in these videos (Below):

And guess what? Jonathan from Boris FX said that it's pretty cool and that he'll pass it along. However, if they end up making it, it would likely be months away or more. But I gave them some additional information that may help speed up its creation.

Mrtn Ritter
Participating Frequently
December 17, 2021

That is cool, but all those videos show pretty impressive the state of this technique. None of those KIs are getting close to the look and feel of actual drawn anime. They all do look more of less like the carton filter of photoshop.

 

*Martin

JBJB1029
JBJB1029Author
Known Participant
December 17, 2021

Is that a Good thing or a Bad thing @Mrtn Ritter?

ShiveringCactus
Community Expert
Community Expert
December 15, 2021

Here's a video that popped up on my YouTube front page a while back showing how one guy takes live action footage and converts it to animation.  He uses EBSynth to do the most of the frame-by-frame work.  

 

You could also look at using Character Animator to create a puppet driven by your webcam.  This isn't a full video-in-one-goal option, but gives you a lot of control.

Mylenium
Legend
December 15, 2021

This stuff is simply extremely laborious and if you refer to the "A Scanner Darkly" example Martin referred to you can see armies of artists doing extra roto despite the movie being specifically shot around the cartoon look. Same for pretty much any other VFX work - even if they were created with lots of green screen, markers and other techniques in mind, there's still armies of roto artists, matchmovers and so on sitting there for hours on end every day chewing through frame by frame. and those people have much more sophisticated tools than AE available... So for what it's worth, unless you are willing to put in the work, you cannot expect certain things to happen. If it's too much to do yourself, then find collaborators or hire other professionals, but otherwise you may simply need to get to grips with the fact that your cool Anime style YouTube video may take weeks or months even instead of just a few days.

 

Mylenium

Mylenium
Legend
December 13, 2021

You're asking too simple a question, no offense. This extends just as much to how you shoot your footage in the first place, what specific look you are after and what additional techniques you plan on using. As you would imagine, it's going to be much easier to convert a well-lit cosplay costume with bright colors in front of a green screen than doing the same for a dark everyday attire in a shadowy alley. Rinse repeat for other things that influence how you even acquire the footage like on-set markers for tracking, additional effects lighting, scene blocking or the camera's capabilities. Conversely, in post it matters how quickly and easily you are able to extract the characters and then how much time you want to spend to do further masking for color corrections, separating individual areas for color ing/ texturing, creating more shapes and masks for additional contours and speed lines and so on. In short: This is much more complex if it's supposed to look good and basically one of those things where advising on specific steps and techniques would require to know what look you have in mind vs. what footage you have/ are able to shoot. Outside that of course you can endlessly watch YouTube tutorials and then piece the techniques together to apply to your project, but there's really no way to explain this in 5 minutes in a few short sentences. These things take practice and experience.

 

Mylenium

JBJB1029
JBJB1029Author
Known Participant
December 13, 2021

So (for example), how do I make these Live Action Footages:

Into Anime like this?

@Mylenium?

Mrtn Ritter
Participating Frequently
December 13, 2021

Rotoscoping is the answer.

 

See this video from "A scanner darkly", where this techinque was used to create an anime style look from actual (greenscreen) footage:

https://www.youtube.com/watch?v=eke5VnpNcNk

 

Keep in mind, that Hamtaro was drawn in the first place. No effect nor KI from the current state will be able to recreate such a thing from footage, especially if it wasn't filmed for this purpose like the example of Sinister 2. Outlines will be shaky, foreground and background merge into each other and a lot of splill.

 

For highest quality like in Hamtaro, you need to redraw your footage.

 

*Martin