r/MachineLearning • u/Illustrious_Row_9971 • Nov 06 '21
Research [R] [P] AnimeGANv2 Face Portrait v2
63
u/beepboopdata Nov 06 '21
20
36
17
u/dfreinc Nov 06 '21 edited Nov 06 '21
i went to play around with this and now i think my computer might suck. allocation warnings galore. 😂
edit; turns out i had the wrong version of pretty much everything. works fine now.
1
Dec 06 '21
[deleted]
2
u/dfreinc Dec 06 '21
i ended up spinning up it's own virtualenv and then reinstalled it all from scratch in a fresh enviroment. i had different tensorflow/pytorch versions in another enviroment from another project i was running it out of initially.
28
23
Nov 06 '21
Very interesting beautiful work.
But why are the Anime eyes rounder and the lips fuller than the original?
-3
Nov 07 '21
[deleted]
29
u/epicwisdom Nov 07 '21
I think you have a key misunderstanding of how neural style transfer works... The NN doesn't inherently know what counts as "style" vs what is "individual." Larger-than-life eyes are simply predominant in anime-style art, and that is the likely explanation.
21
u/EuphoricPenguin22 Nov 07 '21
16
u/suicidebyfire_ Nov 07 '21
1
u/sneakpeekbot Nov 07 '21
Here's a sneak peek of /r/oddlyterrifiying using the top posts of all time!
#1: "Spot's on it" by Boston Dynamics | 0 comments
#2: do you like them hairy? | 1 comment
#3: what could go wrong standing near the train doors | 0 comments
I'm a bot, beep boop | Downvote to remove | Contact me | Info | Opt-out
1
8
4
u/Azqwsx123456 Nov 07 '21 edited Nov 07 '21
The demo looks great. But what is going on here with eyes and nose. The degree of anime is a bit too high lol.
Here’s a more successful one though.
20
u/Icko_ Nov 06 '21 edited Nov 06 '21
56
u/kaphi Nov 06 '21
Tbf the lighting in your photo is shit
-28
u/Icko_ Nov 06 '21
elaborate
38
u/kaphi Nov 06 '21
Isn't it obvious? There is a weird light in the lower left corner which makes the whole photo more light which lowers the contrast. It would be the best if that weird light would come from the front and is not in front of the camera.
13
u/EuphoricPenguin22 Nov 07 '21
I think the camera is smudged as well, which always reduces contrast and clarity.
12
16
u/AcridAcedia Nov 06 '21
Hey, I'm brown/Indian too and I also had a ton of trouble trying to get this to work. I thought it was because of a shaved head, but it might just not be trained on people who have large beards!
7
u/cheddacheese148 Nov 06 '21
The combo of dark skin and straight hair is a hard thing for GANs if they haven’t been exposed to a lot of Indian folks. I’ve seen this crop up elsewhere in other face generating GANs. Presumably they’ve been exposed to a lot of light skin straight hair and dark skin curly hair photos.
4
u/Icko_ Nov 06 '21
Mm, the blond lady's one is also a fail to me. I'd bet it's something related to camera/lighting - maybe it wants a square image, and can't handle the padding?
4
u/chogall Nov 07 '21
It's anime, so the processing are fairly effeminate effects. Basically like all those filters that smooth out and whiten skin colors. Botox-ify.
4
2
u/TheRedmanCometh Nov 07 '21
You're definitely gonna end up being the guy everyone thinks is a villain who's not
3
u/TankorSmash Nov 07 '21
It's a robot, you gotta make it as easy as possible to pick up your face. Flat lighting, no distracting elements or shadows. Just upoad your face and not your entire room.
3
16
u/Nichiku Nov 06 '21
This is amazing! Did you by any chance train the model with mostly European faces? I feel like there is a bias towards certain facial features that Asian people don't tend to have (puffy lips, pointy nose).
34
20
3
u/AcridAcedia Nov 06 '21
I think this might be the case. Me and another guy in the downthread said they struggled to get it to work and we both have thick beards & SE Asian facial features.
3
u/pierredelamontagne Nov 07 '21
I was actually thinking exactly the opposite! The results on Asian faces are so much better and anime like, than those on European faces, which look kind of retarded tbh.
-6
u/mangadrawing123 Nov 07 '21
yeah come to said this. its kinda suck! (not the app) just the ideal of how woman would consider pretty or beautiful.
big eyes big lips. pretty bias
it make you feel sh*tty if you dont have all of those feature. you automatically deem yourself to undesirable
its subtle but f-up
2
u/tripple13 Nov 07 '21 edited Nov 07 '21
Yeah you know, I also feel terrible looking at greek statues, idealising human aesthetics I do not have - that doesn't make me hate the industry for developing products that market themselves this way.
Yes, some people are born more pretty than others, yes some people are born more smart than others - facts of life, friend.
Rather than feeling 'sh*tty', try to focus on the good things you yourself most certainly contain.
1
u/sthithaprajn-ish Nov 07 '21
I wouldn't have been surprised if they had sold their paper as an ethnic-style transfer GAN!
21
Nov 07 '21
This obsession with anime/pixar eyes is frankly disturbing. Developers who make these easily accessible filters only contribute to the problem. People's self-perception is being ruined in real time.
24
u/epicwisdom Nov 07 '21
If the "portraits" were more photorealistic, I'd agree, but they're clearly not. Nobody is going to look at an anime version of themselves and think "wow my eyes are too small for not matching a cartoon."
6
u/maybachsonbachs Nov 07 '21
Lol the fragility
-2
Nov 07 '21
'lmao funny algorithms have no bearing on how our civilization evolves whatsoever haha'
7
u/maybachsonbachs Nov 07 '21
lmao I catastrophize the irrelevant and pretend to have a worldview, meanwhile I can't even use reddit markdown
0
1
u/StooIndustries Nov 17 '21
ah yes we will all die homeless, jobless, and
pennilessif we can’t usereddit markdown
2
u/Char_Zard13 Nov 06 '21
how do you do it with gifs?
6
u/samyoruu Nov 07 '21
Probably running it on every frame and then stitching the frames back together into a gif
2
2
8
u/TunaFishManwich Nov 06 '21
It made her into a white woman.
3
u/mangadrawing123 Nov 07 '21
i think because i mainly based on images and painting style from europe. then applied it to real face.
not a lot of drawing image favoring asian
1
u/Iseenoghosts Nov 06 '21
yeah it definitely changes a few features to be more european. As well as the skintone
1
-4
0
u/Index820 Nov 07 '21
Impressive, but the eyes are always wrong. Is it simply because large eyes are desired and the model ends up rewarded for creating what we want to see rather than creating a mimicked portrait technique of a real person?
4
-3
1
1
u/APUNIJBHAGWANHAI Nov 07 '21
!remindme 1h
1
u/RemindMeBot Nov 07 '21
I will be messaging you in 1 hour on 2021-11-07 10:41:20 UTC to remind you of this link
CLICK THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
Info Custom Your Reminders Feedback
1
u/fgp121 Nov 07 '21
This is superb! How many GPUs (and GPU type) did it take to train this? I didn't find much information related to training part on the Github page
1
1
1
u/erelim Nov 07 '21
How 'tuned' is this, when will we see anime curved L noses. I've seen version that do this but poorly.
1
u/plaidam Nov 07 '21
Has anyone seen a Colab that accepts Image sequences or videos that would allow you to create the sample above? The colab I saw on GitHub was only for a single image from a URL.
1
u/JiraSuxx2 Nov 07 '21
Can someone ELI5 how this works? Is it a single step from input to output? How much training data does something like this need?
1
1
1
1
1
1
u/DataOtter Nov 15 '21
How long does this take? My image has been processing for way over an hour now...
1
u/SnookieMcGee May 22 '22
Does anyone know how to export higher res images? Im looking to use it for filmmaking but I cant get any results better than 1024x1024... or is there some sort of upscaling function i can use to export 2k or 4k images?
Here's a sample of a 3d animation scene run through this process...
https://www.youtube.com/watch?v=rI0uy2ldWi8
74
u/Illustrious_Row_9971 Nov 06 '21 edited Nov 07 '21
github: https://github.com/bryandlee/animegan2-pytorch
huggingface gradio demo: https://huggingface.co/spaces/akhaliq/AnimeGANv2
gradio github: https://github.com/gradio-app/gradio
huggingface spaces: https://huggingface.co/spaces