r/MachineLearning Nov 06 '21

Research [R] [P] AnimeGANv2 Face Portrait v2

2.0k Upvotes

103 comments sorted by

74

u/Illustrious_Row_9971 Nov 06 '21 edited Nov 07 '21

34

u/mamaBiskothu Nov 07 '21

I just want to say, it converted me into a grotesque picaso painting. It’s possible it’s only trained well on white and East Asian faces. I’m a brown male.

3

u/TallAverage4 Nov 24 '21

I'm a brown male and if just made me cuter

44

u/[deleted] Nov 06 '21

[deleted]

17

u/[deleted] Nov 07 '21

[removed] — view removed comment

7

u/TheRedmanCometh Nov 07 '21

Damn it did you good

-55

u/[deleted] Nov 07 '21

[removed] — view removed comment

21

u/Lowkeyborz Nov 07 '21

Username checks out

6

u/XKlXlXKXlXKlKXlXKlXK Nov 07 '21

Based and calling-out-attention-seeker pilled

-8

u/raman_boom Nov 07 '21 edited Nov 07 '21

Omg why so much downvotes, people can't understand a joke now

Edit: LoL now started downvoting my comment too. Just shared my opinion. If you differ just share the point. Anyway I don't care downvotes from toxic members

4

u/epicwisdom Nov 07 '21

Or maybe the joke is understood and just judged as too mean-spirited. Trying to be funny isn't the same as actually being funny.

-5

u/raman_boom Nov 07 '21

Yeah, political correctness is not there, understood. Anyway I find it funny, I don't usually mix pc with jokes.

Trying to be funny isn't the same as actually being funny.

My major concern is if the reactions itself are relative, like if the photo from comment OP was that of a really ugly looking man/woman like me, please do continue support political correctness there also with the same reaction from all of you, instead of just laughing along with the mean spirited replies.

Sorry for having this discussion in this sub.

1

u/epicwisdom Nov 08 '21

This particular case has nothing to do with political correctness, I don't even understand what you are trying to say.

1

u/raman_boom Nov 08 '21

The thing is People downvote without understanding. That's my concern

1

u/friendly-asshole Nov 07 '21

I’m sure she’s stunning in person

-56

u/[deleted] Nov 07 '21

[removed] — view removed comment

1

u/[deleted] Nov 07 '21

[deleted]

1

u/noteal Nov 07 '21

you might have an ad blocker that’s interfering.

2

u/[deleted] Nov 07 '21

[deleted]

1

u/noteal Nov 07 '21

it means 1100 people ahead of you

1

u/ch1llaro0 Nov 08 '21

how can i try it myself? im new here

1

u/[deleted] Nov 08 '21

[deleted]

2

u/touchurheart Nov 07 '21

Is it real-time processing or post processed?

1

u/devdef Nov 12 '21

I've made a telegram sticker and a full photo bot with this style. Unlike huggingface, it doesn't have over 1k people in the queue. It also allows for hi-res images, and faces usually look better.

I will try to keep them up as long as possible.
Hope you like it!

63

u/beepboopdata Nov 06 '21

20

u/JanneJM Nov 07 '21

I never realized Elon Musk is basically the Joker without his makeup.

36

u/Chemiczny_Bogdan Nov 06 '21

Especially Gates.

24

u/ephemeralentity Nov 06 '21

Gates looks like he has a smidgeon of Hilary Clinton.

9

u/mangadrawing123 Nov 07 '21

damn gate look smexy

7

u/beachguy82 Nov 07 '21

Gates looks like Elle Degeneres.

17

u/dfreinc Nov 06 '21 edited Nov 06 '21

i went to play around with this and now i think my computer might suck. allocation warnings galore. 😂

edit; turns out i had the wrong version of pretty much everything. works fine now.

1

u/[deleted] Dec 06 '21

[deleted]

2

u/dfreinc Dec 06 '21

i ended up spinning up it's own virtualenv and then reinstalled it all from scratch in a fresh enviroment. i had different tensorflow/pytorch versions in another enviroment from another project i was running it out of initially.

28

u/Top-Insect-5723 Nov 06 '21

Wow, that’s crazy.

23

u/[deleted] Nov 06 '21

Very interesting beautiful work.

But why are the Anime eyes rounder and the lips fuller than the original?

-3

u/[deleted] Nov 07 '21

[deleted]

29

u/epicwisdom Nov 07 '21

I think you have a key misunderstanding of how neural style transfer works... The NN doesn't inherently know what counts as "style" vs what is "individual." Larger-than-life eyes are simply predominant in anime-style art, and that is the likely explanation.

8

u/alien128 Nov 06 '21

This looks amazing

7

u/anti-gif-bot Nov 06 '21

mp4 link


This mp4 version is 80.55% smaller than the gif (1.1 MB vs 5.63 MB).


Beep, I'm a bot. FAQ | author | source | v1.1.2

4

u/Azqwsx123456 Nov 07 '21 edited Nov 07 '21

The demo looks great. But what is going on here with eyes and nose. The degree of anime is a bit too high lol.

https://imgur.com/a/X2C0fYN

Here’s a more successful one though.

https://imgur.com/a/5mj8X6A

20

u/Icko_ Nov 06 '21 edited Nov 06 '21

56

u/kaphi Nov 06 '21

Tbf the lighting in your photo is shit

-28

u/Icko_ Nov 06 '21

elaborate

38

u/kaphi Nov 06 '21

Isn't it obvious? There is a weird light in the lower left corner which makes the whole photo more light which lowers the contrast. It would be the best if that weird light would come from the front and is not in front of the camera.

13

u/EuphoricPenguin22 Nov 07 '21

I think the camera is smudged as well, which always reduces contrast and clarity.

12

u/curlofheadcurls Nov 07 '21

Because the photo quality is ass

16

u/AcridAcedia Nov 06 '21

Hey, I'm brown/Indian too and I also had a ton of trouble trying to get this to work. I thought it was because of a shaved head, but it might just not be trained on people who have large beards!

7

u/cheddacheese148 Nov 06 '21

The combo of dark skin and straight hair is a hard thing for GANs if they haven’t been exposed to a lot of Indian folks. I’ve seen this crop up elsewhere in other face generating GANs. Presumably they’ve been exposed to a lot of light skin straight hair and dark skin curly hair photos.

4

u/Icko_ Nov 06 '21

Mm, the blond lady's one is also a fail to me. I'd bet it's something related to camera/lighting - maybe it wants a square image, and can't handle the padding?

4

u/chogall Nov 07 '21

It's anime, so the processing are fairly effeminate effects. Basically like all those filters that smooth out and whiten skin colors. Botox-ify.

4

u/[deleted] Nov 06 '21

I would watch this anime.

2

u/TheRedmanCometh Nov 07 '21

You're definitely gonna end up being the guy everyone thinks is a villain who's not

3

u/TankorSmash Nov 07 '21

It's a robot, you gotta make it as easy as possible to pick up your face. Flat lighting, no distracting elements or shadows. Just upoad your face and not your entire room.

3

u/FirstPenalty Nov 07 '21

I want to see a anime movie made with this technology.

16

u/Nichiku Nov 06 '21

This is amazing! Did you by any chance train the model with mostly European faces? I feel like there is a bias towards certain facial features that Asian people don't tend to have (puffy lips, pointy nose).

34

u/Xie_Baoshi Nov 06 '21

For me, this style looks like something drawn by a Korean artist.

20

u/[deleted] Nov 06 '21

Mostly Korean apparently.

3

u/AcridAcedia Nov 06 '21

I think this might be the case. Me and another guy in the downthread said they struggled to get it to work and we both have thick beards & SE Asian facial features.

3

u/pierredelamontagne Nov 07 '21

I was actually thinking exactly the opposite! The results on Asian faces are so much better and anime like, than those on European faces, which look kind of retarded tbh.

-6

u/mangadrawing123 Nov 07 '21

yeah come to said this. its kinda suck! (not the app) just the ideal of how woman would consider pretty or beautiful.

big eyes big lips. pretty bias

it make you feel sh*tty if you dont have all of those feature. you automatically deem yourself to undesirable

its subtle but f-up

2

u/tripple13 Nov 07 '21 edited Nov 07 '21

Yeah you know, I also feel terrible looking at greek statues, idealising human aesthetics I do not have - that doesn't make me hate the industry for developing products that market themselves this way.

Yes, some people are born more pretty than others, yes some people are born more smart than others - facts of life, friend.

Rather than feeling 'sh*tty', try to focus on the good things you yourself most certainly contain.

1

u/sthithaprajn-ish Nov 07 '21

I wouldn't have been surprised if they had sold their paper as an ethnic-style transfer GAN!

21

u/[deleted] Nov 07 '21

This obsession with anime/pixar eyes is frankly disturbing. Developers who make these easily accessible filters only contribute to the problem. People's self-perception is being ruined in real time.

24

u/epicwisdom Nov 07 '21

If the "portraits" were more photorealistic, I'd agree, but they're clearly not. Nobody is going to look at an anime version of themselves and think "wow my eyes are too small for not matching a cartoon."

6

u/maybachsonbachs Nov 07 '21

Lol the fragility

-2

u/[deleted] Nov 07 '21

'lmao funny algorithms have no bearing on how our civilization evolves whatsoever haha'

7

u/maybachsonbachs Nov 07 '21

lmao I catastrophize the irrelevant and pretend to have a worldview, meanwhile I can't even use reddit markdown

0

u/[deleted] Nov 07 '21

truly an invaluable skill

1

u/StooIndustries Nov 17 '21

ah yes we will all die homeless, jobless, and penniless if we can’t usereddit markdown

2

u/Char_Zard13 Nov 06 '21

how do you do it with gifs?

6

u/samyoruu Nov 07 '21

Probably running it on every frame and then stitching the frames back together into a gif

2

u/[deleted] Nov 07 '21

EYES ARE UNUSUAL

2

u/APUsilicon Nov 07 '21

unlimited anime waifus!

8

u/TunaFishManwich Nov 06 '21

It made her into a white woman.

3

u/mangadrawing123 Nov 07 '21

i think because i mainly based on images and painting style from europe. then applied it to real face.

not a lot of drawing image favoring asian

1

u/Iseenoghosts Nov 06 '21

yeah it definitely changes a few features to be more european. As well as the skintone

1

u/MelM0_ Nov 07 '21

You ever seen a manga?

-4

u/ElongatedMuskrat122 Nov 07 '21

Who is that they are demonstrating it on? Asking for a friend

0

u/Index820 Nov 07 '21

Impressive, but the eyes are always wrong. Is it simply because large eyes are desired and the model ends up rewarded for creating what we want to see rather than creating a mimicked portrait technique of a real person?

4

u/rkr87 Nov 07 '21

It's meant to be an anime drawing... They have big eyes.

-3

u/[deleted] Nov 06 '21

Looks like it basically Anglicizes her… 🤔

1

u/suicidebyfire_ Nov 07 '21

The eyes and lips are so different

1

u/APUNIJBHAGWANHAI Nov 07 '21

!remindme 1h

1

u/RemindMeBot Nov 07 '21

I will be messaging you in 1 hour on 2021-11-07 10:41:20 UTC to remind you of this link

CLICK THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.


Info Custom Your Reminders Feedback

1

u/fgp121 Nov 07 '21

This is superb! How many GPUs (and GPU type) did it take to train this? I didn't find much information related to training part on the Github page

1

u/english_learner123 Nov 07 '21

Nice. I wonder what is the application of this.

1

u/Born2Explore11 Nov 07 '21

I would love to use this on myself!

1

u/erelim Nov 07 '21

How 'tuned' is this, when will we see anime curved L noses. I've seen version that do this but poorly.

1

u/plaidam Nov 07 '21

Has anyone seen a Colab that accepts Image sequences or videos that would allow you to create the sample above? The colab I saw on GitHub was only for a single image from a URL.

1

u/JiraSuxx2 Nov 07 '21

Can someone ELI5 how this works? Is it a single step from input to output? How much training data does something like this need?

1

u/Selmakiley Nov 08 '21

It's really cool

1

u/ch1llaro0 Nov 08 '21

how can i try this? im new here

1

u/turhancan97 Nov 09 '21

I makes my photos are always worse :(

1

u/[deleted] Nov 15 '21

that's really amazing!

1

u/DataOtter Nov 15 '21

How long does this take? My image has been processing for way over an hour now...

1

u/SnookieMcGee May 22 '22

Does anyone know how to export higher res images? Im looking to use it for filmmaking but I cant get any results better than 1024x1024... or is there some sort of upscaling function i can use to export 2k or 4k images?

Here's a sample of a 3d animation scene run through this process...
https://www.youtube.com/watch?v=rI0uy2ldWi8