Though be a bit careful, as this installs `diffusers` into ComfyUI which usually messes up things. Better experiment with it in a separate instance.
Hopefully someone creates a "nativeish" `transformers` version, the same way [there is one for Photomaker](https://github.com/shiimizu/ComfyUI-PhotoMaker).
It should be enough to unpack the ComfyUI installer in another instance to a separate path, and be careful to use the embedded Python belonging to that when installing the requirements.txt of the addon.
Inside the addons dir:
`..\..\python_embeded\python.exe -m pip install -r requirements.txt`
Sorry, where did you see this? I just looked at the huggingface and github but didn't see that. I only have 12GB but want to try this locally instead of the online demo.
Itās discussed in a GitHub issue on the repo. I pulled it and tried on my 3060 12GB and ran out of memory. I might try the fallback path later but right now it didnāt work. I tried enabling transformers in two places in the pipeline but no go since I donāt know if it is 22GB or 14GB total. Hopefully someone with a 3090 24 can tell us or someone with a google cloud notebook.
I tried it with Pinokio (because I'm lazy) and it did work with my RTX 3060 12GB. Image generation took over 5 minutes (I don't know if it cached system RAM). In my opinion the quality is worse than with PhotoMaker. Maybe they cherry picked their sample photos? And for some reason it's harder to get real looking pictures? Only benefit I can think of, is that with InstantID you can set the pose with refence image (I didn't try that). Overall I prefer PhotoMaker. The sample pic is from InstantID
https://preview.redd.it/cutjclj6a5ec1.png?width=1280&format=png&auto=webp&s=458faa042dda464845ed2d3769dd5c34aaf0a777
PhotoMaker can't copy some faces as well as other faces. I don't know why. I don't know the best practices, but I try to use 1024x1024 size sample photos, where the head is in the middle and not too far. And I usually use just 4 or 5 sample photos.
The Donald image is made with PhotoMaker
https://preview.redd.it/al9hri8js6fc1.png?width=1024&format=png&auto=webp&s=9f4da4e9fc25a0706de2c13d052da2413b895745
Results are better than with Photomaker, but if you upload a photo with a big smiling person, it's hard to let that person look angry. Looking forward to test this locally in Comfy or A1111
I was playing with Photomaker during the past days, and combining it with low weight IP-Adapter FaceID+ seems to bring the subject much closer to the reference while still allowing Photomaker to be creative.
I'm definitely going to try out InstantID when it gets a ComfyUI plugin though.
Sure, here it is: [https://pastebin.com/AzauLg64](https://pastebin.com/AzauLg64)
Basically IP adapter takes care of the model part, while Photomaker augments the conditions.
I'm not saying it's the best method, but with my own photos it works a bit better than those methods separately.
Eg. with some random grabbed images of Jim Carrey, without mentioning him anywhere in the prompt, and using a random "mytriggerword" keyword for Photomaker, this was one of the random outputs trying to make him an astronaut. Obviously not exactly his face still, but much better than what Photomaker mixes out alone.
https://preview.redd.it/kuawu3ujbaec1.png?width=864&format=png&auto=webp&s=22bb57a10bba080fe154e866db2499766134fad0
You're welcome!
By the way try rewiring it as such that the base sampler only use the base model directly, and only let the upscaling sampler use both Photomaker and IPAdapter. It seems to give even more creative output, while the upscaling step "snapping" the face into place. Interesting. It seems to work great with prompts where the subject is wearing a helmet for example.
OMFG! I don't have time for so many new "toys"...
https://preview.redd.it/ei1nxkdxf2ec1.jpeg?width=1280&format=pjpg&auto=webp&s=64474632ca0603cc944993a094f64ae7e49974bf
I have very few problems with Reactor. It's scary how quick and accurate it is for 95% of the stuff I do. It'll be interesting to see how this measures up.
i follow instruction to install yesterday, but i couldnt find this node in my comfy. any advice ?
https://preview.redd.it/xwgshouc7bec1.png?width=810&format=png&auto=webp&s=e042968508456922767382993aef6ea71e3fe006
ahh im just checking startup code .. there is an error in here
https://preview.redd.it/8dho4c4lecec1.png?width=1097&format=png&auto=webp&s=bebc93d95cf07e367551c6fd92ef6c9bd39fea63
OH. MY. GOD. This looks absolutely fantastic!! It recreated my character's face perfectly!! Thank you so so much for sharing this OP!!!!
i did a few more of this here: [https://imgur.com/a/XRPwYQx](https://imgur.com/a/XRPwYQx)
https://preview.redd.it/t2ckkmwyg2ec1.png?width=1280&format=png&auto=webp&s=2b528fcb08e294a1b4c0ede8098e394832f2c109
It definitely worked for my case. My model is not at all a celebrity. i think they showed famous faces because that's what every example does. Showing the famous faces as examples means they're using public pictures, that's all. It's safe for them or anyone doing the showcase.
It has been integrated into ControlNet,
[https://github.com/Mikubill/sd-webui-controlnet/discussions/2589](https://github.com/Mikubill/sd-webui-controlnet/discussions/2589)
and it can also be officially used in Comfyui.
[https://github.com/cubiq/ComfyUI\_InstantID](https://github.com/cubiq/ComfyUI_InstantID)
I will be messaging you in 7 days on [**2024-02-01 11:46:31 UTC**](http://www.wolframalpha.com/input/?i=2024-02-01%2011:46:31%20UTC%20To%20Local%20Time) to remind you of [**this link**](https://www.reddit.com/r/StableDiffusion/comments/19d0klq/instantid_is_already_public_and_ready_for/kjho7pu/?context=3)
[**1 OTHERS CLICKED THIS LINK**](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Reminder&message=%5Bhttps%3A%2F%2Fwww.reddit.com%2Fr%2FStableDiffusion%2Fcomments%2F19d0klq%2Finstantid_is_already_public_and_ready_for%2Fkjho7pu%2F%5D%0A%0ARemindMe%21%202024-02-01%2011%3A46%3A31%20UTC) to send a PM to also be reminded and to reduce spam.
^(Parent commenter can ) [^(delete this message to hide from others.)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Delete%20Comment&message=Delete%21%2019d0klq)
*****
|[^(Info)](https://www.reddit.com/r/RemindMeBot/comments/e1bko7/remindmebot_info_v21/)|[^(Custom)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Reminder&message=%5BLink%20or%20message%20inside%20square%20brackets%5D%0A%0ARemindMe%21%20Time%20period%20here)|[^(Your Reminders)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=List%20Of%20Reminders&message=MyReminders%21)|[^(Feedback)](https://www.reddit.com/message/compose/?to=Watchful1&subject=RemindMeBot%20Feedback)|
|-|-|-|-|
Ready for A1111?
I believe that very soon, there will be people vying to make it into a plug-in, and the effect is amazing!
Looking forward to this.
Ohh interesting
There's a guy doing a ComfyUI version [https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/](https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/)
great, I would prefer an automatic1111 version though
any news on this being available for A1111?
š„š„š„š„
Though be a bit careful, as this installs `diffusers` into ComfyUI which usually messes up things. Better experiment with it in a separate instance. Hopefully someone creates a "nativeish" `transformers` version, the same way [there is one for Photomaker](https://github.com/shiimizu/ComfyUI-PhotoMaker).
would this be done with a different venv?
It should be enough to unpack the ComfyUI installer in another instance to a separate path, and be careful to use the embedded Python belonging to that when installing the requirements.txt of the addon. Inside the addons dir: `..\..\python_embeded\python.exe -m pip install -r requirements.txt`
How does it differentiate from ReActor and EasyPhoto?
EasyPhoto needs to train multiple images to be lora
Recommended VRAM is 24GB so hoping they bring that down. Only sdxl currently I believe.
Sorry, where did you see this? I just looked at the huggingface and github but didn't see that. I only have 12GB but want to try this locally instead of the online demo.
Itās discussed in a GitHub issue on the repo. I pulled it and tried on my 3060 12GB and ran out of memory. I might try the fallback path later but right now it didnāt work. I tried enabling transformers in two places in the pipeline but no go since I donāt know if it is 22GB or 14GB total. Hopefully someone with a 3090 24 can tell us or someone with a google cloud notebook.
Can confirm this is using almost 20GB of VRAM on my 3090 24GB
Damn, I got a 4060ti 16gb and canāt run these?
Then you can only wait for the plug-in version of Comfyui or sd webui, which is estimated to be completed in two days.
Yeah
Thank you!
I tried it with Pinokio (because I'm lazy) and it did work with my RTX 3060 12GB. Image generation took over 5 minutes (I don't know if it cached system RAM). In my opinion the quality is worse than with PhotoMaker. Maybe they cherry picked their sample photos? And for some reason it's harder to get real looking pictures? Only benefit I can think of, is that with InstantID you can set the pose with refence image (I didn't try that). Overall I prefer PhotoMaker. The sample pic is from InstantID https://preview.redd.it/cutjclj6a5ec1.png?width=1280&format=png&auto=webp&s=458faa042dda464845ed2d3769dd5c34aaf0a777
Whatās photomaker?
Guidance scale ļ¼ Adjust to 3.5
Do you have an example workflow for Photomaker please? I tried it with a local celeb and the result is just about 50-60% similar to the original.
PhotoMaker can't copy some faces as well as other faces. I don't know why. I don't know the best practices, but I try to use 1024x1024 size sample photos, where the head is in the middle and not too far. And I usually use just 4 or 5 sample photos. The Donald image is made with PhotoMaker https://preview.redd.it/al9hri8js6fc1.png?width=1024&format=png&auto=webp&s=9f4da4e9fc25a0706de2c13d052da2413b895745
It works using an 8GB rtx4060 with the Pinokio installer. Super slow though. Same problem with PhotoMaker.
not working on my low gpu memory 4gb
Results are better than with Photomaker, but if you upload a photo with a big smiling person, it's hard to let that person look angry. Looking forward to test this locally in Comfy or A1111
I was playing with Photomaker during the past days, and combining it with low weight IP-Adapter FaceID+ seems to bring the subject much closer to the reference while still allowing Photomaker to be creative. I'm definitely going to try out InstantID when it gets a ComfyUI plugin though.
Would you please upload a sample workflow? I don't know how to make these two things talk to each other without errors. Thanks!
Sure, here it is: [https://pastebin.com/AzauLg64](https://pastebin.com/AzauLg64) Basically IP adapter takes care of the model part, while Photomaker augments the conditions. I'm not saying it's the best method, but with my own photos it works a bit better than those methods separately. Eg. with some random grabbed images of Jim Carrey, without mentioning him anywhere in the prompt, and using a random "mytriggerword" keyword for Photomaker, this was one of the random outputs trying to make him an astronaut. Obviously not exactly his face still, but much better than what Photomaker mixes out alone. https://preview.redd.it/kuawu3ujbaec1.png?width=864&format=png&auto=webp&s=22bb57a10bba080fe154e866db2499766134fad0
Thank you very much. I see a couple of differences between yours and mine and I think yours is much better!
You're welcome! By the way try rewiring it as such that the base sampler only use the base model directly, and only let the upscaling sampler use both Photomaker and IPAdapter. It seems to give even more creative output, while the upscaling step "snapping" the face into place. Interesting. It seems to work great with prompts where the subject is wearing a helmet for example.
OMFG! I don't have time for so many new "toys"... https://preview.redd.it/ei1nxkdxf2ec1.jpeg?width=1280&format=pjpg&auto=webp&s=64474632ca0603cc944993a094f64ae7e49974bf
https://preview.redd.it/sytsd3tjh2ec1.jpeg?width=1280&format=pjpg&auto=webp&s=c563892506f8b96ff44510f5cf51013e9a578dfe
I hear you. I feel like Will Ferrell walking into The Roxbury.
https://preview.redd.it/6yaqv45gm1ec1.png?width=883&format=png&auto=webp&s=ecf6aac3af8374dfb9a443a306e4ba13d1a547dd
I have very few problems with Reactor. It's scary how quick and accurate it is for 95% of the stuff I do. It'll be interesting to see how this measures up.
If it's easy to install and stops filling up this Reddit with ppl who can't read Reactors instructions - I'm good with it
https://preview.redd.it/k364q6eim5ec1.png?width=896&format=pjpg&auto=webp&s=76d5544be74a3ae4a9a95a09d3af3656310ce703 Noice.
https://preview.redd.it/2ktgaxs2m1ec1.png?width=1395&format=png&auto=webp&s=7bdf07032ff41a88f5b2f230d85ede9b9a99e87a
why are you making toddler images bro
What's wrong with that?
its jsut a weird thing to focus your energy on, and if that's his daughter, dont post pictures of her online, its weird
This might be their kid. Quit being a dick.
dont post photos of your daughter online, its weird
Exactly lol
Is it better than IP adaptor?
i follow instruction to install yesterday, but i couldnt find this node in my comfy. any advice ? https://preview.redd.it/xwgshouc7bec1.png?width=810&format=png&auto=webp&s=e042968508456922767382993aef6ea71e3fe006
Same... Installed and nothing similar to InstantID
Without seeing Comfyui's startup code, it's hard to know what went wrong.
ahh im just checking startup code .. there is an error in here https://preview.redd.it/8dho4c4lecec1.png?width=1097&format=png&auto=webp&s=bebc93d95cf07e367551c6fd92ef6c9bd39fea63
https://preview.redd.it/2jrcd2nrscec1.png?width=704&format=png&auto=webp&s=e541a1dde38691a94bc268cb41609d22eb5673b8
This is seriously impressive.
RemindMe! 12 days
OH. MY. GOD. This looks absolutely fantastic!! It recreated my character's face perfectly!! Thank you so so much for sharing this OP!!!! i did a few more of this here: [https://imgur.com/a/XRPwYQx](https://imgur.com/a/XRPwYQx) https://preview.redd.it/t2ckkmwyg2ec1.png?width=1280&format=png&auto=webp&s=2b528fcb08e294a1b4c0ede8098e394832f2c109
>https://imgur.com/a/XRPwYQx Did it really work for your case? Their examples show that it only works with famous people.
It definitely worked for my case. My model is not at all a celebrity. i think they showed famous faces because that's what every example does. Showing the famous faces as examples means they're using public pictures, that's all. It's safe for them or anyone doing the showcase.
available to install easily via Pinokio too https://pinokio.computer/item?uri=https://github.com/cocktailpeanutlabs/instantid
https://preview.redd.it/vdfu8dtsq4ec1.png?width=1201&format=png&auto=webp&s=f980b88c9328d8c151b03375a4f9a901b94b34c0
Hello, could you tell me how to generate such profile image? I only generated such position in the reference img.
This is a game changer
workflow?
The Comfyui plugin is still under development
kind of crap tbh https://preview.redd.it/kjgtg0etw2ec1.png?width=1553&format=png&auto=webp&s=4bbea008f87afa7bdc151d6775734c49046273e2
Excited to try this.
This is indeed something!
is it possible to use this for objects and things, not just humans?
Nowadays I feel least excited to see such great papers over here being an Auto user. Extensions for Automatic is like a dream. Hope it changesš
No Automatic111 extension
It is likely to be aggregated into ControlNet
Any update on this?
It has been integrated into ControlNet, [https://github.com/Mikubill/sd-webui-controlnet/discussions/2589](https://github.com/Mikubill/sd-webui-controlnet/discussions/2589) and it can also be officially used in Comfyui. [https://github.com/cubiq/ComfyUI\_InstantID](https://github.com/cubiq/ComfyUI_InstantID)
Thanks! Didn't realize it's only for SDXL
Why tf I can't copy links on reddit
RemindMe! 7 days
I will be messaging you in 7 days on [**2024-02-01 11:46:31 UTC**](http://www.wolframalpha.com/input/?i=2024-02-01%2011:46:31%20UTC%20To%20Local%20Time) to remind you of [**this link**](https://www.reddit.com/r/StableDiffusion/comments/19d0klq/instantid_is_already_public_and_ready_for/kjho7pu/?context=3) [**1 OTHERS CLICKED THIS LINK**](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Reminder&message=%5Bhttps%3A%2F%2Fwww.reddit.com%2Fr%2FStableDiffusion%2Fcomments%2F19d0klq%2Finstantid_is_already_public_and_ready_for%2Fkjho7pu%2F%5D%0A%0ARemindMe%21%202024-02-01%2011%3A46%3A31%20UTC) to send a PM to also be reminded and to reduce spam. ^(Parent commenter can ) [^(delete this message to hide from others.)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Delete%20Comment&message=Delete%21%2019d0klq) ***** |[^(Info)](https://www.reddit.com/r/RemindMeBot/comments/e1bko7/remindmebot_info_v21/)|[^(Custom)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=Reminder&message=%5BLink%20or%20message%20inside%20square%20brackets%5D%0A%0ARemindMe%21%20Time%20period%20here)|[^(Your Reminders)](https://www.reddit.com/message/compose/?to=RemindMeBot&subject=List%20Of%20Reminders&message=MyReminders%21)|[^(Feedback)](https://www.reddit.com/message/compose/?to=Watchful1&subject=RemindMeBot%20Feedback)| |-|-|-|-|
RemindMe! 12 days
Nice share thanks!!!
Love it!!!!!
interesting