Introduction
This workflow introduces the newly open-source face-changing photo model by ByteDance: InfiniteYou, which is an advanced zero-shot identity ID consistency preservation model developed by ByteDance based on the FLUX model, the strongest open-source model in the field of literary images. InfiniteYou focuses on using diffusion transformer (DiTs) technology to achieve flexible and high-fidelity identity-preserving image generation. It solves problems existing in existing methods, such as insufficient identity similarity, poor alignment of text and image, and low generation quality and aesthetics. At the same time, InfiniteYou is highly compatible and can be seamlessly integrated with a variety of existing methods, such as ControlNets, LoRAs, etc., providing more control and flexibility for customized tasks. With the InfiniteYou model, users can generate personalized photos with high identity similarity and achieve high-quality personalized photo generation.
https://github.com/ZenAI-Vietnam/ComfyUI_InfiniteYou
sim_stage1:
sim_stage1 is the original 1-stage model that prioritizes higher identity similarity to more accurately preserve facial features.
https://huggingface.co/ByteDance/InfiniteYou/tree/main/infu_flux_v1.0/sim_stage1
aes_stage2:
aes_stage2 is a SFT-trained model that focuses on better text-image alignment and enhanced aesthetics.
https://huggingface.co/ByteDance/InfiniteYou/tree/main/infu_flux_v1.0/aes_stage2
Part 1: Use Face Swapping to Keep Characters Consistent
Step 1: Load Image
Step 2: Input the Prompt
Step 3: Adjust the type of ControlNet
Step 4: Get Image
Part 2: Use Face Conbine to Predict Offspring Appearance
Step 1: Load Image
Step 2: Input the Prompt
Step 3: Adjust the type of ControlNet
When balance approaches 1, the facial features of offspring tend to be Image 1
When balance approaches 0, the facial features of offspring tend to be Image 2