RecommendHow to Add LoRA in ComfyUI SD1.5/SDXL/FLUX

LoRA is a fantastic way to customize and fine-tune image generation in ComfyUI, whether you're using SD1.5, SDXL, or Flux. With LoRAs, you can easily personalize characters, outfits, or objects in your creations. In this blog, let's learn how to seamlessly integrate LoRA into ComfyUI for SD1.5, SDXL, and Flux using MimicPC, an AI generator with built-in ComfyUI app. Discover step-by-step instructions on downloading, uploading, and configuring LoRA model files to enhance your image generation workflows, including special tips for Flux integration.

Run This Workflow Now

• All nodes and models are ready to go.
• No manual setup required.
• Error-free—just click and run!

How to Use Lora ComfyUI

Step 1: Download LoRA

Before incorporating LoRA into your workflow, you’ll need to download the LoRA model: Download LoRA files from sources like Hugging Face or copy the download link.

Step 2: Upload LoRA to MimicPC

Once you have your LoRA file or URL, follow these steps to upload it into MimicPC:

1. Navigate to Storage Manager: Login to MimicPC and launch ComfyUI. Go to Storage Manage and navigate to storage > model > loras.
2. Upload the File: You can either upload the LoRA file from your device or use the URL upload option to link the file from an external source.
3. Restart the Application: After the upload, restart ComfyUI within MimicPC to ensure it detects the new LoRA files. If the application is already running, a simple restart will suffice.

Step 3: Load the Default Workflow in ComfyUI

Once inside the ComfyUI environment, start by loading the default workflow. This step sets the foundational framework for incorporating LoRA. MimicPC simplifies this by providing a ready-to-use workflow, so manual setup is minimized.

Step 4: Add the LoRA Node for SD1.5/SDXL

Now it’s time to incorporate the LoRA node into your workflow for SD1.5/SDXL:

1. Load LoRA Node: In ComfyUI, double-click on the workspace or right-click to choose Add Node > Loaders > Load LoRA. This will allow you to add the LoRA node.
2. Configure LoRA Settings: Once the node is added, set the lora_name to reference the LoRA file you uploaded in the MimicPC > storage > model > loras directory. Adjust the strength_model and strength_clip values to determine how strongly LoRA impacts the diffusion and CLIP models.

Step 5: Connect the LoRA Node

Next, integrate the LoRA node into your workflow:

1. Position the Node: Place the LoRA node between the diffusion model and the CLIP nodes in your workflow.
2. Link the Nodes: Connect the input/output of the LoRA node to the corresponding parts of your workflow to complete the setup.

Step 6: Test Your Workflow

After setting up the node, perform a test run:

1. Generate an Image: This will help ensure that LoRA is correctly integrated into your workflow.
2. Adjust the Strength: If needed, tweak the strength_model and strength_clip values for optimal results. You can also incorporate trigger words into your prompts for finer control.

Step 7 (Optional): LoRA Stacking

If one LoRA isn’t sufficient, you can combine multiple LoRAs for more advanced outputs:

1. Use LoRA Stacker: In the Efficiency Nodes custom node, you can load multiple LoRAs.
2. Individual Strength Adjustment: Fine-tune the strength of each LoRA for the desired effect.

Run This Workflow Now

• All nodes and models are ready to go.
• No manual setup required.
• Error-free—just click and run!

Additional Step for Flux: Adding LoRA in Flux

Flux has its own dedicated nodes, so the process for adding LoRA requires an additional step:

1. Reload Flux Nodes: Before adding LoRA to Flux workflows, you need to reload the Flux-specific nodes. This ensures that the Flux environment is properly set up.
2. Add LoRA Node to Flux Workflow: Once the Flux nodes are loaded, you can follow the same steps as above to incorporate the LoRA node. Place the LoRA node between the diffusion model and CLIP nodes in your Flux workflow.
3. Test and Adjust: As with SD1.5/SDXL, generate an image and adjust the strength settings for the LoRA to ensure optimal results.

Conclusion

Wrapping it all up, using LoRA with ComfyUI in MimicPC really makes the whole workflow smooth, whether you're working with SD1.5, SDXL, or Flux. Adding a single LoRA or even stacking multiple ones is super easy and straightforward. For Flux, you’ll just need to reload its specific nodes, but after that, it’s basically the same as with SD1.5/SDXL. With these simple steps, you’ll be opening up a world of creative possibilities for your image generation projects!

If you want to explore ready-to-use ComfyUI workflows, please join our Discord group, where we update workflows daily!

Ready to try multiple LoRA nodes in this AI art journey? Use MimicPC to launch ComfyUI effortlessly and start generating images today.