ComfyUI-Copilot: Your intelligent development assistant

Introduction

Welcome to ComfyUI-Copilot, an intelligent assistant built on the Comfy-UI framework that simplifies and enhances the AI algorithm debugging and deployment process through natural language interactions.Whether it's generating text, images, or audio, ComfyUI-Copilot offers intuitive node recommendations, workflow building aids, and model querying services to streamline your development process.

🤔 Why Choose ComfyUI-Copilot?

• 🍀 Ease of Use: Lower the barriers to entry with natural language interaction, making Comfy-UI accessible even for beginners.
• 🍀 Smart Recommendations: Leverage AI-driven node suggestions and workflow implementations to boost development efficiency.
• 🍀 Real-Time Assistance: Benefit from round-the-clock interactive support to address any issues encountered during development.

In this workflow, I installed the ComfyUI-Copilot node to help me create a partial redraw workflow for flux. I will show you my production process and introduce its functions to you so that you can get familiar with it and use it more quickly.

https://github.com/AIDC-AI/ComfyUI-Copilot

Workflow Overview

How to use this workflow

Step 1: Install ComfyUI-Copilot

1.Click the manager button.

2.Click the Custom Nodes Manager button.

3.Enter the copilot keyword.

4.Select the node installation authored by AIDC-AI.

5.Click Relaunch to restart comfyui.

6.There is a comfyUI-copilot icon in the upper right corner of the page. Click it to open the smart assistant.

7.After opening copilot, click the settings icon at the top.

8.Click on the 'Click here to request one' link to get the API key.

9.Fill the obtained API key back into the input.

Step 2: Use copilot to create a workflow: Make a flux partial redraw workflow

1.Enter what you want to do in the input box below, for example: I want to generate a partial redraw workflow of flux.

2.Select the chat model. There are 4 models to choose from: gpt-4o, gpt-4o-mini, qwen-plus, DeepSeek-V3.

3.Based on the search results, select the workflow you want and click Accept.

4.If the nodes required by the workflow are missing, copilot will prompt you to download them. Click the Download button to jump to the github website of the corresponding node. You can also click on the graph directly, which will load all the nodes directly, but errors will be reported for nodes that are not installed. You can go to the manager to install them.

5.Replace the generated workflow model with your own model.Such a partial redrawing workflow of flux is now completed.

Step 3: Node Helper

1.Click the node you want to know about with your mouse.

2.Click the ‘usage’ button in the copliot.

3.The chat window will pop up information about this node and how to use it.

4.Click the node you want to know about with your mouse.

5.Click the 'parameters' button in the copliot.

6.All parameter information about this node will pop up in the chat window.

7.Click the node you want to know about.

8.Click the ‘Downstream Nodes’ button in the copliot

9.Downstream workflow recommendations for this node will pop up in the chat window.

Step 4: Parameter Exploration

1.Click on the node you wish to explore.

2.Select GenLab menu bar.

3.Select the parameters to explore.

4.Click ‘next’ to proceed to the next step.

4.Set the parameter value ranges.'min' means taking the minimum value, 'max' means taking the maximum value, and 'step' means the value to be increased each time until the value of 'max' is reached.

5.Click ‘next’ to proceed to the next step

6.Click ‘Start Generation’ to proceed to the next step

7.The system will automatically batch execute different parameter combinations.

8.Generated results support visual comparison, helping you quickly find the optimal parameter configuration.

9.Click on the generated image and click the 'Apply Selected' button. Copilot will automatically add the 'steps' and 'cfg' parameters below the image to the parameters of KSampler.

Step 5: Prompt Rewriting Assistant

1.Click on the 'CLIP Text Encode (Prompt)' node.

2.Select the parameters to explore.

3.Click ‘next’ to proceed to the next step.

4.Click the AI ​​Writing button.

5.Enter the prompt word in the input box.

6.Click the 'Generate' button.

7.Three sets of more content-rich and high-quality prompt words will be generated below.

8.Click the Add Selected button.

9.You can copy the generated prompt words into the ‘CLIP Text Encode (Prompt)’ node.