🛋️ Interior Design for ComfyUI v2.0

This project adapts the original pipeline from
StableDesign: 2nd place solution for the Generative Interior Design 2024 competition
to work natively and fully inside ComfyUI, leveraging modern custom nodes and a modular architecture.

Learn more about the original method in this Medium article.

---

✅ Key Features

• Fully restructured for ComfyUI compatibility
• Includes 3 custom nodes developed specifically for this repository:
  • "Interior Design Segmentator"
  • "Image Normalize"
  • "Control Items"
• Uses additional advanced custom nodes:
  • Depth Anything V2
  • ComfyUI_IPAdapter_plus
• Reimplements only the necessary components from the original pipeline, such as:
  • Semantic segmenter using openmmlab/upernet-convnext-small
• Supports standard ComfyUI workflows with ControlNet and IP Adapter integration
• Compatible with other workflows and custom models
• Inference is significantly faster than the original pipeline (test the workflow and compare).

---

🧱 Pipeline Overview

• The idea was to use as many nodes from the ComfyUI core as possible. However, for certain tasks, I had to rely on custom nodes or adapt my own nodes to stay as faithful as possible to the original pipeline, or alternatively, use dependencies from other custom node repositories.
• Uses the same base models as the original StableDesign pipeline
• Includes custom ControlNet models:
  • controlnet_depth
  • own_controlnet (segmentation)
• These ControlNets, along with the depth map and segmentation map, are passed into the UNet of the diffusion model
• Final step includes refinement with latent noise injection and up/down-scaling(because of the size limitation of the original pipeline)

---

📁 Example Workflow

An example workflow is included in this repository:
stable-design-for-comfyui.json

You can load it directly into ComfyUI to test or extend the pipeline.

---

📦 Installation & Dependencies

This node is available on ComfyUI Manager
You must also install the following custom nodes manually if not yet available:

• Depth Anything V2
• ComfyUI_IPAdapter_plus (note: unmaintained)
• ComfyMath

---

🔧 Upcoming Features

• Expansion of Control Items: Add support for more semantic regions and control inputs to increase flexibility and detail in generation.
• Evaluation of CLIP Conditioning: Reassess the combination of positive and negative CLIP embeddings in ControlNet to verify if results match the original pipeline's behavior.
• Custom IP Adapter Node: Implement a native IP Adapter node to replace the current dependency on ComfyUI_IPAdapter_plus, which is currently unmaintained.

---

🧪 License & Acknowledgements

Original pipeline by MykolaL (StableDesign on Hugging Face)
This adaptation reuses only essential logic, converted to full ComfyUI-compatible workflow format.

---

feel free to open issues and PRs