{"id":1390,"date":"2024-06-24T12:00:00","date_gmt":"2024-06-24T19:00:00","guid":{"rendered":"https:\/\/letsbuildroboticswithshadow8472.com\/?p=1390"},"modified":"2024-06-24T12:03:17","modified_gmt":"2024-06-24T19:03:17","slug":"which-stable-diffusion-ui-is-right-for-me","status":"publish","type":"post","link":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/2024\/06\/24\/which-stable-diffusion-ui-is-right-for-me\/","title":{"rendered":"Which Stable Diffusion UI is Right for Me?"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Good Morning from my Robotics Lab! This is Shadow_8472 and today I am exploring Automatic1111 alternatives. Let\u2019s get started!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A1111 is a nice baseline StableDiffusion interface. A determined beginner should find it approachable, it provides easy access to a large toolbox for an intermediate audience, and the community library of extensions and video\/text tutorials is large enough to keep experts honing their skills.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Stable Diffusion Forge vs. StableSwarmUI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">But A1111 it\u2019s hardly the only one around. Forge has had my attention as a direct improvement for A1111, for \u2013if nothing else\u2013 bugfixes when switching models. I\u2019ve bumped into this limitation while experimenting with ControlNet, and it gets in the way.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But another UI (User Interface) has caught my attention recently: StableSwarmUI. From around one hour of research, it appears to be a beginner friendly package built off ComfyUI, an interface I\u2019d previously written off as well above my skill level. Installation threw an extra challenge when it assumed browser access and I was working over SSH. I recently learned graphical SSH though:<\/p>\n\n\n\n<pre class=\"wp-block-verse\">ssh -CY &lt;user@host&gt;<\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Otherwise, StableSwarmUI was very easy to install.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Out of the box, my installation of StableSwarmUI was set up to run SDXL models. When I tried SonicDiffusion (Stable Diffusion 1.5 base) from my A1111 installation, I kept getting 50% gray outputs. I took a peek at the ComfyUI backend. Yeah\u2026 I have no business making the all-out switch until I\u2019ve properly introduced myself to ComfyUI. Time to research until I can make a basic workflow.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u2026<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OK, don\u2019t ask me about the gray boxes. Refreshing Firefox did nothing. Some people fixed similar issues by reinstalling or deleting one file or another. I left it over a weekend, then restarted StableSwarmUI server while installing the Custom Node Manager for ComfyUI.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">ComfyUI Workflows<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">ComfyUI all about the workflow: a program you make by linking various nodes into a flowchart. I looked up consistent character workflows to get a better idea of how they work. There are a couple options, but YouTuber NerdyRodent\u2019s Reposer Plus caught my attention first [1]. Custom Node Manager found most of its custom nodes, but NerdyRodent used a now outdated plugin called IPAdapter. I had to study IPAdapter v2 (programmer video [2]), but it wasn\u2019t too difficult to swap out the relevant nodes once I\u2019d taken my time.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Reposer Plus needed additional models \u2013 some of which I already had in A1111. I made a shared models directory and moved StableSwarmUI\u2019s entire models directory over. I found a setting in StableSwarmUI at \u201cServer\/Server Configuration\/Paths\/ModelRoot\u201d to point the UI at my models directory. A1111 would have me edit a .yaml file directly, but symbolic links are easier.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I set the workflow in motion with \u201cQueue Prompt,\u201d but the IPAdapter Advanced node I installed threw an error on me. It took an extra session, but experimentation identified model mismatch (I tried loading a \u201cBig G\u201d CLIP Vision model when it needed the normal one). The workflow then ran normally, but the final upscale turned sepia. I tried a photorealistic upscale model (as opposed to one for anime), but it turned out this was another server restart issue.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Takeaway<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">I played around with StableSwarmUI a bit more after a line of mediocre results with the Nerdy Rodent\u2019s workflow. Like with many tech projects, I\u2019m interacting with a large and evolving ecosystem. Being on local hardware, I have both the liberty and burden of being my own admin while still learning the user\u2019s point of view. And until I know both, I cannot tell if StableSwarmUI is there yet or not. I was all primed to complain about how I can\u2019t readily draw into the beginner interface for a ControlNet input, but on closer inspection I was mistaken about how this UI works. I still haven\u2019t found the feature, but that doesn\u2019t mean it\u2019s not there.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you are a first-day beginner, I would still recommend EasyDiffusion for its easy installation, image history, and inpainting. If you want anything more, A1111 will let you explore further (Forge appears abandoned) at the cost of image history. If you want to try a cool ComfyUI workflow, StableSwarmUI may be right for you.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Final Question<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">What is your favorite ComfyUI workflow? I look forward to hearing your answers in the comments below or on my <a href=\"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/discord-invite\/\" target=\"_blank\" rel=\"noreferrer noopener\">Socials<\/a>!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Works Cited<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">[1] N. Rodent, \u201cStable Diffusion &#8211; Face + Pose + Clothing &#8211; NO training required!,\u201d<em> youtube.com<\/em>, Oct. 14, 2023. [Online]. Available:<a href=\"https:\/\/youtu.be\/ZcCfwTkYSz8\">https:\/\/youtu.be\/ZcCfwTkYSz8<\/a>. [Accessed June 20, 2024].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">[2] L. Vision, \u201cIPAdapter v2: all the new features!,\u201d<em> youtube.com<\/em>, Mar. 25, 2024. [Online]. Available:<a href=\"https:\/\/youtu.be\/_JzDcgKgghY\">https:\/\/youtu.be\/_JzDcgKgghY<\/a>. [Accessed June 20, 2024].<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Good Morning from my Robotics Lab! This is Shadow_8472 and today I am exploring Automatic1111 alternatives. Let\u2019s get started! A1111 is a nice baseline StableDiffusion interface. A determined beginner should find it approachable, it provides easy access to a large toolbox for an intermediate audience, and the community library of extensions and video\/text tutorials is &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/2024\/06\/24\/which-stable-diffusion-ui-is-right-for-me\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Which Stable Diffusion UI is Right for Me?&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[355,365],"tags":[371,273,375,271,376],"class_list":["post-1390","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-image-generation","tag-a1111","tag-ai-image-generation","tag-comfyui","tag-stable-diffusion","tag-stableswarmui"],"_links":{"self":[{"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/posts\/1390","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/comments?post=1390"}],"version-history":[{"count":1,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/posts\/1390\/revisions"}],"predecessor-version":[{"id":1391,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/posts\/1390\/revisions\/1391"}],"wp:attachment":[{"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/media?parent=1390"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/categories?post=1390"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/letsbuildroboticswithshadow8472.com\/index.php\/wp-json\/wp\/v2\/tags?post=1390"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}