Releases: Acly/krita-ai-diffusion
Version 1.30.0
Download krita_ai_diffusion-1.30.0.zip
Illustrious / NoobAI
Illustrious XL is a diffusion model trained extensively on (mostly anime-themed) illustration content. NoobAI XL adds further training on top. Both are based on the SDXL architecture, but weights have diverged significantly enough to require their own set of control models.
This release adds a separate "Illustrious" workload:
- NoobAI Control models (ControlNet, IP-Adapter) are used for styles using Illustrious architecture
- Managed install offers checkpoint and control models as download option
- Built-in style "Anime (Noob AI XL)" with recommended settings
- Supports both epsilon and v-prediction
- Seamless fill is disabled by default (there is no inpaint model so far)
Important
Most Illustrious checkpoints are detected as "SDXL" because they cannot be distinguished. You can configure
the correct architecture manually in Style settings > Checkpoint configuration (advanced) > Diffusion Architecture
The v-prediction models are detected automatically (no configuration needed).
User Guide
The documentation that was previously on the Wiki has moved to a new place: docs.interstice.cloud
There is a lot of new content too:
Something that was frequently requested but not easily possible on the Wiki was a full list of models recognized by the plugin: Model Database
Regional LoRA
LoRA which are added to text prompts of regions are now applied to that region only. Previously LoRA could only be applied to the entire image.
The initial implementation either requires a lot of VRAM or runs very slowly! Only use it if you really need it.
Other Changes
- Improved compatibility with custom tag lists (for auto-completion) by @BetaDoggo
- Lowered the default minimum resolution for SDXL to avoid resizing where it isn't required #1470
- Style settings are now locked when a built-in style is selected (with an option to make a copy to edit it)
- Made CFG rescale for v-prediction models configurable in style.json files (no UI for now)
- Reorganized model packages for the managed server install to be grouped by base model
- Upgraded managed install to PyTorch 2.5.1
- Fixed an assertion when there is a node with a "type" parameter in a custom workflow #1473
- Fixed mismatch between image and mask size when using resolution multiplier #1532
- Fixed an infinite recursion in custom graph workspace which could lead to hangs and broken UI when opening documents
- Fixed issues when active layer change is emitted before the layer is part of the node tree #1475
- Fixed empty error box being shown after a connection error is resolved
- Fixed long layer names stretching the animation workspace UI
- Moved model database to a separate JSON file (resource paths are still in resources.py)
- Added style models (eg. Flux depth/canny) to extra_model_paths
Contributors
Assets 3
Version 1.29.0
Download krita_ai_diffusion-1.29.0.zip
Flux Updates
"Reference" control layers now work with Flux. They use the Redux model to add content from one or more image layers to the generation.
There is also limited support for the Depth and Canny Loras released by Black Forest Labs. You can use the "Fill" model to Fill/Expand/Add/Remove content, but it's not fully integrated for now and must be selected manually.
See Flux Support for instructions. Keep in mind this is intended for those who want to experiment, expect changes in the future.
Other Changes
- Added "grace period" between making changes to the canvas or parameters, and starting a live generation. by @modelflat
- If generation is very fast, it will start immediately (as before)
- If it takes a bit longer there will be a tiny delay to wait for additional changes
- Will always schedule generation regularly after some time even when constantly editing the image
- Added context menu entry to copy image generation metadata to the clipboard #1421 by @mmuellerdm
- Added detection for some non-Flux GGUF models (eg. SD3.5 medium/large)
- Custom workflows: text prompt input box now respects the line count setting #1416 by @mmuellerdm
- Custom workflows: added context menu entry to copy generation parameters of previous results by @ronan36880
- Custom workflows: reserve more space for parameters in case none of the groups are expanded #1420
- Fixed Lora strength not being displayed correctly in Style settings in some cases
- Fixed cancel of active image generation when using cloud
- Open auto-complete only if there are at least 3 characters excluding trailing space #1417
Contributors
Assets 3
Version 1.28.1
Download krita_ai_diffusion-1.28.1.zip
Changes
- Fixed "missing parameter" error when using groups or explicit order in custom workflows #1393 #1414
- Fixed initial value for style widgets in custom workflows #1393
- Add
unetandtext_encodersfolders to built-in extra model paths #1395 - Update upscale button text based on context #1269
- Fixed broken link on welcome page #1388
- Improve error message when custom node pack is missing
Version 1.28.0
Download krita_ai_diffusion-1.28.0.zip
Built-in Style Model Updates
The built-in styles now refer to a range of models rather than one specific checkpoint, which allows for smoother updates. The following changes have been made to the recommended checkpoint list:
- [SD1.5] Serenity 2.1 (may replace RealisticVision5)
- [SDXL] RealVisXL 5.0 (may replace Juggernaut6)
- [SDXL] Pixelwave 11
As before those are just recommendations to get started with, you can always make your own choice.
New additions are also available on interstice.cloud
Custom Workflow Parameters
- Can now explicitly define the order of parameters
- Added parameter groups to aggregate related inputs
- Added button to reset all parameters in a group
Please check the documentation on how it works!
Managed Server Model Location
Models are now stored next to the ComfyUI installation folder, to allow smoother updates.
Eg. from .../ServerPath/ComfyUI/models to .../ServerPath/models.
Migration should happen automatically. Please find and put your models there afterwards (or use extra_model_paths.yaml).
Other Changes
- Updated managed ComfyUI & GGUF nodes (enables SD3.5 medium, #1383)
- Disable upscale button while upscale is in progress #1270
- Upscale: only show target size on hover to avoid showing old information #1264
- Fixed small but constant memory leak (even when doing nothing), #1359 by @FeepingCreature
- Fixed custom workflow parameter node min/max not accepting negative values #1381
- Error messages are now confined to a box, added "Copy to clipboard" button #1351
- Fixed clamp not being applied to grow/feather values
- Fixed Lora selection box expanding the Settings window #1343
- Fixed auto-completion with trailing space #1294
- Fixed text weight editing across multiple lines #1379
- Automatically switch to remote custom workflow after clicking "Open Web UI" button
Contributors
Assets 3
Version 1.27.1
Download krita_ai_diffusion-1.27.1.zip
Changes
- Fixed issues with intermediate diffusion results showing up among the output images #1330
- Fixed Parameter node not being connectable to other inputs Acly/comfyui-tooling-nodes#23
- Fixed Parameter node defaults being lost on reload Acly/comfyui-tooling-nodes#25
- Fixed Custom Workflow UI reserving space for text output when there is none
- Use a shorter request timeout for automatic update checks at startup #1339
- Added scrollbar for long custom parameter lists #1340
Version 1.27.0
Download krita_ai_diffusion-1.27.0.zip
Stable Diffusion 3.5
- SD3.5 checkpoints can be used with the plugin
- Added support for T5 text encoder for SD3
- Managed install now also supports fp8 scaled checkpoint version
As with all new models, a lot of features don't work yet, but feel free to give it a try!
See #1328 for more information on where to get the model.
Custom Workflows: Send Text
You can now send text from your custom workflow to Krita. Who knows, it could be useful.
Other Changes
Version 1.26.0
Download krita_ai_diffusion-1.26.0.zip
Custom Workflows
You can now run custom ComfyUI node graphs from within Krita.
Watch Video (YouTube) | Documentation & Guide
Features
- New "Graph" workspace dedicated to custom workflows
- Import workflow files (ComfyUI JSON API format) and run them
- Connect to ComfyUI running in the browser for synchronized editing
- Expose important parameters in Krita Plugin's UI for easy access
- Supports queued and live (update on change) generation
- Exchange canvas, image and mask layers, selections, style settings...
Important
Custom workflows work with managed or custom (local/remote) server.
Make sure to update comfyui-tooling-nodes if you're running a custom install.
Other Changes
- Expand LoRA trigger words directly inside the prompt when using auto-completion
- Trigger words are not added when the LoRA is added via prompt behind the scenes anymore!
- No change for LoRA added from the Style settings (trigger words are appended to the prompt)
- Fixed diffusion model of the first style in the list being reset to default #1227
- Fixed parenthesis in LoRA filenames being escaped when using auto-complete #1213
- Fixed handling of jobs which finish without generating any images #1182
- Added list of used style LoRA to image metadata (shown in tooltip)
- Support for Flux unblur control layer (jasperai/Flux.1-dev-Controlnet-Upscaler)
- Fixed color of progress bar after a model upload
- Show status message when (temporarily) disconnected from the server
- Improved error handling when a mensaged server process has stopped or crashed
- Improved error message when failing to read transferred images
- Added indicator when number of control layers is too high (Cloud)
- Fixed issues with open pose vector generation
Version 1.25.0
Download krita_ai_diffusion-1.25.0.zip
Automatic Updates
Future versions of the plugin (excluding this one!) can be downloaded and installed automatically.
By default the plugin will check for new versions when Krita is started. This can be disabled in the new "Plugin" settings tab.
Flux Inpainting
The inpainting model by AlimamaCreative is now used for Fill, Expand, and related modes.
It is an alpha version, results so far are mixed, but better than not having an inpaint model. See Flux Support for more info on installation and setup.
Other Changes
- The Guidance slider in Style settings can now be used to influence Flux guidance (default: 3.5)
- Fixed issues with installation of insightface on Windows (required for "Face" control layers) #1186
- Fixed issue with missing SSL (TLS) certificates on macOS #1181 by @voronin-ilya
- Support system certificate stores for SSL (TLS) in download_models.py script by @Rotonen
- Fixed mixup of Mistoline ControlNet for Flux and SDXL #1200
- Fixed model search path prioritization
Contributors
Assets 3
Version 1.24.0
Download krita_ai_diffusion-1.24.0.zip
Flux Extensions
- Support loading diffusion models, not just full checkpoints
- Support quantized models in GGUF format
- Support for Control layers: Line Art, Soft Edge, Canny, Depth
Flux integration is ongoing and things will change. Please read: Current state, Download & Installation
Other Changes
- Selecting a folder to filter LoRA no longer changes existing entries #1138
- Fixed LoRA not being sorted alphabetically #1139
- Improved error messages when selecting incompatible LoRA
- Added "Copy Style" option to the context menu for generated images #1040
- Show more information about how images were generated in the history #1172
- Limit the number of tiles when upscaling to very large resolutions
- Allow setting a proxy via environment variables for the download_models.py script #1160
- Fixed issues with installed numpy version #1135
- Updated to latest PyTorch (2.4.1, CUDA 12.4)
🥨 Join us on Discord!
Share, discuss, support or just chat: discord.gg/pWyzHfHHhU
Version 1.23.0
Download krita_ai_diffusion-1.23.0.zip
LoRA Model Upload
The new Upload button allows you to select a .safetensors file anywhere on your system and use it as a LoRA.
This works across all connections:
- Copies files to the appropriate place for local installs
- Uploads files to remote ComfyUI servers
- Interstice.cloud service now supports custom LoRA!
- During BETA: model size is limited to 300 MB (to be increased later)
- Currently no other limits, and no additional charges
Files are uploaded when needed, and cached on the server.
LoRA Trigger Words
Additional settings are now stored for each LoRA, and can be used across different Styles:
- Trigger words are added to the prompt whenever a LoRA is used
- The default strength can be set individually
This also works when adding LoRA via the prompt (eg. <lora:Ink scenery>).
Translations
- Thai by @hotfreshmilk
- Korean by @sejoung
Thanks to all who contributed translation updates!
Other Changes
- Added button to copy / duplicate an existing Style #1084
- Fixed performance issue for small Fill regions in high resolution images
- Fixed error when there is a small selection with a very large context
- Fixed error when using high strength Refine region with SD3 or Flux
- Remember last used translation toggle state #1087
- Ignore Clip Skip and other base model settings when they are not supported (eg. SD3, Flux)
- Ignore control layers which aren't supported by the model or server (UI still shows a notice)
- Removed LCM and Lightning sampler presets from "official" list (existing Styles can still use them)
- Allow to continue an incomplete server installation in more situations instead of reporting an error
- Improved error messages for common connection issues
- Improved error message when trying to send really large images (>16k)
Important
Remember to update ComfyUI if you are using a custom install!
Latest version of comfyui-tooling-nodes and comfyui-inpaint-nodes are required.
