How to obtain results similar to Photoshop's generative ai with Krita plugin

[lostsole76]

Hi, I've been doing an extensive project with Photoshop's AI with landscapes and adding assets, flowers, trees, etc. I just discovered Krita plugin. However, after trying all manner of models and settings, I can't seem to get any results that are quite as realistic or that blend as well as what Photoshop has done. Can anyone point me to any information about how this could be done, what models or settings? Is it even possible with Krita plugin to get the same sort of results? Outside of my project, I found the plugin to be amazing! Thank you for any help!

[minsky91]

In my experience, I was able to generate all kinds of realistic imagery with the Krita Ai plugin, including objects found in nature (trees, flowers, animals etc.). Organic blending of additionally generated objects requires some understanding of the plugin's specifics though, as the Krita plugin's approach, based on ComfyUI as its backend and Stable Diffusion in general, might differ somewhat from the one used in the generative fill in Photoshop. And there is indeed a plenty of parameters involved in using the plugin that might feel a bit overwhelming.

If you shed a little more light on how you are trying to achieve your goal with Krita AI, together with samples of your successful results in Photoshop perhaps, it might be a little easier to answer to your question.

Note that we have now a brand new Discord-based Kriita AI diffusion user group, you might find more people there who have an extensive experience with the plugin (and are willing to advise) than here . Join us at https://discord.com/invite/pWyzHfHHhU and post your question in the #general channel!

[lostsole76]

Thanks so much for your response!

This file is part Photoshop generative fill and part real photography.

In the attached file, the pine trees are from PS GF, but trust they match the rest of the photo. Some of the granite with lichen is PSGF, and some is real. It's hard to tell which is and which is not real.

The flowers are PS GF and the tall grass is also PS GF, but matches exactly the grass that was there, except the new AI grass is in better shape.

So, using Krita plugin, and again, trying many experiments with settings and models, and depth of effect sliders, I was unable to duplicate this level of PSGF photorealism. I got some pretty results, but everything had a 3D animation look which won't work with the project.

I'm willing to compensate someone, if not yourself, that has the knowledge and skill to help me get Krita to do the same as PS GF, if possible?

I'm also looking for a professional level AI landscape artist to help with my project in a paid freelancer capacity, if you happen to know anyone in your network.

Thanks again for any help!

[minsky91]

emailing is perfectly fine, just send me your address over any of the two platforms I mentioned, by means of a singular contact. (since I feel neither of us wants to share the address here)

Interstice hosts, as I imagine, a vanilla ComfyUI with the latest version installed, which is why you were/are getting bad results. I don't think you will solve the issue with Interstice without assistance of Acly. The version supplied with the plugin, on the other hand, is tailored to its work. Do try a local server setup on your RTX 3090, it's the best way to proceed. Will sort out Interstice later on.

[lostsole76]

Sent a request on Discord! Thanks! I prefer old school, just plain old simple email. Well, old school to me was writing letters by hand in cursive. Lol.

[Acly]

To clarify, there is no difference in output between local, managed or interstice - all produce identical images (with same input).

[lostsole76]

Thanks Acly. That is what would seem logical to me.

[minsky91]

To clarify, there is no difference in output between local, managed or interstice - all produce identical images (with same input).

Well, having learned something about ComfyUI setups (which can be very complex and often, let's say, inconsistent) in the last months, I would prefer using the "should be" verb instead of "is". ;) After having spent a whole day investigating this issue, I finally got to the bottom of it - it was most likely a mix-up in custom nodes due to numerous successive updates of Comfy under Stability Matrix in the last weeks that went under the radar of the plugin. When generating content of an image selection on my laptop over a local network connection to the said Comfy server (the latest v0.2.2) running on my main PC, the process had been consistently failing with an endless series of messages of the "patch type not recognized fooocus ...." type displayed on the console (which I found out only hours later), but the plugin would not react in any way to that and kept producing that lousy patch of plastic grass (see the 1st image of the 2 I posted above) each and every time. In other words, there was no indication of any error in my Krita interface on the laptop. At the same time, no render problem whatsoever had occurred when generating from absolutely the same input under the same settings on my main PC with the plugin using the managed server. No problem either in any version of Comfy, local or external, when generating an entire image - the screwed renderings happened only when inpainting something inside a selection.

The difference in output between using the local and external comfy servers was so obvious to me that I concluded, perhaps hastily, that any external, non-managed Comfy server install could be at fault here. Now, after having done (for an umptieth time in my short AI experience) a clean reinstall of ComfyUI, reinstalling as well all the needed nodes and models and whatnot, I have it running again properly on all my configurations, no inpainting issues that I can notice. For how long, I don't know.

[ricewind100]

You can indicate the part of the image you want me to use as a reference

[lostsole76]

Hi, thank you for commenting and playing around with the image. I guess I'm not wanting to necessarily reference any parts of the original image, but rather be able to add new alpine foliage from outside of the image and have that look realistic like my PSGF example above.. I hope that answers your question. The grass you made isn't too bad. The granite behind it is too plain. I'm still experimenting myself with different options but no success so far that matches PSGF. Thanks again!