OneTrainer window just shuts off

[Erlandsson]

As i have big problems getting kohya to work again, so i thought i would test OnetTrainer.

But it behaves just like kohya, it shuts off randomly.
I can start training, but after random time, the window just vanishes, and training stops.
What do i need to send the community for help? Is there any crash logs anywhere?

running win10, i9, 64Gb ram, rtx4080super 16Gb.
I have also tried on fresh windows installations, both windows 10 and 11. No difference.

[O-J1]

For lurkers - refer to #622 for additional details and context.

Edit: Given this user has to massively reduce clock speed, it was in fact the degrading cpu issue I mentioned. Closing.

[Erlandsson]

Not a usable answer, as it works sometimes with the exact settings. I have output loras (when i am very lucky).
It starts training, counting steps up. runs for a while, then just shuts off window and training stops.

[O-J1]

My post was not an answer if you mean me. Its just providing additional context. You left out details such as its a 14900k in this post but its there in the prior report. These details are important

[FurkanGozukara]

@Erlandsson it could be out of RAM which kills python apps

[Erlandsson]

Which would be out of ram? computer or gpu? Taskmanager show lots of free ram on both. I have run with 96Gb of Ram still happenig, so i removed 32Gb, did a Passmark memory test for 4 hours. No mem problem.

It more looks like all python scripts trying to read from other files fails randomly. This is my observation from all my 100s of tries to install kohya. As kohya fails with installs completely random. I have to run setup atleast 5-6 times before it seems to have installed all.
Then when training, it also fails randomly with lines about "accelerate" and "py something"..

I havle also tried installing on other drives, even on mechanical drive. same faults.

i HAVE HAD kohya running perfectly for 2 weeks, but after i tried reinstalling it, it fails me everytime.
I have also tried both Kohya and Onetrainer on fresh win10 AND win11 installations. same faults.

Just now i tried turning XMP in bios off, but that was not good. Got crashing webpages and blue sceens of that.

[FurkanGozukara]

Which would be out of ram? computer or gpu? Taskmanager show lots of free ram on both. I have run with 96Gb of Ram still happenig, so i removed 32Gb, did a Passmark memory test for 4 hours. No mem problem.

It more looks like all python scripts trying to read from other files fails randomly. This is my observation from all my 100s of tries to install kohya. As kohya fails with installs completely random. I have to run setup atleast 5-6 times before it seems to have installed all. Then when training, it also fails randomly with lines about "accelerate" and "py something"..

I havle also tried installing on other drives, even on mechanical drive. same faults.

i HAVE HAD kohya running perfectly for 2 weeks, but after i tried reinstalling it, it fails me everytime. I have also tried both Kohya and Onetrainer on fresh win10 AND win11 installations. same faults.

Just now i tried turning XMP in bios off, but that was not good. Got crashing webpages and blue sceens of that.

in this case your Operating system is the problem

[Erlandsson]

[Erlandsson]

I tried pinokio for installation of kohya, but that did also not help. Still ends training prematurely, also with errors.
I checked into linux, but i dont unserstand at all how that works. spent this whole day without getting anywhere

[FurkanGozukara]

I tried pinokio for installation of kohya, but that did also not help. Still ends training prematurely, also with errors. I checked into linux, but i dont unserstand at all how that works. spent this whole day without getting anywhere

my recommendation delete your existing python and follow this guide every step exactly same and reinstall onetrainer after that

https://youtu.be/DrhUHnYfwC0

[Erlandsson]

I have uninstalled/reinstalled python so many times i cant remember now. Both with default path, and my own selected, (with path selected) it does not matter. I have uninstalled python, nvidia kit, git, yeah everything, countless times.
Today i try to install Forge Ui, instead of Automatic1111 , which also craps out sometimes now.
But that does not even start. It craps out on installation over and over again.

And as i have said, i have tried on a completely stock windows 11 AND windows 10 installation. Just, python 3.10.11, git, vc_redist, cuda11.8 etc.

Both Onetrainer and kohya acts the same but different. Kohya at least outputs error while training, while OneTrainer just quit main window, then it says in cmd promp "training stopped". Nothing else.

The thing is: i CANT have two python installed simutaneously it seems, even though diff docs say so.
Atutomatic1111 NEEDS 3.10.6, Kohya NEEDS 3.10.11.
One program needs Cuda 11.8 installed, Forge ui need 12.1, but no one say if it is installed locally in their respective directories, or if it should be installed in windows.

So it seems it is IMPOSSIBLE to have all 3 or 4 setups installed and all working. (as of now, no program work)

Now after all my fiddling with pythons etc, automatic1111 has started to crap out when starting. Does not help to reinstall that either.

And funny enough, when starting run.bat it say on top python3.10.6, but if i enter webui folder and try web-ui,bat or webui-user it says 3.10.11. those last 2 i have NEVER been able to start automatic with (even if docs say that should be used), i always had to start with the one in root.

I have even thought about if my Powersupply is too weak, but then i remember that i HAD kohya AND automatic working. ALL before i tried reinstalling kohya. Then all went to hell.

[Erlandsson]

I will check that video, but i have no high hopes.

[Erlandsson]

Just followed the videos installation of pythons. Does not work with 2 pythons on windows 10. Even if installed in different folders.
The installation apps for each version 3.10.11 and 3.10.6 ( i don't want or need 3.11.xx) does not look the same as in video. I tried installing boh, vice versa each time. The second installation deletes almost all files in the first install. If i check installed apps, only the last one installed is there.
I have installed both. If i move the 3.10.6 to the top in env, it still only find 3.10.11 when opening in cmd.

So guess two different version of python is not possible on windows 10.

[O-J1]

Its not possible with default tools yes. There are more advanced ways of achieving it but I dont think any of this is your issue given you have completely nuked your entire pc and neither Kohya nor OT now work. In my opinion its time for you to attempt RMA your CPU or try another PSU.

Like I said in the now closed issue, the 14900k is the cpu most likely to be unstable because it had flaws in driver and manufacturing, if the bios updates were not applied or were not applied in time, a damaged CPU will continue to degrade. Anyway I dont think any of us can further help successfully on this.

[FurkanGozukara]

Just followed the videos installation of pythons. Does not work with 2 pythons on windows 10. Even if installed in different folders. The installation apps for each version 3.10.11 and 3.10.6 ( i don't want or need 3.11.xx) does not look the same as in video. I tried installing boh, vice versa each time. The second installation deletes almost all files in the first install. If i check installed apps, only the last one installed is there. I have installed both. If i move the 3.10.6 to the top in env, it still only find 3.10.11 when opening in cmd.

So guess two different version of python is not possible on windows 10.

i just replied you

have python 3.10.11 - it works with all of the AI apps

[Erlandsson]

what windows version?

And i find it strange that all other program i have, for example Blender works great.
Also that it was just a reinstall of kohya that destoyed everything. Well, automatic1111 still works kind of, i just need to restart it sometimes.

And that it is always the same messages in kohya.. Accellerate and runpy.pi is the main messes.

[Erlandsson]

"Blue screening became more and more frequent. The biggest sign of instability with the Intel Core i9-14900K was blue screening. Essentially, the CPU would become unstable."

I have not any of those problems. but i will check if it chrash when clockspeed is high, as it throttles up when training, but only at max 7% usage.