update torch 2.1.2 to 2.4

[ismaildakrory]

I attempted to manually update from https://pytorch.org/, but Kohya refuses any version other than 2.1.2, and I can't find any way to make Kohya setup update to the latest torch version.
two days of searching with no luck.

Any help would be appreciated.

[ismaildakrory]

This is for anyone who is a beginner like me, or having a problem with torch v 2.4 and above:

I changed the \kohya_ss\requirements_pytorch_windows
to this:

torch==2.4.0+cu118 --index-url https://download.pytorch.org/whl/cu118
torchvision==0.19.0+cu118 --index-url https://download.pytorch.org/whl/cu118
xformers==0.0.27.post2+cu118 --index-url https://download.pytorch.org/whl/cu118

then run the \kohya_ss\setup.bat

I had many errors, I could fix them in plainly 2 days, but one error took most of the time:

The specified module could not be found. Error loading "....\kohya_ss\venv\lib\site-packages\torch\lib\fbgemm.dll" or one of its dependencies.

I searched and tucked in many suggestions until this one fixed my problem:

pytorch/pytorch#131662 (comment)