jaxiiruff

Decent, for now until ROCM & ZLUDA improve. I use NixOS and run my AI stuff using docker containers as its the easiest way imo because of how fucked up the dependencies are for ROCM especially.

Basically to get AMD working for this stuff right now is to make sure certain versions of ROCM for certain versions of projects interacting with certain versions of pytorch all like each other. The most dependency hell of all dependency hells.

So most projects have a hell of a time supporting ROCM so you must use alternative forks mostly, and even if there is a ROCM version it is so hardly used that no one knows if it works or if it doesnt half the time. I will say you will have the EASIEST time by far if you use a 7900 XT because most things are built to support that card. Otherwise good luck. Get used to using environment variables such as:

HSA_OVERRIDE_GFX_VERSION=11.0.0 (Or 10.3.0 if that one doesnt work. I use 11.0.1, these are codes for GPU's supported by ROCM incase yours isnt supported)

TL:DR - its all a big mess right now but it does work if you fuck with it a bunch, I got my 7800 XT to work nicely with Ollama + OpenWebUI for text generation. For stable diffusion its definitely a shit show atleast for my preferred UI Invoke AI. Doesnt work at all it only uses my CPU (also AMD so maybe some fuckery.) However I dont regret it as AMD is truly the best especially on Linux but definitely not for AI as it currently stands.

Already bought mine months ago and have been enjoying it, not so much the ROCM side of things but eh.

Oh hell yeah this will save us AMD users so much headache, I really dont understand why it was taken down recently.

From what I understood it was AMD having a problem with ZLUDA but now suddenly its okay again? Whatever as long as ROCM is improved or benefitted by this im happy.

Damn ubisoft might just be the worst gaming company ever created at this point if they have employees crying about not being able to buy that second boat or beachfront property cause gamers have had enough of it

Mullvad is the one!

Me and the boys cashing out in the finals while this burns

hmm ubisoft trying to be atleast somewhat decent, next they should get rid of their launcher

what the hell microsoft

Damn im the same, Id say it means we anxious but we got that dog in us for better or worse

This was definitely done to spite GrayJay no doubt about it since they clearly state in the app to download the version from the website rather than the play version.

Yeah I hear ya. How do you happen to be running it? I use NixOS and its a challenge there for me but I found atleast some success using docker since the dependencies are so out of control for AI at the moment.

Also give Ollama-rocm + Open Webgui a shot as an alternative to koboldcpp if you cant get atleast some text generation to work because that is the only thing I have got working with rocm.

This checks out after what they recently did to the ZLUDA project. As an owner of an AMD gpu I agree that ROCM support is really bad. It works half of the time and fairly poorly.