fix: ROCm build #817
fix: ROCm build #817
Conversation
| sudo patch $ROCM_PATH/lib/llvm/lib/clang/*/include/__clang_hip_cmath.h ./patches/amd.patch |
There was a problem hiding this comment.
What happens if there's multiple versions installed here? Will it return the first one?
There was a problem hiding this comment.
I think there shouldn't be more than one version, though I can just make it check rocm version and patch clang 17 for rocm 6.1 and clang 18 for 6.2 if that's better
There was a problem hiding this comment.
Nvm, I'm too stupid for that. It should be fine as is anyway
|
@AlpinDale can it be merged? |
|
@Naomiusearch sorry for the delay. I forgot to mention: I tested this PR a bit more and it seems to break AWQ/GPTQ marlin entirely. I planned to redo this PR but I got distracted. I'll finish it up today. |
|
I tested this some more and AWQ needs more work to be fixed. Can you undo the changes related to gptq_marlin? We can merge the PR then. |
I have no idea what to put here so...
Pozdrawiam z rodzinką :3