Just add FLASH_ATTENTION_TRITON_AMD_ENABLE=TRUE env variable before the command. It will go AMD route ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible resultsSome results have been hidden because they may be inaccessible to you
Show inaccessible results