The ollama 0.12.6-rc0 software released this evening and with it comes experimental Vulkan API support...

link to the original content