Ollama

Ollama and Radeon 9070

Получилось запустить ollama на новой 9070 под винду.

1. Ставим оригинальную ollama
2. Ставим по инструкции – https://github.com/likelovewant/ollama-for-amd/releases

Пользуемся)

P.S. Копия на всякий случай)

  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.2 [hipsdk 6.2.4]， make sure to replace the libs with v0.6.2.4

ROCm5.7 version * No need to update, Not available

ollama-windows-amd64-rocm5.7z for ROCm5.7
Support lists gfx803 gfx900:xnack- gfx902 gfx1103

ollama-windows-amd64.7z for ROCm6.2.4
ROCmlibs for 6.2 available at ROCmlibs for 6.2.4

Support lists gfx906:xnack- gfx1010:xnack- gfx1011 gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1201 （expertimenal）

Note

Let’s get Ollama set up!

  1. Install or Extract: You can either run the OllamaSetup.exe file, or download the
    ollama-windows-amd64.7z file and unzip it.
  2. Update ROCm Libraries:
    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.2.4 or ROCmLibs for 5.7
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama. You can either run ollama run model names or use the command ./ollama serve (depending on how you installed it).

or use One Click Installer Ollama-For-AMD-Installer by ByronLeeeee

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it’s means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

Теги: github, ollama, radeon

Ollama