Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add first class support for Windows ARM #469

Open
thewh1teagle opened this issue Jan 5, 2025 · 12 comments
Open

Add first class support for Windows ARM #469

thewh1teagle opened this issue Jan 5, 2025 · 12 comments
Assignees
Labels

Comments

@thewh1teagle
Copy link
Owner

thewh1teagle commented Jan 5, 2025

Describe the feature

whisper.cpp should work on Windows arm64. tauri as well.
We should be able to add support for it.

Some thoughts:

  • How to provide the option in the website. we want to keep it simple for x64 users. they don't need to think if they have it or not. (new idea: add small indication near download button for windows arm?) or similar with better wording!)
  • There's option to change the architecture of Vibe core entirely. we can create runner for the core inference of whisper.cpp like Ollama did.
    This way we don't need special installer for Arm. the app will run as x86-64 and the inference runner will be Arm

Request for help:

  • I don't have Windows arm to test it on. It would be great if someone can test it from the community (Let me know if you do in the comments!)

Related:

Pointers:

Issues:

Whisper.cpp build for ARM CPU with no errors.

Build:

bunx tauri build -- --no-default-features --target aarch64-pc-windows-msvc
@thewh1teagle thewh1teagle self-assigned this Jan 5, 2025
@njstone9
Copy link

I'm running Windows 11 on the new Microsoft Surface X Elite. Vibe crashes and closes within a few seconds of trying to transcribe anything. When I load it, it says something about my CPU being old (ha ha!).

Any possibility of getting Vibe to work on ARM Windows?

@thewh1teagle
Copy link
Owner Author

I'm running Windows 11 on the new Microsoft Surface X Elite. Vibe crashes and closes within a few seconds of trying to transcribe anything. When I load it, it says something about my CPU being old (ha ha!).

Any possibility of getting Vibe to work on ARM Windows?

What a smart CPU detection! ;)
I really want to fix this and add support for ARM as mentioned in this issue. However, I need someone with an ARM machine who's willing to help me and others by testing a few files I'll build to ensure they work properly.

@njstone9
Copy link

njstone9 commented Jan 10, 2025 via email

@thewh1teagle
Copy link
Owner Author

You can test on my machine if you like.

I built first version with native Windows arm support!

You can download here

https://github.com/thewh1teagle/vibe/releases/download/v3.0.0/vibe_3.0.0_arm64-setup.exe

Note:

  • ffmpeg is still for regular windows. I hope it won't be an issue
  • diarization is disable for now

Let me know if it can transcribe for you

Example audio you can try:

https://github.com/thewh1teagle/vibe/raw/refs/heads/main/samples/short.wav

@njstone9
Copy link

njstone9 commented Jan 11, 2025 via email

@njstone9
Copy link

njstone9 commented Jan 13, 2025 via email

@thewh1teagle
Copy link
Owner Author

Next step?

Try to run it from cmd.exe with the following commands:

set RUST_LOG=DEBUG
%localappdata%\vibe\vibe

It will open the app, try to transcribe this file, and then copy the log from the terminal here and paste it
Thanks

@njstone9
Copy link

njstone9 commented Jan 17, 2025 via email

@thewh1teagle
Copy link
Owner Author

Hi - quick turnaround on this one!

I see that you try to load distil model. try this model instead:

https://huggingface.co/ggerganov/whisper.cpp/resolve/main/ggml-tiny.bin

@thewh1teagle
Copy link
Owner Author

Do you see any error in the browser console? (right click -> inspect element -> console -> see errors)

@njstone9
Copy link

njstone9 commented Jan 17, 2025 via email

@njstone9
Copy link

njstone9 commented Feb 17, 2025 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants