CPU3DAI tools for 3D, video and audio

whisper.cpp v1.9.4: Windows on ARM support and ggml update to 0.23.0

Version v1.9.4 of the whisper.cpp launcher has been released. In the GitHub repository, the changes have been published: Windows on ARM support has been added to the build pipeline, the ggml backend has been updated to version 0.23.0, repeated decoder startup has been fixed, and the call order of the language auto-detection callback has been corrected.

What it means

For those who run whisper.cpp on their own machine, the release brings several practical changes. The Windows on ARM build is now part of the release process — this concerns devices with ARM processors running Windows. The ggml update to 0.23.0 affects the compute backends: in Metal, missing tunings for M3 Max have been added; in SYCL, the rms_norm+mul+add and add+add operation chains have been merged; and an uninitialized variable in q5_1 quantization for s390x has been fixed. The change in the call order of encoder_begin_callback before language auto-detection may affect server mode: the response to a detection request now returns the language. Reinitializing the decoder between calls eliminates instability during consecutive runs. The developer does not specify memory requirements or particular models for this release. Link to the news feed about AI tools for 3D and video: cpu3d.com/ainews.
whisper.cpp v1.9.4: what changed Windows on ARM build in the release pipeline ggml 0.23.0 Metal: tuning for M3 Max SYCL: fusion of operations Decoder re- initialization Language callback call order before detection Server mode detection response returns language q5_1 quantization fixed s390x variable Release v1.9.4: stabler decoder, broader platform support
How the method works. The diagram was drawn based on this news note.

See also