Pre-release / continuous build: this is an experimental build, not a stable release.
hexagon: optimize CPY/CONCAT — round 3, short-rows edition (#30341) * hexagon: move the converting CPY in blocks of rows per DMA descriptor so short rows are not DMA-latency bound * hex-cpy: cleanup cpy cursor handling * hex-cpy-concat: introduce threaded dma/hvx gather-row helper Co-authored-by: Ruslan Karymov <67752306+karusrus@users.noreply.github.com> * hex-cpy: remove leftover rejections for extended buffers * hex-cpy: relax the gate for fast-path * hex-cpy: remove scalar divs and vtcm access and use explicit gather_sync * hex-cpy: add proper support for mdev work splitting to fastpath * hex-cpy: optimize dense gather-row tasks * hex-cpy: unroll gather-rows loops * hex-cpy: add fastpath for f16 * hex-cpy-concat: support for colapsing 3/4D dims * hex-cpy: double-buffer support * hex-cpy: factor out gather-rows into more of an op by itself * hex-cpy-concat: dedup kernel-params * hex-cpy-concat: step-down nr to fit instead of hard fail * hex-gather: replace div with a mask * hex-gather-rows: cleanup dma pipeline and remove the stalls * hex-gather: specialize compute funcs * hex-gather: reduce scalar reg.spills and func calls * hex-gather: do not recompute rows-per-thread on the npu * hex-build: add support for building/installing just hexagon * hex-cpy-concat: remove redundant barrier in concat and move cpy barrier under fence * hex-gather: annotations for dma-out * hex-mdev: make all key vtcm_acquire sync state atomic (fixes random hangs in mdev setups) --------- Co-authored-by: Yiwei Shao Co-authored-by: Ruslan Karymov <67752306+karusrus@users.noreply.github.com>Website: - https://llama.app
Attestations: - https://github.com/ggml-org/llama.cpp/attestations/55095068
macOS/iOS: - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework
Linux: - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries - Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries - Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries - Ubuntu x64 (ROCm 10.0) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) - Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Android: - Android arm64 (CPU) - Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Windows: - Windows x64 (CPU) - Windows arm64 (CPU) - Windows arm64 (OpenCL Adreno) - Windows x64 (CUDA 12) - CUDA 12.4 DLLs - Windows x64 (CUDA 13) - CUDA 13.4 DLLs - Windows arm64 (CUDA 13) - CUDA 13.4 DLLs - Windows x64 (Vulkan) - Windows arm64 (Vulkan) - Windows x64 (OpenVINO) - Windows x64 (SYCL) - Windows x64 (ROCm 10.0)
openEuler: - DISABLED - openEuler x86 (310p) - openEuler x86 (910b, ACL Graph) - openEuler aarch64 (310p) - openEuler aarch64 (910b, ACL Graph)
UI: - UI