We are also testing more weight formats and runtimes, including smaller 4-bit formats such as IQ4_XS and Inco AI's Splash, a Metal engine…

We are also testing more weight formats and runtimes, including smaller 4-bit formats such as IQ4_XS and Inco AI's Splash, a Metal engine for Apple Silicon that uses DFlash speculative decoding. We will add their results once they pass our accuracy checks, which we will publish soon. Early tests show faster completion times on some systems