Search results

kv-cache : use ggml_set_rows

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 14285

#14285 In ggml-org/llama.cpp;

· ggerganov opened on Jun 19, 2025

ggml : add ggml_set_rows

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 14274

#14274 In ggml-org/llama.cpp;

· rgerganov opened on Jun 19, 2025

MODEL: Falcon-H1 support

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

pythonpython script changespython script changes

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 14238

#14238 In ggml-org/llama.cpp;

· younesbelkada opened on Jun 17, 2025

ggml : implement op fusion, starting with REGLU/GEGLU/SWIGLU

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

help wantedExtra attention is neededExtra attention is needed

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 14158

#14158 In ggml-org/llama.cpp;

· CISC opened on Jun 12, 2025

Granite Four

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

server

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggml-org/llama.cppnumber 13550

#13550 In ggml-org/llama.cpp;

· gabe-l-hart opened on May 14, 2025

llama : try loading tensors with pre-computed hashes

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Komputehttps://github.com/KomputeProject/kompute/https://github.com/KomputeProject/kompute/

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 13106

#13106 In ggml-org/llama.cpp;

· rgerganov opened on Apr 25, 2025

Metal TQ2_0

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 12485

#12485 In ggml-org/llama.cpp;

· dmahurin opened on Mar 20, 2025

<code>tool-call</code>: Phi-4 support

androidIssues specific to AndroidIssues specific to Android

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

server

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 12288

#12288 In ggml-org/llama.cpp;

· jpohhhh opened on Mar 9, 2025

Attempt to add the <code>mllama</code> support

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Draft (not ready).

ggml-org/llama.cppnumber 11639

#11639 In ggml-org/llama.cpp;

· q82419 opened on Feb 4, 2025

ggml-cuda : add TQ2_0 kernels, for ternary inference on GPU

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

enhancementNew feature or requestNew feature or request

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

performanceSpeed related topicsSpeed related topics

pythonpython script changespython script changes

Review Complexity : HighGenerally require indepth knowledge of LLMs or GPUsGenerally require indepth knowledge of LLMs or GPUs

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 11183

#11183 In ggml-org/llama.cpp;

· compilade opened on Jan 10, 2025

Add VisionOS compatibility by adding missing type definitions

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 11019

#11019 In ggml-org/llama.cpp;

· sinkingsugar opened on Dec 30, 2024

naming : normalize the name of callback-related identifiers

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

breaking changeChanges that break ABIs, APIs, file formats, or other forms of backwards compatibility.Changes that break ABIs, APIs, file formats, or other forms of backwards compatibility.

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 9405

#9405 In ggml-org/llama.cpp;

· ggerganov opened on Sep 10, 2024