Code

Plugin interface for backends#570

Code

Open

iboB wants to merge 20 commits intoggml-org:masterggml-org/ggml:masterfrom iboB:torch-demoiboB/ggml:torch-demoCopy head branch name to clipboard

+322-19

Commits

Commits on Oct 23, 2023

• cmake : don't find CUDA it it's already found

  iboB

  committed
  3071540

  Copy full SHA for 3071540

• cmake : if built as a plugin, use fPIC and build as static lib

  iboB

  committed
  9f9f46b

  Copy full SHA for 9f9f46b

• backend : add set_tensor_external_data

  iboB

  committed
  7f33707

  Copy full SHA for 7f33707

• cuda : init backend as a plugin

  iboB

  committed
  ac9b0ba

  Copy full SHA for ac9b0ba

• cmake : rely on external CUDA if any to make CUDAToolkit available

  iboB

  committed
  7396f84

  Copy full SHA for 7396f84

• cuda : fix unused var warning

  iboB

  committed
  e1f7aed

  Copy full SHA for e1f7aed

• cuda : destroy resources on free

  iboB

  committed
  95770f5

  Copy full SHA for 95770f5

• cuda : properly reuse tensor->extra

  iboB

  committed
  c36c63e

  Copy full SHA for c36c63e

• metal : backend interface set_external_data

  iboB

  committed
  4103c51

  Copy full SHA for 4103c51

• minor : typo

  iboB

  committed
  acd2940

  Copy full SHA for acd2940

• cuda : only destroy handles on free if not a plugin

  iboB

  committed
  77ba5bd

  Copy full SHA for 77ba5bd

• backends : dummy buffer for external tensors

  iboB

  committed
  ac52b0e

  Copy full SHA for ac52b0e

• backend : add offset arg to set_tensor_external_data

  iboB

  committed
  e033464

  Copy full SHA for e033464

• minor : style

  iboB

  committed
  b29eb7f

  Copy full SHA for b29eb7f

• wip

  iboB

  committed
  973c420

  Copy full SHA for 973c420

• rewrite tensor external data

  iboB

  committed
  837aa5f

  Copy full SHA for 837aa5f

• plugin example

  iboB

  committed
  3ee1e60

  Copy full SHA for 3ee1e60

• remove non-standard enum fwd decl

  iboB

  committed
  a8b9f6a

  Copy full SHA for a8b9f6a

• minor : document set_tensor_external_data

  iboB

  committed
  933b132

  Copy full SHA for 933b132

• minor : spaces

  

  ggerganov

  authored and

  iboB

  committed
  6ced18f

  Copy full SHA for 6ced18f