Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jan 4, 2024

• Update llama.cpp

  abetlen

  committed
  eb9c7d4

  Copy full SHA for eb9c7d4

Commits on Dec 27, 2023

• Bump version

  abetlen

  committed
  011c363

  Copy full SHA for 011c363

Commits on Dec 22, 2023

• Add HIP_PATH to dll search directories for windows users.

  abetlen

  committed
  92284f3

  Copy full SHA for 92284f3

• set llama_max_devices using library function

  abetlen

  committed
  2b0d3f3

  Copy full SHA for 2b0d3f3

• Fix typo

  abetlen

  committed
  d9a1d90

  Copy full SHA for d9a1d90

• Bump version

  abetlen

  committed
  37556bf

  Copy full SHA for 37556bf

• fix: inccorect bindings for kv override. Based on #1011

  abetlen

  committed
  6d8bc09

  Copy full SHA for 6d8bc09

• docs: add server config docs

  abetlen

  committed
  522aecb

  Copy full SHA for 522aecb

• Update llama.cpp

  abetlen

  committed
  6473796

  Copy full SHA for 6473796

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87

  Copy full SHA for 4b01a87

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

• Update llama.cpp

  abetlen

  committed
  4a85442

  Copy full SHA for 4a85442

• fix text_offset of multi-token characters (#1037)

  Show description for 2f03fb0
  twaka

  authored
  2f03fb0

  Copy full SHA for 2f03fb0

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623

  Copy full SHA for 33cc623

Commits on Dec 18, 2023

• fix: float32 is not JSON serializable when streaming logits.

  abetlen

  committed
  a05b4da

  Copy full SHA for a05b4da

• Fix type annotations

  abetlen

  committed
  7df6c32

  Copy full SHA for 7df6c32

• Fix type annotation

  abetlen

  committed
  b703aad

  Copy full SHA for b703aad

• Fix type annotation

  abetlen

  committed
  d0aedfc

  Copy full SHA for d0aedfc

• Fix ctypes definitions of `llama_kv_cache_view_update` and `llama_kv_cache_view_free`. (#1028)

  e-c-d

  authored
  2993936

  Copy full SHA for 2993936

• Bump version

  abetlen

  committed
  5e863d8

  Copy full SHA for 5e863d8

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650

  Copy full SHA for 095c650

• Remove unnused import

  abetlen

  committed
  472b344

  Copy full SHA for 472b344

• perf: Don't convert logprobs arrays to lists (#1021)

  kddubey

  authored
  6b2e0e0

  Copy full SHA for 6b2e0e0

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944df

  Copy full SHA for 62944df

Commits on Dec 16, 2023

• Bug fixed with n_ctx=0 (#1015)

  Show description for f1c631d
  DanieleMorotti

  authored
  f1c631d

  Copy full SHA for f1c631d

• Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

  Show description for 5a89446
  kddubey

  authored
  5a89446

  Copy full SHA for 5a89446

• Update llama.cpp

  abetlen

  committed
  534b1ea

  Copy full SHA for 534b1ea

Commits on Dec 14, 2023

• Bump version

  abetlen

  committed
  cbce061

  Copy full SHA for cbce061

• Add qwen chat format (#1005)

  yhfgyyf

  authored
  8b4db73

  Copy full SHA for 8b4db73

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  690c563

  Copy full SHA for 690c563

• Update llama.cpp

  abetlen

  committed
  c0fc0a1

  Copy full SHA for c0fc0a1

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32

  Copy full SHA for 8e44a32

• Replace logits_to_logprobs implementation with numpy equivalent to llama.cpp (#991)

  Show description for ef22e47
  player1537

  authored
  ef22e47

  Copy full SHA for ef22e47

• Fix UnsupportedOperation: fileno in suppress_stdout_stderr (#961)

  Show description for ac35f68
  

  zocainViken

  and

  abetlen

  authored
  ac35f68

  Copy full SHA for ac35f68

• Add Pygmalion chat format (#986)

  chiensen

  authored
  b938ccc

  Copy full SHA for b938ccc