Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jan 8, 2026

• Update llama.cpp API 20260108

  JamePeng

  committed
  4d0fe24

  Copy full SHA for 4d0fe24

Commits on Jan 1, 2026

• Update llama_context_params and fix the `embeddings` typo

  JamePeng

  committed
  b6bf564

  Copy full SHA for b6bf564

Commits on Nov 2, 2025

• Implement LlamaTrieCache into llama_cache.py: Optimize LlamaCache lookup from O(N) to O(K) using a Trie

  JamePeng

  committed
  2419dc2

  Copy full SHA for 2419dc2

Commits on Aug 31, 2025

• Sync llama: use FA + max. GPU layers by default

  JamePeng

  committed
  2be720d

  Copy full SHA for 2be720d

Commits on Aug 26, 2025

• Sync llama : remove KV cache defragmentation logic

  JamePeng

  committed
  ae46275

  Copy full SHA for ae46275

Commits on Aug 10, 2025

• Added gemma3 setting.chat_format into server/model.py

  JamePeng

  committed
  9645ded

  Copy full SHA for 9645ded

Commits on Jul 16, 2025

• Update llama.cpp API 20250717

  JamePeng

  committed
  bc283d3

  Copy full SHA for bc283d3

Commits on Jul 13, 2025

• more logits_all params restored

  JamePeng

  committed
  cdc7348

  Copy full SHA for cdc7348

Commits on Jul 6, 2025

• Sync abetlen/llama-cpp-python 0.3.11 code

  JamePeng

  committed
  0701c73

  Copy full SHA for 0701c73

Commits on May 20, 2025

• Sync kv-cache : add SWA support

  JamePeng

  committed
  177445c

  Copy full SHA for 177445c

Commits on May 13, 2025

• Update llama.cpp API code 20250513

  JamePeng

  committed
  6b3e11c

  Copy full SHA for 6b3e11c

Commits on May 9, 2025

• Sync context : remove logits_all flag and update API

  JamePeng

  committed
  1a1d920

  Copy full SHA for 1a1d920

Commits on Sep 20, 2024

• feat: Add option to configure n_ubatch

  abetlen

  committed
  6c44a3f

  Copy full SHA for 6c44a3f

Commits on Aug 29, 2024

• feat: Add server chat_format minicpm-v-2.6 for MiniCPMv26ChatHandler

  abetlen

  committed
  97d527e

  Copy full SHA for 97d527e

Commits on Jul 17, 2024

• fix(server): Use split_mode from model settings (#1594)

  Show description for 66d5cdd
  

  grider-withourai

  and

  abetlen

  authored
  66d5cdd

  Copy full SHA for 66d5cdd

Commits on Jun 13, 2024

• feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)

  Show description for 320a5d7
  

  jkawamoto

  and

  abetlen

  authored
  320a5d7

  Copy full SHA for 320a5d7

Commits on Jun 4, 2024

• feat: adding `rpc_servers` parameter to `Llama` class (#1477)

  Show description for d634efc
  

  chraac

  and

  abetlen

  authored
  d634efc

  Copy full SHA for d634efc

Commits on May 29, 2024

• fix: fix string value kv_overrides. Closes #1487

  abetlen

  committed
  df45a4b

  Copy full SHA for df45a4b

Commits on May 3, 2024

• fix(server): Propagate `flash_attn` to model load. (#1424)

  dthuerck

  authored
  2138561

  Copy full SHA for 2138561

Commits on May 2, 2024

• feat: Add llama-3-vision-alpha chat format

  abetlen

  committed
  31b1d95

  Copy full SHA for 31b1d95

Commits on Apr 30, 2024

• feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)

  Show description for fe2da09
  abetlen

  authored
  fe2da09

  Copy full SHA for fe2da09

Commits on Apr 1, 2024

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048

  Copy full SHA for f165048

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bd

  Copy full SHA for 4d574bd

Commits on Feb 8, 2024

• fix: broken import

  abetlen

  committed
  85d3374

  Copy full SHA for 85d3374

• feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

  Show description for 9018270
  

  jeffrey-fong

  and

  abetlen

  authored
  9018270

  Copy full SHA for 9018270

Commits on Jan 31, 2024

• Add speculative decoding (#1120)

  Show description for fb762a6
  abetlen

  authored
  fb762a6

  Copy full SHA for fb762a6

Commits on Jan 21, 2024

• fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

  abetlen

  committed
  24f3945

  Copy full SHA for 24f3945

Commits on Jan 19, 2024

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7

  Copy full SHA for b8fc1c7

Commits on Jan 15, 2024

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6

  Copy full SHA for 76aafa6

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Loading