Issues

• feat: Add support for new gpt-5 model variants

  knuddelsgmbh/jtokkit#133 · Filter by author SimonCalundan opened on Aug 8, 2025
  1

• Add o200k_harmony encoding used by gpt-oss models

  knuddelsgmbh/jtokkit#131 · Filter by author dafriz opened on Aug 5, 2025

• NumberFormatException while calling loadMergeableRanks

  knuddelsgmbh/jtokkit#128 · Filter by author vamsikantamneni opened on Jun 28, 2025

• add a new way to get the truncation of original text

  knuddelsgmbh/jtokkit#124 · Filter by author wdongyu opened on Jun 17, 2025
  1

• is there any milestone for DeepSeek, Gemini or Qwen supporting?

  knuddelsgmbh/jtokkit#123 · Filter by author caork opened on Jun 5, 2025

• New GPT4.1 model family

  knuddelsgmbh/jtokkit#121 · Filter by author juanpedrodiez opened on Apr 25, 2025
  1

• is there a way to get the actuall list of tokens?

  knuddelsgmbh/jtokkit#120 · Filter by author emaayan opened on Feb 11, 2025

• leading spaces lost

  knuddelsgmbh/jtokkit#116 · Filter by author aiwojiagiegie opened on Nov 30, 2024

• Dependency Dashboard

  knuddelsgmbh/jtokkit#11 · Filter by author renovate opened on Apr 15, 2023