Issues

• 📋 Documentation Enhancement Suggestion

  marella/ctransformers#217 · Filter by author croviatrust opened on Mar 6, 2026

• AutoModelForCausalLM is stuck, no error

  marella/ctransformers#216 · Filter by author victoris93 opened on Mar 10, 2025

• I'm having trouble running gguf models

  marella/ctransformers#215 · Filter by author fatihsazan opened on Jan 12, 2025
  2

• IBM Granite models support?

  marella/ctransformers#214 · Filter by author 0wwafa opened on Jan 10, 2025

• Link in readme broken

  marella/ctransformers#213 · Filter by author KansaiUser opened on Aug 7, 2024

• model not loading on GPU

  marella/ctransformers#212 · Filter by author kot197 opened on Jul 28, 2024

• Problem accessing libctransformers.so

  marella/ctransformers#211 · Filter by author Ajayvenki opened on Jul 26, 2024
  1

• Support for Llama3

  marella/ctransformers#210 · Filter by author gultar opened on Apr 20, 2024
  2

• OSError: .......cannot open shared object file: No such file or directory

  marella/ctransformers#209 · Filter by author Saurabh11811 opened on Apr 17, 2024
  3

• Error when trying to run on kali linux

  marella/ctransformers#208 · Filter by author Kuro0911 opened on Apr 16, 2024

• GGUF MODEL INFERENCE

  marella/ctransformers#206 · Filter by author Bamore01 opened on Mar 2, 2024

• Inputting embeddings directly

  marella/ctransformers#205 · Filter by author liechtym opened on Feb 24, 2024

• Does ctransformers support ollama models?

  marella/ctransformers#204 · Filter by author PriyaranjanMarathe opened on Feb 21, 2024
  1

• Add support for Google's Gemma models

  marella/ctransformers#203 · Filter by author gultar opened on Feb 21, 2024

• Does ctransformers boost the inference speed in llm inference?

  marella/ctransformers#202 · Filter by author pradeepdev-1995 opened on Feb 15, 2024

• How to load the finetuned model in safetensors format(not in gguf)

  marella/ctransformers#201 · Filter by author pradeepdev-1995 opened on Feb 15, 2024

• Cannot generate text on GPU

  marella/ctransformers#199 · Filter by author congson1293 opened on Jan 2, 2024
  3

• Add support for Microsoft Phi-2

  marella/ctransformers#197 · Filter by author niutech opened on Dec 14, 2023

• Unsupported Model : Zephyr 'stablelm' GGUF

  marella/ctransformers#196 · Filter by author Jonathanjordan21 opened on Dec 14, 2023

• Pulling models outside of hf?

  marella/ctransformers#195 · Filter by author ghost opened on Dec 13, 2023

• Multimodal models compatibility

  marella/ctransformers#194 · Filter by author ParisNeo opened on Dec 13, 2023

• precompiled rocm and metal wheels

  marella/ctransformers#193 · Filter by author ParisNeo opened on Dec 10, 2023

• GPTQ models are not respecting context_length or max_seq_len settings

  marella/ctransformers#191 · Filter by author chrsbats opened on Dec 6, 2023

• OSError: [WinError 1114] A dynamic link library (DLL) initialization routine failed

  marella/ctransformers#190 · Filter by author saurabhbluebenz opened on Dec 6, 2023

• Unclear error: GGML_ASSERT: D:\a\ctransformers\ctransformers\models\ggml/llama.cpp:453: data

  marella/ctransformers#189 · Filter by author deveolper opened on Dec 2, 2023
  3