Large Language Models

4 posts

Large Language ModelsDeployment

Hosting Your Own LLM Server

February 28, 20266 min read

#gguf#fastapi#llama-cpp#llm+1

Large Language ModelsDeployment

⚙️ How to Start Using llama-server

February 28, 20263 min read

#llm#gguf#hugging-face#llama-server+1

Medical AILarge Language Models

Running MedGemma-4B on a Small GPU (<16GB) Using BitsAndBytes

February 27, 20269 min read

#gemma#llm#genai#transformers+1

Medical AILarge Language Models

Running MedGemma-4B on CPU or Using GGUF + llama-cpp

February 27, 202610 min read

#llama-cpp#gemma#llm#genai+1