DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to run any model from Hugging Face, Ollama or an OCI registry with LocalAI

Load models straight from Hugging Face, Ollama or OCI references with one command.

Short answer: Install LocalAI; then run a Hugging Face file: local-ai run huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf; run an Ollama model: local-ai run ollama://gemma:2b. All steps.

Who it is forA tinkerer who wants to try a specific GGUF or Ollama model through one consistent API.

The problemEach model source has its own tooling and serving setup.

The outcomeModels from different sources running behind the same LocalAI API.

What you need first

  • Docker or Podman, or the macOS app (not signed by Apple)
  • Optional GPU: NVIDIA, AMD, Intel, Apple Silicon or Vulkan; CPU-only works
  • Disk space for the models you pull

Steps

  1. Install LocalAI
  2. Run a Hugging Face file: local-ai run huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
  3. Run an Ollama model: local-ai run ollama://gemma:2b
  4. Or an OCI image: local-ai run oci://localai/phi-2:latest
  5. List what is installed with local-ai models list

Prompt for your agent

With mudler/LocalAI, load <model> from <Hugging Face or Ollama>, confirm it appears in local-ai models list, and call it through the OpenAI-compatible endpoint with a test prompt.

Caveat. Check each model's license before using it in a product.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for mudler/LocalAI and "Run any model from Hugging Face, Ollama or an OCI registry"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer