Who it is forA creator who has no footage for a concept and wants a complete short video generated from a written idea.
The problemProducing a vertical clip from scratch normally needs a camera, a set and an editor.
The outcomeA concatenated 9:16 MP4 built from an LLM storyboard, chained keyframe images and per-segment video generation, with the option to redo single segments.
What you need first
- Docker Desktop, or Docker Engine with Compose v2
- Your own vertical B-roll clips, placed under assets/ or uploaded in the UI (ClipFactory ships no footage)
- An OpenAI key and an ElevenLabs key for the content factory, or Offline dry run with no keys to test the pipeline
- For the AI Lab: an image provider key and a video provider key (Google Gemini API and/or fal.ai)
Steps
- Run
docker compose up -din the cloned Clipfactory folder and open http://localhost:3000. - On Setup or Settings, add an OpenAI key for keyframe images and a Google or fal.ai key for video generation.
- Open the AI Lab and start a new video from your prompt.
- Check the price estimate shown in the New-video dialog before you start, since retries and re-dos cost extra.
- Review each segment, redo or edit any that miss, then download the finished MP4.
Prompt for your agent
Use the repo feyzilim/clipfactory's AI Lab to generate one vertical video from the prompt <prompt>. Confirm the price estimate in the New-video dialog before starting, then save the concatenated 9:16 MP4. Verify that the output is a single MP4 with the expected length and aspect ratio.
Caveat. The README puts AI Lab costs at roughly $1 to $15 per video depending on the model and length, so run a short test first.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for feyzilim/clipfactory and "Turn a single sentence into a fully AI-generated vertical video"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer