DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to run the exam on a ChatGPT or Claude subscription with Embodied First Exam

Use a subscription login in place of an API key to run the exam with codex or claude-code.

Short answer: Install Harbor as in the core exam: uv tool install --force -e . --with-executables-from harbor; then For ChatGPT, log in once with codex login, then run: CODEX_FORCE_AUTH_JSON=1 harbor run -d embodied-first-exam -a codex -m openai/gpt-6-astra. All steps.

  • Research
  • Intermediate
  • 1 hour
  • From the README
  • Codex
  • Claude Code

Credentials. The login token is tied to one person's account, so keep it in your own .env and do not share it or run the exam through a pooled account.

Who it is forA researcher who already pays for a ChatGPT or Claude subscription and does not want to set up separate API billing for a test run.

The problemAPI keys need a separate billing setup, and some people prefer to run the exam with the login they already use.

The outcomeAn exam run that authenticates with the subscription login and reports results like a key-based run.

What you need first

  • Linux x86_64 host with git, uv, and Docker Engine with Compose v2 and BuildKit (or rootless podman with -e podman)
  • NVIDIA driver and NVIDIA Container Toolkit for any GPU task
  • An API key for the agent's model in .env, or a ChatGPT or Claude subscription
  • Enough free disk for the benchmark images (1 to 150 GB depending on the suite)

Steps

  1. Install Harbor as in the core exam: uv tool install --force -e . --with-executables-from harbor
  2. For ChatGPT, log in once with codex login, then run: CODEX_FORCE_AUTH_JSON=1 harbor run -d embodied-first-exam -a codex -m openai/gpt-6-astra
  3. For Claude, run claude setup-token, put the token it prints in .env as CLAUDE_CODE_OAUTH_TOKEN, then run: CLAUDE_FORCE_OAUTH=1 harbor run -d embodied-first-exam -a claude-code -m anthropic/claude-opus-5-5 (inferred, check the README)

Prompt for your agent

In the repo mll-lab-nu/embodied-first-exam, run the core set with the subscription login for <agent name> using the matching command from the README. Report the task count and score. Verify that the login token is stored only in your local .env or shell and is not printed in the output.

Caveat. The README lists this as a separate path from the API key setup, so check that your subscription covers the model named in the command before you start.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for mll-lab-nu/embodied-first-exam and "Run the exam on a ChatGPT or Claude subscription"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer