DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to log which AI agents visit your site with Botscent

Count visits by agent name so you can see agent traffic apart from people.

Short answer: Run npm install botscent in the project, or pip install botscent for a Python server; then add the page half for your framework, following the Quickstart section for that framework; add the server half, for example app.use(botscent()) in Express, or export { proxy } from 'botscent/next' in Next.js 16 or later. All steps.

Authorization notice. Botscent is dual-use. Only use it on software, sites and systems you own or have explicit permission to test.

Who it is forA site owner or analytics lead who cannot tell AI agent visits from human visits in current logs.

The problemAgent traffic is mixed into normal analytics, so you cannot see which agents arrive or how often.

The outcomeA log entry for each request that records the agent name, or human, and the reasons, using the page verdict joined to the request's own verdict.

What you need first

  • A site built with a supported framework such as Next.js, Express, Django or FastAPI
  • npm for the TypeScript package or pip for the Python package
  • Permission to edit your site's server code and page layout
  • A running site URL to test against

Steps

  1. Run npm install botscent in the project, or pip install botscent for a Python server.
  2. Add the page half for your framework, following the Quickstart section for that framework.
  3. Add the server half, for example app.use(botscent()) in Express, or export { proxy } from 'botscent/next' in Next.js 16 or later.
  4. Send the page verdict to your server with reportHeaders on same-origin requests, then join it with combine(own, report) on the server.
  5. Run npx botscent check https://your-site.example/ and confirm the server and page halves report pass.

Prompt for your agent

Using the botscent repo (nalinbhardwaj/botscent), add agent visit logging to <site path>. Expected output: one log line per request with agent_name or human and the reasons. Verify that `npx botscent check https://<your-site>/` reports pass for both halves.

Caveat. The page verdict comes from the visitor's browser, so use it to measure and adapt pages, not to make access decisions.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for nalinbhardwaj/botscent and "Log which AI agents visit your site"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer