# Browsers, Bots and the Bill: Agentic Traffic and the Browser Agent Layer

> Bots now file most web requests, and browser agents from Perplexity, Anthropic, OpenAI and Browserbase are turning agentic traffic into a measured, billable and identifiable layer of the agent stack.

- Canonical: https://aiagentinfra.com/articles/browser-agents-agentic-traffic-browserbase
- Author: Ryan Elliott Dennis
- Category: Platforms & Interfaces
- Kind: Reference article
- Last verified: 2026-09-04
- Keywords: browser agents, agentic traffic, Browserbase, Browser Use, Stagehand, Perplexity Comet, Cloudflare pay per crawl, AI agents web traffic, HUMAN Security agentic traffic, x402

> "There will soon be more AI agents than humans making transactions on the internet." — Brian Armstrong, CEO of Coinbase (CoinDesk, March 15, 2026)

Bots generated 60.6% of the HTML content requests Cloudflare Radar measured as of Aug. 10, 2026, against 39.4% from humans, according to Search Engine Journal's Aug. 12 account of Cloudflare's agent-wallet launch; two months earlier Cloudflare chief executive Matthew Prince had posted that bots had passed human traffic online for the first time, a June 2026 milestone Ahrefs cited on July 24. Brian Armstrong's forecast of more agents than humans transacting on the internet therefore arrives with its premise half met: in requests, the machines already lead. Agentic traffic is the share of that automated flow generated by AI agents acting for a person, and the browser agent layer, meaning the hosted browsers, automation frameworks and consumer agentic browsers that produce it, is where the traffic originates, where it is billed and where it is blocked. This article measures the layer with the two datasets that exist, prices it with the three payment mechanisms that have shipped, and argues that the economics for publishers and merchants now turn on a distinction the web is drawing for the first time: bot or agent.

## Agentic Traffic by the Numbers: Two Datasets, One Definition Problem

Cloudflare's figure counts automated requests of every kind. Crawlers indexing pages, scrapers harvesting them, monitoring probes and AI agents fetching a product page on a user's instruction all land in the 60.6%, which makes it a ceiling on agentic traffic, and a loose one. HUMAN Security's "State of Agentic Traffic" for July 2026, published Aug. 6, 2026, measures the narrower category directly, across the traffic its Sightline platform observes for customers, identifying agents through behavioral signal analysis, user-agent attribution and publisher-level integration. Its shares sit in the table below. Both datasets carry the biases of the networks that produce them, and each sees the internet its own customers expose to it.

| Agent or browser | Share of agentic traffic, July 2026 | Movement |
|---|---|---|
| Perplexity Comet | 47.13% | Leading share |
| Claude Chrome extension (Anthropic) | 24% | +11.6% month over month |
| ChatGPT Atlas (OpenAI) | 15.5% | Volume −9% |
| ChatGPT Agent (OpenAI) | 6.1% | Down from nearly 9% in May |
| Browserbase | 2.6% | From 2.7% |
| Genspark | 2.4% | From 3.0% |
| Browser Use Cloud | 1.0% | From 1.2% |

Destinations tell the economic story. Media and publishers took 43.5% of agentic traffic in July, passing e-commerce at 42.0% for the first time, with travel at 13.4%; education, at 0.03%, grew 62.3% in volume, and streaming and gaming, at 0.14%, contracted by nearly half. Two consumer browsers and one browser extension account for 86.6% of the category, which means agentic traffic in 2026 is mostly a person with a browser that acts, while the developer infrastructure, Browserbase and Browser Use Cloud combined, produces 3.6%. That ratio is the layer's central fact. Consumer agents generate the volume; infrastructure vendors generate the tooling that enterprise agents will run on once they reach the same scale.

## Browserbase, Browser Use and Stagehand: Infrastructure Versus Framework

Hosted browsers are Browserbase's product: headless Chromium sessions with proxies, stealth and session recording, consumed through an API. Contrary Research's company profile records a $40 million Series B at a $300 million valuation in June 2025, led by Notable Capital with CRV and Kleiner Perkins, $67.5 million raised in total, more than 50 million browser sessions in 2025, over 1,000 paying customers and about 1.3 million monthly downloads of its tools. Stagehand is the company's open-source framework for letting a model act on a page through natural-language instructions, and Madrona reported it crossing 500,000 monthly npm installs in April 2025. Browser Use is the framework-first competitor, an open-source Python library with more than 21,000 GitHub stars per Respan's 2026 comparison, plus a hosted Browser Use Cloud that HUMAN measures at 1.0% of agentic traffic. Search interest tracks the split: Exploding Topics estimates 22,200 monthly searches for "browserbase," up 1,550% over two years, with a trajectory label of "peaked." Model vendors compete from above. Google's Project Mariner scored 83.5% on WebVoyager, per The Next Web's April 22, 2026, coverage of Cloud Next; Perplexity's Comet browser, free since Oct. 2, 2025, dominates HUMAN's table; and Anthropic's Chrome extension and OpenAI's Atlas turn the two largest chat assistants into browsing agents. Infrastructure and framework are converging. Browserbase ships Stagehand, Browser Use ships a cloud, and the consumer browsers ship both, wrapped around a model. Any durable advantage sits in anti-detection, session state and cost per successful task, and the published data cover the first two.

## The Bill: Cloudflare Pay Per Crawl, x402 and Comet Plus

Three billing mechanisms now attach to agentic traffic. Cloudflare's is the toll booth. Its pay-per-crawl feature, tied to the x402 standard through the x402 Foundation it announced with Coinbase on Sept. 23, 2025, lets a site answer a crawler with HTTP 402 and a price; Cloudflare shipped x402 in its Agents SDK and MCP integrations and proposed a deferred-payment scheme so agents settle in batches, its Monetization Gateway, launched July 1, 2026, extends the charge to web pages, datasets, APIs and MCP tools, and on Aug. 4, 2026, it added Cloudflare Wallets, stablecoin account wallets that delegate capped virtual wallets to agents, alongside cloudflare.pay identity handles. Coinbase's x402 is the meter. Volume through it has collapsed: CoinDesk reported on Aug. 13, 2026, that on-chain settlement had fallen 93% year to date, from about $800,000 a day in late 2025 to a seven-day average near $41,800, with Helios Analytics' Jamie Coutts calling the data a "reality check," even as Ripple joined the Linux Foundation-hosted x402 Foundation in July and Visa, Mastercard, Google and Stripe sit among its members. CoinDesk had already put daily volume near $28,000 on March 15, 2026, with about half of it flagged as artificial. Perplexity's is the revenue share. Comet Plus, at $5 a month, routes about 80% of subscription revenue to publishers, with roughly $42.5 million allocated, according to TechTimes' June 8, 2026, report on Perplexity's $200 million raise at about $20 billion, a valuation this publication treats as reported. The three mechanisms price different things: a request, a settlement and an audience. Publishers receiving 43.5% of agentic traffic can now pick one per agent.

## Bots or Agents: Detection, Trusted Agent Protocol and Verifiable Intent

Blocking bots was a solved commercial problem until the bots started carrying the customer's money. Visa introduced its Trusted Agent Protocol in October 2025, an open framework with Akamai support and more than 10 partners, so that a merchant's edge can distinguish an agent holding a Visa credential from a scraper; Visa's Dec. 18, 2025, release paired it with hundreds of completed agent-initiated transactions and more than 100 ecosystem partners. Mastercard's Agent Pay for Machines, launched June 10, 2026, with more than 30 participants including Cloudflare, Coinbase, Stripe and Tempo, adds what the company calls Verifiable Intent, a credential that lets any party in a transaction recognize the agent and its permissions across ecosystems. Cloudflare's cloudflare.pay handles give an agent an identity to which a wallet can be attached. HUMAN's own methodology, behavioral signals plus user-agent attribution plus publisher integration, is the detection side of the same coin. Identity precedes payment. A publisher that can tell Comet from a scraper can bill Comet, and a merchant that can verify a mandate can admit the agent that carries it while continuing to block the rest; the technical stack for that distinction, credentials at the network, handles at the edge and signals at the origin, exists as of mid-2026, and its adoption counts are the numbers to watch.

## Economics for Publishers and Merchants

Consider the publisher first. Agentic traffic converts differently from human traffic: an agent reads the page, extracts the answer and returns to its user, so the impression, the scroll depth and the ad viewability that fund the open web occur inside the agent's context window. Ahrefs' July 24, 2026, analysis shows the demand side reorganizing around that fact: an 18-keyword "agentic optimization" cluster averaging 541 monthly searches, up 852% over 18 months, "agentic SEO" up 5,867%, and combined agentic demand up 92% year over year, small numbers with steep slopes. The publisher's choice set is now block, meter or share. Merchants face the mirror image. E-commerce received 42.0% of agentic traffic in July, and an agent that arrives with a Shared Payment Token, a Cart Mandate or a Visa credential is a buyer with a budget, which is why the payment networks, and this site's companion article on agentic commerce, treat the browser as a checkout surface. Where a catalog is exposed through a protocol, the agent skips the browser; where it is exposed as a storefront, the browser is the universal API, the interface of last resort that every site already supports. Browser agents exist because most of the web will remain a storefront for years. The bill exists because the storefront's owner has learned to count who walks in.

## What to Watch

Four series will decide whether the browser agent layer becomes a billable utility or a cost center. First, HUMAN's monthly shares: whether Comet holds near half, whether Anthropic's extension keeps compounding at 11.6% a month, and whether the developer platforms, Browserbase and Browser Use, grow past a combined 3.6%. Second, Cloudflare Radar's bot share against the 60.6% baseline, and any breakout of agents from crawlers. Third, x402 settlement after the Monetization Gateway and Cloudflare Wallets, against the $41,800-a-day trough of August 2026. Fourth, Comet Plus payouts to publishers against the $42.5 million allocated, the first line item on the open web's agentic invoice. Traffic has arrived. The bill is being drafted.

## By the numbers

- Bot share of HTML requests: 60.6% — Cloudflare Radar, Aug. 10, 2026; humans 39.4% [1]
- Perplexity Comet share of agentic traffic: 47.13% — HUMAN Security, July 2026; Claude Chrome extension 24%, Atlas 15.5% [3]
- Browserbase sessions in 2025: 50M+ — $40M Series B at $300M valuation, June 2025; 1,000+ paying customers [4]
- x402 settlement volume, year to date: −93% — From ~$800,000 a day in late 2025 to a ~$41,800 seven-day average, Aug. 13, 2026 [11]
- Comet Plus revenue allocated to publishers: ~$42.5M — About 80% of subscription revenue, as reported June 8, 2026 [9]

## Sources

1. "Cloudflare Gives AI Agents Wallets That Pay For What They Access," Search Engine Journal, Aug. 12, 2026. https://www.searchenginejournal.com/cloudflare-gives-ai-agents-wallets-that-pay-for-what-they-access/584959/
2. Louise Linehan, "5 AI Search Trends I'm Seeing in 2026, Backed by Ahrefs Data," Ahrefs, July 24, 2026. https://ahrefs.com/blog/ai-search-trends/
3. HUMAN Security, "State of Agentic Traffic, July 2026: Publishers Claim Highest Share of Agentic Traffic," HUMAN Security, Aug. 6, 2026. https://www.humansecurity.com/learn/blog/state-of-agentic-traffic-july-2026-publishers-claim-highest-share-of-agentic-traffic/
4. Contrary Research, "Browserbase," Contrary Research, 2025. https://research.contrary.com/company/browserbase
5. Madrona, "The AI Agent Infrastructure Stack: Three Defining Layers," Madrona, Feb. 28, 2025, updated April 21, 2025. https://www.madrona.com/ai-agent-infrastructure-three-layers-tools-data-orchestration/
6. Respan, "Browser Use vs Browserbase (2026)," Respan, 2026. https://www.respan.ai/market-map/compare/browser-use-vs-browserbase
7. Exploding Topics, "Browserbase," Exploding Topics, Accessed Sept. 4, 2026. https://explodingtopics.com/topic/browserbase
8. "Google Cloud Next: the agentic era arrives," The Next Web, April 22, 2026. https://thenextweb.com/news/google-cloud-next-ai-agents-agentic-era
9. "Perplexity raises $200 million as Comet AI browser becomes the agent economy's front door," TechTimes, June 8, 2026. https://www.techtimes.com/articles/318028/20260608/perplexity-raises-200-million-comet-ai-browser-agent-economy-front-door.htm
10. Cloudflare, "Cloudflare and Coinbase launch the x402 Foundation," Cloudflare Blog, Sept. 23, 2025. https://blog.cloudflare.com/x402/
11. "x402 settlement volume plunges 93% year to date," CoinDesk via Yahoo Finance, Aug. 13, 2026. https://finance.yahoo.com/markets/crypto/articles/x402-settlement-volume-plunges-93-105710906.html
12. Visa, "Visa and Partners Complete Secure AI Transactions, Setting the Stage for Mainstream Adoption in 2026," Visa Investor Relations, Dec. 18, 2025. https://investor.visa.com/news/news-details/2025/Visa-and-Partners-Complete-Secure-AI-Transactions-Setting-the-Stage-for-Mainstream-Adoption-in-2026/default.aspx
13. Mastercard, "Mastercard launches Agent Pay for Machines," Mastercard Newsroom, June 10, 2026. https://www.mastercard.com/us/en/news-and-trends/press/2026/june/mastercard-launches-agent-pay-for-machines.html
14. Shaurya Malwa, "Visa Is Ready for AI Agents. So Is Coinbase. They're Building Very Different Internets," CoinDesk, March 15, 2026. https://www.coindesk.com/tech/2026/03/15/visa-is-ready-for-ai-agents-so-is-coinbase-they-re-building-very-different-internets