COMMUNITY DATA · April 2026

Publisher Adoption

Which major websites have gone agent-ready? Tracking SOM Directive adoption across the web.

Scanning top 1,000 sites monthly. Last scan: April 2026. 0 of 50 checked sites have SOM directives.

01

Why This Matters

When publishers add SOM Directives to robots.txt, AI agents can serve their content at 10–100× lower token cost. Better for agents. Better for publishers. This leaderboard tracks the early adopters.

02

Status Summary

50

Sites scanned

0

With SOM directives

17×

Avg compression potential

03

Site Tracking

SiteCategorySOM DirectivesPotentialStatus
nytimes.comNews✗ Not yet43×Monitored
theguardian.comNews✗ Not yet38×Monitored
techcrunch.comNews✗ Not yet35×Monitored
vercel.comSaaS✗ Not yet29×Monitored
stripe.comSaaS✗ Not yet52×Monitored
github.comDev Tools✗ Not yet18×Monitored
docs.python.orgDev Tools✗ Not yet22×Monitored
medium.comPublishing✗ Not yet31×Monitored
substack.comPublishing✗ Not yet27×Monitored
wordpress.comPublishing✗ Not yet24×Monitored
shopify.comE-commerce✗ Not yet45×Monitored
woocommerce.comE-commerce✗ Not yet41×Monitored
cloud.google.comCloud✗ Not yet118×Monitored
aws.amazon.comCloud✗ Not yet87×Monitored
docs.microsoft.comDev Tools✗ Not yet34×Monitored
smashingmagazine.comPublishing✗ Not yet29×Monitored
ycombinator.comTech✗ Not yet14×Monitored
producthunt.comTech✗ Not yet19×Monitored
arstechnica.comNews✗ Not yet37×Monitored
somready.comSaaS✓ Live—Early adopter
04

Submit Your Site

Is your site SOM-ready? Let us know and we'll add it to the list.

Open a GitHub Issue →
05

Methodology

  • Each site's robots.txt is fetched and scanned for SOM-* directives.
  • Compression potential is calculated using webtaskbench.com benchmark data for category averages.
  • Scans run monthly against a curated list of high-traffic sites.