Loading the page
On air. The free wire runs 15 minutes behind live. See pricing
World, crypto, finance and tech news, scored for impact.
On air. The free wire runs 15 minutes behind live. See pricing
World, crypto, finance and tech news, scored for impact.
MuhabbitBotOn air. The free wire runs 15 minutes behind live. See pricing
World, crypto, finance and tech news, scored for impact.
The crawler that reads a story page so Muhabbit can write its own summary and score it. Last updated November 2026.
When a story appears in your feed, MuhabbitBot may fetch that story's page once to read it. It identifies itself as MuhabbitBot/1.0 (+https://muhabbit.com/bot). Muhabbit uses the text to write a summary in its own words and to score the story. Readers get your headline, your name and a link to your page. Your article body is never shown or served.
MuhabbitBot checks each of these before it uses a page. Any one of them is enough.
Your robots.txt, for the MuhabbitBot token or for all crawlers:
User-agent: MuhabbitBot Disallow: /
A text and data mining reservation under the W3C TDM Reservation Protocol: a /.well-known/tdmrep.json file, a tdm-reservation: 1 response header, or <meta name="tdm-reservation" content="1"> in the page.
[
{ "location": "/*", "tdm-reservation": 1 }
]A <meta name="robots" content="noai"> tag in the page.
When you say no, MuhabbitBot does not use your page. Muhabbit then works from the title and description your feed already publishes, and still links every story to you.
To have your stories removed from the site and the API, see For publishers.