About TrendmastBot
User-Agent: TrendmastBot/1.0 (+https://trendmast.com/bot)
TrendmastBot is the crawler behind Trendmast, a news aggregation site. It reads publicly available RSS/Atom feeds and news sitemaps to discover headlines, and it fetches article pages only to resolve canonical URLs and preview images.
What it does
- Honors
robots.txton every request, including feed and image fetches. - Uses conditional requests (ETag / If-Modified-Since) and fetches any one host at most once per minute.
- Stores only headlines, publishers' own short descriptions, preview-image URLs, bylines, and timestamps — never full article text from all-rights-reserved publishers.
- Links readers to the original article on your site; Trendmast never republishes your articles.
Opting out
Disallow TrendmastBot in your robots.txt and the crawler will stop fetching.
To have existing headlines and images removed as well, contact us and we will purge
everything derived from your site.
Contact: bot@trendmast.com