Published on 2025-08-07T06:18:08Z

Miniflux bot

The Miniflux bot is a content fetcher for Miniflux, a minimalist, open-source RSS and Atom feed reader. It is not a centralized crawler but operates from individual, self-hosted installations of the software. Its presence in your logs means that one or more users have subscribed to your website's feed using their personal Miniflux instance. This activity helps distribute your content to a dedicated, privacy-conscious readership.

What is the Miniflux bot?

The Miniflux bot is a feed fetcher associated with Miniflux, an open-source feed reader application. Miniflux allows users to subscribe to RSS, Atom, and JSON feeds from websites. The bot's function is to regularly poll these feed URLs for new content on behalf of a user's self-hosted Miniflux instance. It identifies itself in logs with a user-agent string like Mozilla/5.0 (compatible; Miniflux/2.x.x; +https://miniflux.app). Unlike general web crawlers, it only accesses the specific feed URLs that users have subscribed to.

Why is the Miniflux bot crawling my site?

The Miniflux bot is accessing your website because at least one user of a self-hosted Miniflux instance has subscribed to your RSS or Atom feed. The bot is simply fetching your content to display it to that subscriber. By default, it checks for updates every 60 minutes, but this interval can be customized by the user. The crawling is a legitimate and expected activity for any site offering public feeds, and it represents genuine user interest in your content.

What is the purpose of the Miniflux bot?

The purpose of the Miniflux bot is to serve as a personal content aggregator for its users. It allows them to follow updates from multiple websites in a single, privacy-focused interface. For content publishers, Miniflux acts as a distribution channel that helps maintain a connection with your audience. Users who subscribe to your feed via Miniflux are often among your most engaged readers, and the service helps you reach them efficiently while respecting their privacy.

How do I block the Miniflux bot?

If you wish to prevent Miniflux instances from fetching your content feeds, you can add a rule to your robots.txt file. This will stop users who rely on this software from receiving your updates.

To block the Miniflux bot, add the following lines to your robots.txt file:

User-agent: Miniflux
Disallow: /

How to verify the authenticity of the user-agent operated by Miniflux?

Reverse IP lookup technique

To verify user-agent authenticity, you can use host linux command two times with the IP address of the requester.
  1. > host IPAddressOfRequest
    This command returns the reverse lookup hostname (e.g., 4.4.8.8.in-addr.arpa.).
  2. > host ReverseDNSFromTheOutputOfFirstRequest
If the output matches the original IP address and the domain is associated with a trusted operator (e.g., Miniflux), the user-agent can be considered legitimate.

IP list lookup technique

Some operators provide a public list of IP addresses used by their crawlers. This list can be cross-referenced to verify a user-agent's authenticity. However, both operators and website owners may find it challenging to maintain an up-to-date list, so use this method with caution and in conjunction with other verification techniques.