Published on 2025-08-07T06:18:08Z
PocketParser
PocketParser is the web fetcher for the popular 'read later' service Pocket. It is not a general-purpose web crawler but an on-demand bot that visits a webpage only when a user saves that page to their Pocket account. Its purpose is to extract metadata, such as the title and a featured image, to create the preview card that appears in the user's saved list. This ensures a site's content is represented accurately and attractively within the Pocket app.
What is PocketParser?
PocketParser is a specialized web crawler, or fetcher, for the 'read later' service Pocket. When a user saves content to their Pocket account, this bot visits the webpage to collect the metadata needed to create a preview card within the Pocket application. It identifies itself in server logs with the user-agent string PocketParser/2.0 (+https://getpocket.com/pocketparser_ua)
. Unlike more aggressive crawlers, PocketParser only visits pages when triggered by a user's action and focuses solely on gathering the information needed to generate an accurate preview, such as titles, images, and Open Graph tags.
Why is PocketParser crawling my site?
The PocketParser bot is visiting your website because a user of the Pocket service has saved a link to your content. The bot is not systematically crawling your entire site; it is making a targeted visit to the specific URL that the user saved. The frequency of its visits is directly tied to how often users save your content to their Pocket accounts. This is a legitimate and authorized activity that represents genuine user interest in your content.
What is the purpose of PocketParser?
The purpose of PocketParser is to support Pocket's core service by enabling rich, visual previews of saved content. When an article is saved, the bot collects the metadata needed to create an engaging preview card with a title, image, and summary. This benefits both the user, by creating an organized and visually appealing reading list, and the content creator. For website owners, it ensures that your content is accurately represented in the Pocket interface, which can encourage return visits when users decide to read the saved content.
How do I block PocketParser?
To prevent PocketParser from creating previews of your content when it is saved by users, you can add a disallow rule to your robots.txt
file. This will cause links to your site to appear as plain text within the Pocket app.
To block this bot, add the following lines to your robots.txt
file:
User-agent: PocketParser
Disallow: /
How to verify the authenticity of the user-agent operated by Read It Later?
Reverse IP lookup technique
host
linux command two times with the IP address of the requester.-
This command returns the reverse lookup hostname (e.g., 4.4.8.8.in-addr.arpa.).> host IPAddressOfRequest
-
> host ReverseDNSFromTheOutputOfFirstRequest