{
    "byline": "ArchiveBox",
    "charset": "UTF-8",
    "dir": null,
    "excerpt": "I'd say this is currently our 2nd most-requested feature :) It's definitely in the roadmap: #120 but not planned anytime soon because it's not ArchiveBox's primary use-case and it's extremely difficult to do well. For now I recommend using another software to do the crawling to produce a list of URLs of all the pages, and then pipe that list into archivebox to do the actual archiving.",
    "lang": null,
    "length": 2847,
    "siteName": null,
    "title": ""
}