They use little parts of packages (known as crawlers or bots) to abide by the many hyperlinks and learn new pages (and also updates to your webpages they uncovered just before). Idea: There’s a helpful totally free Device by Animalz which might be connected to your Google Analytics account and https://easyfaq.io