Use sitemaps to count words
Many sites have sitemaps that points at the pages of a website. It would be great if this service could use the sitemaps to know which pages to scan for words. This would resolve problems currently present for duplicate pages being counted etc.
And example sitemap is located at http://www.themodernnomad.com/sitemap.xml