Crawling: Net crawlers or ‘spiders’ are pre-programmed bots that ‘crawl’ Internet sites to inspect all of their content material, from web page code to World wide web copy, metatags, and more.
I really like https://reallivesocial.com/story2883913/5-simple-techniques-for-seo