Crawlability/indexability: Your sitemap and robots.txt with each other tell Google what you do and don’t want Google to crawl and index.White-hat Search engine optimisation is the only technique to go. Serps have intelligent algorithms and spam detection procedures that will track and penalize any Sites utilizing black hat Search engine optimisat