Google currently uses various sources to find new content on the web, from links to submitted URLs. This traditional method may not include new content as soon as it goes live. Google is now discovering web sites by automatically scanning RSS and Atom feeds. This new process will help Google more quickly identify web pages and will allow users to find new content in search results as soon as it goes live.
RSS/Atom feeds have been very popular in recent years as a mechanism for content publication. They allow readers to check for new content from publishers. Using feeds for discovery allows Google to index pages more quickly than traditional crawling methods.
In order for Google to use your RSS/Atom feeds for discovery, it’s important that crawling these files is not disallowed by your robots.txt. To find out if Googlebot can crawl your feeds, test your feed URLs with the robots.txt tester in Google Webmaster Tools.
Incoming search terms:
- google crawl rss feeds
- googlebot crawlt feed/atom
- how youtube crawl rss
Related Posts
- Google Disables Uploads, Comments on YouTube Korea
- Apple claims Safari 4 to be the Fastest Browser
- Google Finally Enables Offline Access for Gmail
- Microsoft rolls out Bing!
- SEO Tips on Backlinks
Related Websites
- Suggestions On The Way To Complete Your Own Article Submission
- Free Ways That You Could Increase Your Sites Ranking
- Strategic Internet Marketing - Your Internet Business Requires Article Marketing
- Can Be There A Back-link Software Meant For Search Engine Optimization?
- How You Can Create Effective SEO Copy
{ 0 comments }
