Our site is database intensive and creates hundreds of thousands of dynamic pages. Some of the features use session Id. This is causing several issues for the googlebot crawling and I keep getting warning messages from google. One such message is shown below.
"Googlebot encountered problems while crawling your site [url removed, login to view] Googlebot encountered extremely large numbers of links on your site. This may indicate a problem with your site's URL structure. Googlebot may unnecessarily be crawling a large number of distinct URLs that point to identical or similar content, or crawling parts of your site that are not intended to be crawled by Googlebot. As a result Googlebot may consume much more bandwidth than necessary, or may be unable to completely index all of the content on your site. More information about this issue
Here's a list of sample URLs with potential problems. However, this list may not include all problematic URLs on your site.
[url removed, login to view] "
(domain name replaced with example and the place name substituted with myplace). I want someone who has good experience in creating seo friendly urls and solve this problem. You may have to replace session IDs with cookies. If needed set the canonical urls for all the features. You will also check all the remaining urls and implement seo friendly modifications without affecting the ranking. Please share your previous experience on this.
8 freelancers are bidding on average $140 for this job
I should be able to solve your problem. It is probably something subtle in the code. I have employed Search Engine Optimization with my own sites with good results. aj