Quote:
|
Originally Posted by RyanLanane
A couple questions... Has anyone had anything similar happen to them? Does this mean google has crawled everything it is going to, or is there no way to tell ? Also, since I submitted all those urls in the site map shouldn't I eventually see 1600 + seperate queries from the AdSense googlebot queries even if there are errors ? Also this is the one I wonder the most about... Once it shows it has crawled your site, does it mean it has also indexed it.. meaning whatever pages are going to be listed are instantly at that point or are they 2 seperate stages which can be done a lengthy amount of time from each other.
|
Ok, the result in Google is a "stump", a place-holder in a sense.
60-70 inquiries is the spider going through the 1,600 links it's digested.
Google may decide to either wait until each link has been crawled before it gets put into the public dB, or it might do it in pieces. Not instant at all. Crawling simply means getting put into the dB; it has nothing to do with actually publicly publishing the dB.
Also, no, even if it crawls all 1,600 does not mean all 1,600 will go in. In fact, I will guarantee you that they will not. MSN and Yahoo do put
everything in, Google purposely has decided "bigger is not better" (or so they say publicly). You will probably get 1/4 to 1/3 of your site eventually listed in Google and no more. And no you can't control what goes in and stays out; it/they will decide.
GoogleBot is GoogleBot. "Adsense bot" usually shows up as: Google MediaPartners or mediapartners-google.
Quote:
|
Optimizing this thing is going to be a bitch because all calls are done by a script with a single template for every joke and every category meaning each page has the same meta tags, title, description, etc.. I am hoping Google doesn't look at it as a Spam of their index.
|
Quote:
|
Right now, I can't manipulate the meta's per joke... being able to do so would make a huge difference when it comes to SEO - The script really is pretty messy though
|
Some advice. 1,600 joke pages? ReMETA and rename each joke/file? Messy script?
I would forget it and leave as it is. But if your heart is set on it, you might find it easier taking each one and pouring each into a better CMS. (Or maybe you can get the one you have reworked. I can think of ways that could be done or might not be able to be done, depending upon individual item functionality and how it writes to a dB at the moment.)
And even then you might want to hire a grunt to do it for you. If you change 25 jokes a day thats about 4-5 hours of work a day for over two months. Can you afford that time or get back the ROI on that? (And that's not including a new script install or existing script overhaul to boot.)