5 replies to this topic

[Robsta]

I don't know how significant this is, but I thought I would mention it. I was looking in the 'Visitors now browsing' page today, and noticed that a Yahoo crawler was on an unpublished page. This page had not been published for several months. :?: Does this happen?

[Hans]

Maybe you can look here:
http://www.etomite.c...&lst_category=5

[Robsta]

Maybe you can look here:
http://www.etomite.c...&lst_category=5

Close, but no cigar. Unpublished means it should not be available or accessible to anyone, or anything. It's an Etomite feature... so why was it reporting Yahoo on it :?:

[Dean]

If the document is cached, then the search engines will find it

[Robsta]

If the document is cached, then the search engines will find it

I thought about that, but the page hasn't been published for some time and I often clear the cache when working on the pages. Unless of course 'refresh site' doesn't do as advertised So I think I can safely say it wasn't cached, although the search and cache options are still ticked.

[Robsta]

I'm not too worried about it. I'll keep an eye on what shows up in the logs, see if it's a one off or not. I'm sure if it was a problem, it would have been reported by now. As I said, it just baffled me.