Comments on: Research Firm Says Yahoo, MSN, & Google Have Major Page-Caching Flaw

By: Alphane Moon

Alphane Moon — Tue, 11 Dec 2007 12:28:14 +0000

Oh yes, removed pages can be found in the cache of some search engines for eternity.

I’m not a big fan of the “cache” functionality, since it has sometimes be exploited by scrapers to steal content from websites. “noarchive” is a good idea.

By: g1smd

g1smd — Fri, 07 Dec 2007 23:55:40 +0000

“od” should be “of”.

By: g1smd

g1smd — Fri, 07 Dec 2007 23:55:10 +0000

This would be a bigger problem with sites like archive.org as they keep old pages forever by design.

With search engines the old pages are eventually dropped, some in a matter od days to weeks.

Be aware that Google can keep some old pages for a year when they are in the Supplemental Index.

By: Jaan Kanellis

Jaan Kanellis — Fri, 07 Dec 2007 21:19:57 +0000

Well if Google (and other SE’s) removed 404 or missing pages faster this would not be an issue.