Google’s new- and faster- updating system: Caffeine
Last Tuesday, June 8th, Google announced the completion of a new web indexing system called Caffeine. With Caffeine, Google analyze the web in small portions and update their search index on a continuous basis, globally. As Google find new pages, or new information on existing pages, they can add these straight to the index. That means you can find fresher information than ever before — no matter when or where it was published.
According to Google,
“Caffeine lets us index web pages on an enormous scale. In fact, every second Caffeine processes hundreds of thousands of pages in parallel. If this were a pile of paper it would grow three miles taller every second. Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day. You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles.”
Read the entire article here.

