Balgates’s Weblog

I’m Wat I’m!!!

How Does Google Store All of its Data?

Clustered serversEver wonder how Google manages all their information? Imagine Gmail, it has to keep track of the billions of emails that get sent out each day regardless of whether or not it is spam.

A Database?
My first thought was a database. But if you think about it, if e-mails were stored in a single database table, it would have billions of rows added each day. This just isn’t possible nor is it efficient when performing a search. So Google cannot possibly store their data in a database… at least not in the traditional MySQL sense.

After a bit of digging around, I found an interesting document written by some of Google’s main architect that describes their file system in great detail. It turns out Google uses a distributed file system spread over many machines. It offers huge storage (hundreds of terabytes) over thousands of machines and thousands of disks.

The Google File System

The advantage of this type of system is redundancy and low cost. Their servers are not top of the line but clustering many of them together creates a highly cost-effective file system.

It’s what Yahoo Does
The owner of the largest database in the world, Yahoo!, takes on a similar approach: clusters of cheap computers that form a distributed file system. In fact, if a computer breaks down, it’s usually cheaper and faster to throw away the computer and replace it with a new one than it is to repair it.

So if you have a bunch of old computers sitting around at home, don’t throw them out just yet… you could create your own distributed file system!

Courtesy: http://www.jonlee.ca

Advertisements

May 20, 2009 Posted by | Business, General, IT, Science, Software, Technology | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | Leave a comment

India now aims for manned space mission

The plan is to achieve the space mission by 2015 said ISRO chief.

MANNED MISSION: The plan is to achieve the space mission by 2015 said ISRO chief.

India is aiming to send a manned mission into the space after the success of its first unmanned mission to the moon, Indian Space Research Organisation (ISRO) chairmain G. Madhavan Nair said on Nov 23, 2008.

“The (manned) moon mission is a tough task and to achieve that our first task is to send an Indian astronaut on a manned mission to space, who will orbit the earth and return. For this, the sanction of the government has to come.

We plan to achieve this by 2015,” Nair said at a reception accorded to him during his first visit to his home town since the successful launch of the Chandrayaan-1.

“The next moon mission by the US and China is fixed for 2020 and our target is that we also should be ready by then,” Nair added.

“To achieve that, the space mission would provide the necessary boost. Another thing that is being planned is Aditya, a mission to study the solar system from the earth’s orbit,” said Nair.

November 24, 2008 Posted by | General, India Related, Science, Technology, World News | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | Leave a comment