Balgates’s Weblog

I’m Wat I’m!!!

How Does Google Store All of its Data?

Clustered serversEver wonder how Google manages all their information? Imagine Gmail, it has to keep track of the billions of emails that get sent out each day regardless of whether or not it is spam.

A Database?
My first thought was a database. But if you think about it, if e-mails were stored in a single database table, it would have billions of rows added each day. This just isn’t possible nor is it efficient when performing a search. So Google cannot possibly store their data in a database… at least not in the traditional MySQL sense.

After a bit of digging around, I found an interesting document written by some of Google’s main architect that describes their file system in great detail. It turns out Google uses a distributed file system spread over many machines. It offers huge storage (hundreds of terabytes) over thousands of machines and thousands of disks.

The Google File System

The advantage of this type of system is redundancy and low cost. Their servers are not top of the line but clustering many of them together creates a highly cost-effective file system.

It’s what Yahoo Does
The owner of the largest database in the world, Yahoo!, takes on a similar approach: clusters of cheap computers that form a distributed file system. In fact, if a computer breaks down, it’s usually cheaper and faster to throw away the computer and replace it with a new one than it is to repair it.

So if you have a bunch of old computers sitting around at home, don’t throw them out just yet… you could create your own distributed file system!

Courtesy: http://www.jonlee.ca

May 20, 2009 Posted by | Business, General, IT, Science, Software, Technology | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | Leave a comment

Infosys to freeze hiring, says signs aren’t good

S Gopalakrishnan, CEO and MD of Infosys, speaks at the Reuters India Investment Summit.

COMPANY FORECAST: S Gopalakrishnan, CEO and MD of Infosys, speaks at the Reuters India Investment Summit.

Infosys Technologies Ltd will freeze recruitment after meeting this fiscal year’s target of hiring 25,000 staff, a telling sign the global downturn is hitting India’s $52 billion outsourcing sector.

The country’s second largest software services firm however has no plans to cut jobs and is sticking with its third quarter outlook, CEO Kris Gopalakrishnan told reporters.

He said the outsourcing sector’s growth rate would halve next year as some customers delay orders. “Last year the IT industry grew more than 30 per cent, this year it is looking at somewhere in the region of 15 per cent,” Gopalakrishnan said.

India’s export-driven IT sector, used to a scorching pace of growth, has been hit by the financial crisis and recession in the United States, which contributes more than half their revenue. In the last few years, the outsourcing industry has created tens of thousands of jobs, mainly attracting young workers, as global companies look to trim labour costs.

Infosys hired 16,000-17,000 employees in the first half of the fiscal year that began in April and would honour commitments to 6,000 under training, Gopalakrishnan said. Infosys, which counts Goldman Sachs and Philips Electronics among its clients, cut its full-year dollar revenue outlook in October due to the worsening global downturn.

Gopalakrishnan said on Dec 04, 2008 the company would freeze fresh recruitment, apart from meeting specific skill needs. “We will have to look at controlling our cost, controlling our expenses making sure that we run an optimised business. We will have to look at what are things we need to do in order to prepare ourselves for the recovery.” “Growth is coming more and more from emerging markets so hese are the things we need to prepare ourselves. We should not lose momentum in this slowdown,” he said.

But Infosys still expects its strong client base and a weakening rupee to help it meet a forecast for December quarter earnings of $0.57 a share. The Indian rupee has fallen nearly six per cent so far this quarter against the dollar.

“Infosys is seeing further degradation of the demand environment, with headwinds from leadership changes at customers, a shrinking large deal pipeline …. Pricing pressure has emerged,” CLSA Asia-Pacific said in a report this week.

December 4, 2008 Posted by | General, India Related, IT, Software, Technology | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 1 Comment