Yahoo’s take on open source is totally different from what Google previously launched. Instead of focusing on an opensocial movement focused on the alliance of social networks, Yahoo is focusing more on the advancement of research and development of systems software for distributed computing. To do this, Yahoo launched M45, a supercomputing cluster that is a key component of Hadoop, an open source distributed file system and parallel execution environment that allows users to process massive amount of data.
Hadoop has been the adopted by many groups and had been the software of choice for supporting university coursework in internet-scale computing. And Yahoo has been one of the main contributor of Hadoop. Yahoo is making the m45 available to in supercomputing class data center to the academic community for research on systems software.
Yahoo expects to run m45 with the latest version of Hadoop as well as other state-of-the-art, Yahoo-supported, open-source distributed computing software developed by its Research arm.
To kick-off M45’s development, top researchers at Carnegie Mellon are conducting simultaneous activities on M45 that includes instrumentation and evaluation, information retrieval and large-scale graph problem analysis on the cluster, processing of large-scale computer graphics, natural language search processing and machine translation problems. After passing through the Carnegie Mellon researchers, Yahoo plans to make M45 available to other universities as well.
Here’s what Randall E. Bryant, dean of the School of Computer Science at Carnegie Mellon has to say about Yahoo’s M45:
Hadoop has become an important computing environment for data-intensive applications and Yahoo! is playing a leading role in its development. We are excited about collaborating with Yahoo! on systems software research, helping to advance the state-of-the-art, and creating new research possibilities in this critical area,
Ron Brachman, vice president and head of Yahoo! academic relations, sums up the relevance of M45 in the Academic community:
Launching this program and M45 is a significant milestone in creating a global, collaborative research community working to advance the new sciences of the Internet. This milestone is a key element of Yahoo!’s growing Academic Relations effort.
Although different in what Google has announced two weeks ago on “collaboration and cooperation” among social networks, or mobile operators, once can’t help but notice the fact that Yahoo’s announcement is more substantive and specific than the generally over-hyped announcement that Google made recently. Yahoo’s M45 may not have as big as an impact as the Open Handset Alliance or OpenSocial, but at least Yahoo clearly stated what it wants to achieve and what it is doing to achieve it.
As pointed out by Matt Cutts in his posted comment below, Google and IBM have partnered with Univ. of Washington to undertake a similar initiative earlier than Microsoft did.
Arnold, you mention OpenSocial and the Open Handset Alliance, but you didn’t mention that Google and IBM are partnering with Univ. of Washington to teach highly parallel programming using Hadoop and open source code. Over 1500+ processors will be available, and if you look at http://code.google.com/edu/content/parallel.html you’ll see that multiple lectures from the first course were videotaped and digitized so that anyone can learn more.
Here’s one article about the initiative, which was announced over a month ago:
http://radar.oreilly.com/archives/2007/10/google_ibm_give.html
But you can also search for [google ibm hadoop] to find lots more info.
I’m just now getting around to reading the press release. The first sentence says “Yahoo! Inc. … today announced that it will be the first in the industry to launch an open source program aimed at advancing the research and development of systems software for distributed computing.”
First in the industry? Google’s post was a month ago and linked to digitized lectures from even before that: http://googleblog.blogspot.com/2007/10/let-thousand-servers-bloom.html
I shrug my shoulders. :)
Blah! I remember that post, and wasn’t able to tie it up with this Yahoo press release and instead chose to link it up with the most recent Google announcements.
Anyway, take it easy on shrugging your shoulders Matt, you might get some of your shoulder joints disaligned :-)
I can get better analysis at the Wall St Journal …