ARN

MySpace to open source in-house data analysis technology

Qizmt is a distributed computation framework based on the MapReduce programming model for processing large data sets

MySpace on Tuesday will release as open source a technology called Qizmt that it developed in-house to mine and crunch massive amounts of data and generate friend recommendations in its social-networking site.

Qizmt is a distributed computation framework based on the MapReduce programming model for processing large data sets in processor clusters.

The company hopes that the developer community will be able to benefit from Qizmt, as well as enhance and extend it, said Hala Al-Adwan, MySpace's vice president of data.

In use at MySpace for about a year, Qizmt is used to power the site's "People You May Know" feature, which makes friend recommendations to users.

MySpace hopes to extend its use to other types of recommendations, like suggestions for movies or books, and for products to buy, said Al-Adwan, who will demo Qizmt on Tuesday at Computerworld's Business Intelligence Perspectives conference in Chicago with MySpace COO Mike Jones.

"We want to look at our entire data set and start exploring the realm of social analytics. We're really trying to understand the nature of our users' behavior and the relationship with each other and with content as well," Al-Adwan said.

Before creating Qizmt in-house, MySpace looked at available options for doing large scale data processing in near real time, but didn't find anything it considered appropriate to its needs and to its .Net-based development platform, she said. Qizmt was developed using C# .Net for Windows.

In June, MySpace released as open source another internally developed tool called MSFast for tracking the performance of Web sites.

Come socialise with us! Facebook | LinkedIn

References show all

Comments

Post new comment

The content of this field is kept private and will not be shown publicly.
Users posting comments agree to the ARN comments policy.
Login or register to link comments to your user profile, or you may also post a comment without being logged in.
Related Coverage
Related Whitepapers
Latest Stories
Community Comments
Tags: data analysis, mapreduce, MySpace, open source
rhs_login_lockGet exclusive access to ARN's news, research and invitation only events.
ARN Distributor Directory
Find distributors by name | vendor | location
Channel Deals
/deals/aca-pacific/436_receive-15-off-sap-crystal-server-and-designer
ACA Pacific

Receive 18% off SAP Crystal Server and Designer Licenses. Offer Ends June 28th, 2012.

More details »
ARN Vendor Directory
Find vendors by name | category

iAsset is a channel management ecosystem that automates all major aspects of the entire sales,marketing and service process, including data tracking, integrated learning, knowledge management and product lifecycle management.