Dryad & DryadLINQ Team Blog

The basic computational model we decided to adopt for Dryad is the directed-acyclic graph (DAG). Each node in the graph is a computation, and each edge in the graph is a stream of data traveling in the direction of the edge. The amount of data on any...

It’s been a while since we posted on the blog but a question posted today on the forum is a good opportunity to break the silence. The question is about what to do when your program fails on the cluster. Recently Microsoft Research held its...

Sometimes it’s interesting to get some context about how a research project started out, what its original goals were, and how they changed over time. This post goes into a bit of that history of the Dryad project. From mid-2003 until early 2005, I...

When we first announced the public download of DryadLINQ, academic researchers and scientists were the primary audience we had in mind. Since the announcement, we received a number of inquiries from commercial users who would like to try the technology...

Research and technology are constantly evolving. Dryad and DryadLINQ are not immune. We know this has caused some confusion to users of our external release. For example, the Dryad paper presented at EuroSys’07 reports results obtained on compute nodes...

Michael has done a great job introducing Dryad. Now, let us take a look at what DryadLINQ is. DryadLINQ provides a new programming model for large scale data-parallel computing. The most unique feature of DryadLINQ is its complete integration with...

We’re going to start off this blog with a couple of basic posts explaining what Dryad and DryadLINQ are. I’m going to start by introducing Dryad, and Yuan will follow on with DryadLINQ. Dryad is an execution engine that is optimized for certain types...

Last Tuesday at PDC’09 , John Vert gave a comprehensive overview of the DryadLINQ framework for data-intensive computing on Windows HPC Server. John is an architect in the HPC Server team and he has played a key role in the development of the adapters...

We made the Dryad/DryadLINQ research stack available as a free download last July. Since then, we’ve made a number of improvements that we wanted to share. Today, we are pleased to announce the availability of an update to our initial release. The...

Welcome to the official Microsoft blog for Dryad and DryadLINQ! The purpose of this blog is to share information about the design and implementation of our system, and also about ways that people are using Dryad and DryadLINQ to perform distributed computations...