Share via


Wenming's Big Data and Big Compute Blog

All about running HPC and Big Data workload on the Microsoft Windows Azure platform. I have been and will continue to cover a variety of topics on Hadoop, HPC, Migration from / Interops with Unix, Tips and Tricks for running HPC and Big Data.

In the first two blogs of this series, we installed the IPython notebook using the minimum...

Date: 04/17/2013

In the previous blog, we demonstrated how to create a Windows Azure Linux VM in detail. We will...

Date: 04/09/2013

I just returned from the Python in Finance Conference in New York, I would like to thank Bank of...

Date: 04/09/2013

Running the Python example step by step: We explained the basic idea behind LSA or latent semantic...

Date: 04/07/2013

Mammoth the NullSQL tool Most of us by now understand the properties of big data. Many of us are...

Date: 04/01/2013

Our previous blog, MapReduce on 27,000 books using multiple storage accounts and HDInsight showed...

Date: 03/31/2013

In our previous blog, Preparing and uploading datasets for HDInsight, we showed you some of the...

Date: 03/30/2013

In the previous blog ...

Date: 03/30/2013

  Free datasets There are many difficult aspects associated with Big Data, getting a good,...

Date: 03/30/2013

Windows Azure HDInsight Service, formerly known as Hadoop on Windows Azure, is now available inside...

Date: 03/19/2013

In a previous blog, I explained Big Compute and the newly released HPC Pack 2012 from...

Date: 12/19/2012

While most of you that have been using the Microsoft HPC Server product know the history and...

Date: 12/19/2012

About 9 months ago, I deployed a Weather forecast demo at an internal Microsoft event, Techfest. The...

Date: 11/26/2012

The Super Computing conference attracts some of biggest names in the industry, academia, and...

Date: 11/21/2012

HadoopOnAzure allows a user to run Hadoop on Microsoft Windows Azure as a service. It is currently...

Date: 08/22/2012

Last month my colleague Don Pattee at the HPC team announced the availability of the Windows Azure...

Date: 12/06/2011

  If you have CPU intensive jobs that require 100s of Cores on Azure or on HPC on-premise...

Date: 05/06/2011

  I will update here with more information as they become available for this exciting...

Date: 05/03/2011

I will be covering some of the new, and more complete Azure burst features on my blog, please stay...

Date: 05/02/2011

One of the interesting things living in Boulder Colorado for almost 20 years is that I bump into...

Date: 05/01/2011

  My previous blog showed you how to make a movie using ray tracing software and the powerful...

Date: 05/01/2011

  For the last two years, I’ve been using my 6 core 3.3 ghz Intel Nehalem X 980 processor...

Date: 04/30/2011

  We all know that Scientists and Engineers run Computationally intensive jobs. Many of us...

Date: 04/30/2011

I attended and gave a tutorial at the 11th LCI International conference last year at the Pittsburgh...

Date: 04/30/2011

Windows HPC Server 2008 R2 or version 3 of the Windows HPC Server product has RTMed in July. The...

Date: 09/11/2010

This package includes two enhancements to ease debugging HPC applications. The first feature...

Date: 01/13/2010

In the past year, the Microsoft HPC team has demonstrated the ManyFacesOfGo application running on...

Date: 01/06/2010

At SC09 Microsoft Introduced Windows HPC Server 2008R2 Beta1.  Channel 9 videos for Beta1...

Date: 12/16/2009

As an HPC cross platform developer, I have spent a good part of my 20s working on scientific codes...

Date: 11/14/2009

Quite a few folks from the Microsoft HPC team will be heading down to Portland next week to attend...

Date: 11/14/2009

Kyril Faenov, the General Manager, HPC and Parallel Computing Technologies, announced last week that...

Date: 09/28/2009

I have explained what SUA is and how it differs from Cygwin in previous blogs. Basically, SUA stands...

Date: 09/28/2009

The MPI Cluster Debugger (with C/C++ project templates) is now available via the Microsoft Download...

Date: 07/18/2009

MSMPI is Microsoft’s implementation of MPI (Message passing interface) library.  I’ve explained...

Date: 06/26/2009

    One of my previous blog explains what linpack is:   LAPACK, LINPACK, ATLAS,...

Date: 06/26/2009

resourcekit.windowshpc.net Finally version 2 is updated and online. Changes include: New Parallel...

Date: 05/01/2009

The 10th LCI (Linux Cluster Institute) international Conference on High Performance Clustered...

Date: 03/21/2009

When it comes to HPC development, linear algebra libraries are the essential building blocks. ...

Date: 02/24/2009

Overview This update fixes an issue where the HPC Pack 2008 SDK was attempting to use a function...

Date: 02/13/2009

High Performance Computing (HPC) Clusters: Reduce Complexity with IBM and Microsoft Please join us...

Date: 01/02/2009

I am at Microsoft PDC this week, demonstrating the Microsoft HPCS Server 2008. Please come by the...

Date: 10/27/2008

Yes, it's ready! I have compiled a 70 item kit full of white papers, presentations, videos, and...

Date: 10/23/2008

Many people are still wondering exactly what Windows HPC Server 2008 is. On the launch day of the...

Date: 09/22/2008

PETSc, stands for portable, extensible toolkit for scientific computation, it is a suite of data...

Date: 09/08/2008

One of the most frequent questions I get when I talk to customers is, what is my best option for...

Date: 09/06/2008

HPC Basic Profile Web Service or the HPCBP for short, is a web service, built using the Windows...

Date: 08/24/2008

Next>