Sign In
Wenming's Big Data and Big Compute Blog
All about running HPC and Big Data workload on the Microsoft Windows Azure platform. I have been and will continue to cover a variety of topics on Hadoop, HPC, Migration from / Interops with Unix, Tips and Tricks for running HPC and Big Data.
Translate This Page
Translate this page
Powered by
Microsoft® Translator
Options
About
Email Blog Author
RSS for posts
Atom
RSS for comments
OK
Search
Advanced search options...
Search In:
Everything
Blogs
Forums
People
Groups
Places
Pages
Date range:
All Time
Last Year
Last 6 Months
Last 3 Months
Last Month
Last Week
Last Two Days
Tags
HPC
Archive
Archives
December 2011
(1)
May 2011
(5)
April 2011
(3)
September 2010
(1)
January 2010
(2)
December 2009
(1)
November 2009
(2)
October 2009
(1)
September 2009
(2)
July 2009
(1)
June 2009
(2)
April 2009
(1)
March 2009
(1)
February 2009
(2)
January 2009
(1)
December 2008
(1)
October 2008
(2)
September 2008
(4)
August 2008
(1)
July 2008
(3)
June 2008
(4)
May 2008
(4)
MSDN Blogs
>
Wenming's Big Data and Big Compute Blog
Posts
Subscribe via RSS
Sort by:
Most Recent
|
Most Views
|
Most Comments
Excerpt View
|
Full Post View
Wenming's Big Data and Big Compute Blog
Deploying an HPC Cluster using just PowerShell (Part I)
Posted
5 months ago
by
HPC Trekker
3
Comments
Last month my colleague Don Pattee at the HPC team announced the availability of the Windows Azure HPC Scheduler and HPC pack 2008 R2 Service pack 3 releases. The title is long, but the story is simple, while we updated our HPC on-premise solution with...
Wenming's Big Data and Big Compute Blog
Just Published: Five learning samples for Windows HPC with Burst to Windows Azure covering Parametric Sweep, Cluster SOA, and Excel UDF offloading Programming Models
Posted
over 1 year ago
by
HPC Trekker
0
Comments
If you have CPU intensive jobs that require 100s of Cores on Azure or on HPC on-premise cluster, I’ve just uploaded five easy-to-learn samples with lab instructions. (See figure 3) These samples have been added to the same location of the white...
Wenming's Big Data and Big Compute Blog
Windows HPC2008R2 SP2 Azure Burst Beta Documentation Available
Posted
over 1 year ago
by
HPC Trekker
0
Comments
I will update here with more information as they become available for this exciting distribution which covers MPI on Azure, Azure VM roles and other exciting new and essential features. TechNet Library: · What's New in Windows HPC Server 2008 R2...
Wenming's Big Data and Big Compute Blog
Windows HPC Server 2008 R2 SP2 Beta is out!
Posted
over 1 year ago
by
HPC Trekker
0
Comments
I will be covering some of the new, and more complete Azure burst features on my blog, please stay tuned! The Microsoft HPC Pack 2008 R2 software, and the Windows HPC Server 2008 R2 Suite, enables cluster based supercomputing based on x64 versions...
Wenming's Big Data and Big Compute Blog
Don’t trust the weatherman? Running my own weather forecast on Windows HPC Server (Rain is coming back to Seattle Monday)
Posted
over 1 year ago
by
HPC Trekker
2
Comments
One of the interesting things living in Boulder Colorado for almost 20 years is that I bump into NCAR (National Center for Atmospheric Research), NOAA(National Oceanic and Atmospheric Administration), and CU Boulder researchers on a daily basis. I have...
Wenming's Big Data and Big Compute Blog
Having a BLAST on Windows HPC with Windows Azure burst (1/3)
Posted
over 1 year ago
by
HPC Trekker
0
Comments
My previous blog showed you how to make a movie using ray tracing software and the powerful HPC scheduler on Azure with little programming. Today, we’ll look at a more complex example in a series of 3 blog posts in the coming months. ...
Wenming's Big Data and Big Compute Blog
Got a powerful GPU? Run my World Wide Telescope 3D Seismic Simulation Tour
Posted
over 1 year ago
by
HPC Trekker
0
Comments
For the last two years, I’ve been using my 6 core 3.3 ghz Intel Nehalem X 980 processor courtesy of Intel (thank you!), it slices through just about any workload like butter, for example, encoding a 1 hour live meeting video takes a few minutes...
Wenming's Big Data and Big Compute Blog
HPC Server SP1: Burst to Azure with little or no programming
Posted
over 1 year ago
by
HPC Trekker
0
Comments
We all know that Scientists and Engineers run Computationally intensive jobs. Many of us often wish we had an extra computer or a dozen to run the applications that seem to take forever on our desktop. We wait for the code to compile, the...
Wenming's Big Data and Big Compute Blog
Notes on Chemistry codes
Posted
over 1 year ago
by
HPC Trekker
1
Comments
I attended and gave a tutorial at the 11th LCI International conference last year at the Pittsburgh Super Computing Center. There, I had the honor to meet several leading quantum chemistry HPC code researchers. One of them, Dr. Wang Yang. ...
Wenming's Big Data and Big Compute Blog
Windows HPC Server 2008 R2 Launch Event in New York City
Posted
over 2 years ago
by
HPC Trekker
0
Comments
Windows HPC Server 2008 R2 or version 3 of the Windows HPC Server product has RTMed in July. The official launch event has been set for week of 9/20 in New York City. I have listed the agenda and cool events below, and you can also use the URL: www.weekonwallst...
Wenming's Big Data and Big Compute Blog
New version: HPC Debugger Enhancements for MPI and Cluster-SOA
Posted
over 2 years ago
by
HPC Trekker
0
Comments
This package includes two enhancements to ease debugging HPC applications. The first feature integrates the ‘F5’ experience of launching the Visual Studio 2008 MPI Cluster Debugger for C++ MPI applications and your Windows HPC Server 2008 environment...
Wenming's Big Data and Big Compute Blog
Windows HPC Server and the game of Go: Challenging 10^170 search space.
Posted
over 2 years ago
by
HPC Trekker
0
Comments
In the past year, the Microsoft HPC team has demonstrated the ManyFacesOfGo application running on the Surface and offloading game play calculations to a Windows HPC Server at several events. Here’s a little bit of background information. ...
Wenming's Big Data and Big Compute Blog
Windows HPC Server 2008R2 Beta1 Channel 9 Videos
Posted
over 3 years ago
by
HPC Trekker
0
Comments
At SC09 Microsoft Introduced Windows HPC Server 2008R2 Beta1. Channel 9 videos for Beta1 features videos are now live on the Channel 9 HPC Show . It covers Excel [ Chris Crall ], Scheduler features [ Chris Crall ], SOA [ Ming Xu and Yiding...
Wenming's Big Data and Big Compute Blog
Unix to Windows API dictionary project
Posted
over 3 years ago
by
HPC Trekker
0
Comments
As an HPC cross platform developer, I have spent a good part of my 20s working on scientific codes under different operating systems. Windows, Mac, LINUX, HPUX, AIX, IRIX, Solaris. Building /compiling code is a full time job, not to mention...
Wenming's Big Data and Big Compute Blog
Super computing 2009 next week
Posted
over 3 years ago
by
HPC Trekker
0
Comments
Quite a few folks from the Microsoft HPC team will be heading down to Portland next week to attend the 2009 super computing conference. I will be distributing a new version of the memory stick containing reference materials . ( download...
Wenming's Big Data and Big Compute Blog
China's new fastest supercomputer
Posted
over 3 years ago
by
HPC Trekker
0
Comments
China has apparently become the third country to build a petaflop supercomputer. Xinhua news agency reported on Thursday that the country has unveiled "Tianhe," a 1.206 peak petaflop machine powered by a combination of 6,144 Intel CPUs and 5,120 AMD GPUs...
Wenming's Big Data and Big Compute Blog
Microsoft buys Interactive Supercomputing (Star-P maker)
Posted
over 3 years ago
by
HPC Trekker
0
Comments
Kyril Faenov, the General Manager, HPC and Parallel Computing Technologies, announced last week that Microsoft purchased Interactive supercomputing. [ link ] This is pretty exciting news for the Microsoft HPC group, as Star-P functionalities will be integrated...
Wenming's Big Data and Big Compute Blog
Installing SUA--- a Walk through
Posted
over 3 years ago
by
HPC Trekker
0
Comments
I have explained what SUA is and how it differs from Cygwin in previous blogs. Basically, SUA stands for Sub system for Unix Applications, and it is an alternative to Cygwin if you have windows server or Windows Client (7, vista) Ultimate installed. Remember...
Wenming's Big Data and Big Compute Blog
5 minute tutorial on the amazingly easy to use MPI Cluster Debugger
Posted
over 3 years ago
by
HPC Trekker
1
Comments
The MPI Cluster Debugger (with C/C++ project templates) is now available via the Microsoft Download Center. Search for 'hpc debugger' or go directly to http://www.microsoft.com/downloads/details.aspx?displaylang=en&FamilyID=d3993532-bdf8-4024-b164...
Wenming's Big Data and Big Compute Blog
Examples of linking in MSMPI library.
Posted
over 3 years ago
by
HPC Trekker
0
Comments
MSMPI is Microsoft’s implementation of MPI (Message passing interface) library. I’ve explained it a few times before. MSMPI Explained , MSMPI SDK patch . Many people have asked me for examples that they can understand and relate to how MPI...
Wenming's Big Data and Big Compute Blog
LIZARD released into the HPC wild
Posted
over 3 years ago
by
HPC Trekker
0
Comments
One of my previous blog explains what linpack is: LAPACK, LINPACK, ATLAS, DGEMM, ACML, MKL, CUDA Easy Download Instructions 1. Go to MS download center site: http://www.microsoft.com/downloads 2. Search for "Lizard"...
Wenming's Big Data and Big Compute Blog
Windows HPC resource Kit version 2 available
Posted
over 3 years ago
by
HPC Trekker
1
Comments
resourcekit.windowshpc.net Finally version 2 is updated and online. Changes include: New Parallel computing content section in developers. Updated many older documents, presentations. New hpc webcasts from partners. New marketing white papers. We will...
Wenming's Big Data and Big Compute Blog
Linux Cluster International Conference
Posted
over 3 years ago
by
HPC Trekker
1
Comments
The 10th LCI ( Linux Cluster Institute ) international Conference on High Performance Clustered Computing was hosted at National Center for Atmospheric Research ( NCAR ) in Boulder, Colorado on 3/9 - 3/12. This year's focus was on large scale system design...
Wenming's Big Data and Big Compute Blog
HPC MATH ATTACKS: BLAS/LAPACK, LINPACK, ATLAS, DGEMM, ACML, MKL, CUDA
Posted
over 3 years ago
by
HPC Trekker
1
Comments
When it comes to HPC development, linear algebra libraries are the essential building blocks. You often hear about BLAS/LAPACK, so what exactly are they and how do they relate to the top 500 run benchmark called LINPACK? BLAS stands for basic...
Wenming's Big Data and Big Compute Blog
mpiexec not working on windows XP? We got a patch.
Posted
over 3 years ago
by
HPC Trekker
1
Comments
Overview This update fixes an issue where the HPC Pack 2008 SDK was attempting to use a function that was not available on olders versions of Windows, such as 32-bit Windows XP. If you encounter the error "The procedure entry point GetProcessIdOfThread...
Page 1 of 2 (45 items)
1
2