Sign in
Wenming's Big Data and Big Compute Blog
All about running HPC and Big Data workload on the Microsoft Windows Azure platform. I have been and will continue to cover a variety of topics on Hadoop, HPC, Migration from / Interops with Unix, Tips and Tricks for running HPC and Big Data.
Translate This Page
Translate this page
Powered by
Microsoft® Translator
Options
About
Email Blog Author
RSS for posts
Atom
RSS for comments
OK
Search
Tags
azure
Big Compute
Big Data
bigdata
bigdata hpc hadoop windowsazure azure
Bing
BingMap
hadoop
HDInsight
HPC
HPC Python Scientific Visualization VTK
python
windowsazure
Archive
Archives
April 2013
(7)
March 2013
(4)
December 2012
(2)
November 2012
(2)
August 2012
(1)
December 2011
(1)
May 2011
(5)
April 2011
(3)
September 2010
(1)
January 2010
(2)
December 2009
(1)
November 2009
(2)
October 2009
(1)
September 2009
(2)
July 2009
(1)
June 2009
(2)
April 2009
(1)
March 2009
(1)
February 2009
(2)
January 2009
(1)
December 2008
(1)
October 2008
(2)
September 2008
(4)
August 2008
(1)
July 2008
(3)
June 2008
(4)
May 2008
(4)
Posts
Subscribe via RSS
Sort by:
Most Recent
|
Most Views
|
Most Comments
Excerpt View
|
Full Post View
Wenming's Big Data and Big Compute Blog
A Unix to Windows porting topic: Threads and Processes
Posted
over 5 years ago
by
HPC Trekker
1
Comments
Any Intro to Unix class teaches students about the beauty of fork() exec(), the two classic calls that allow a user to create a child process. While creating processes on Unix systems are common, creating new processes under the win32 API is a very expensive...
Wenming's Big Data and Big Compute Blog
Microsoft MPI Stack Explained
Posted
over 5 years ago
by
HPC Trekker
2
Comments
The Microsoft HPC solution comes with an enhanced MPI stack. For sure, it is not the only MPI stack that runs on windows. ANL has an mpich2 mpi stack, so does HP. How does MSMPI differ from the ANL one, of which it is based on? 1. MSMPI comes in both...
Wenming's Big Data and Big Compute Blog
Windows HPC Pack RC1 Ready for download
Posted
over 5 years ago
by
HPC Trekker
0
Comments
The download is available on connect.microsoft.com. You'll have to get a "liveID" using your email address, if you haven't gotten that already. The download process has 3 steps: 1. Search for windows HPC under CONNECTION DIRECTORY, SERVER, then HPC (at...
Wenming's Big Data and Big Compute Blog
Windows HPC 2008 demystified
Posted
over 5 years ago
by
HPC Trekker
1
Comments
First, let me explain what Windows HPC is all about. Windows High performance computing team has produced two versions thus far. Their first version is called Microsoft Windows Compute Cluster Server. It is a very basic solution to the traditional HPC...
Wenming's Big Data and Big Compute Blog
Dynamic libraries on Windows, Linux and OSX
Posted
over 5 years ago
by
HPC Trekker
0
Comments
Dynamic libraries also known as shared libraries allow the same library to be used by multiple programs at the same time. Dynamic libraries work slightly different on various platforms. Here’s a quick summary of how they work on the three major platforms...
Wenming's Big Data and Big Compute Blog
Scientific computing with PYTHON on windows (2/2)
Posted
over 5 years ago
by
HPC Trekker
1
Comments
As promised in the previous blog, I have prepared a walk through to get you started on programming python on windows. This is a quick walk through of installing Enthought's Python scientific packages on windows. This bundle includes Python 2.5.2, NumPy...
Wenming's Big Data and Big Compute Blog
Scientific computing with PYTHON on Windows (1/2)
Posted
over 5 years ago
by
HPC Trekker
0
Comments
Why Python? In the scientific community, python is becoming the de facto scripting language. The obvious reasons are: 1. It is accessible, download and install in minutes. 2. The syntax is simple, just about anyone could program, read it. 3. It is dynamic...
Wenming's Big Data and Big Compute Blog
Explicit and Implicit
Posted
over 5 years ago
by
HPC Trekker
2
Comments
This is the final post of the simple HPC Math series I am composing. The previous two posts were on linear, and nonlinear solvers. Just like nonlinear solvers depend on linear solvers, time stepper solvers will depend on the previous two building blocks...
Wenming's Big Data and Big Compute Blog
5 min Intro to nonlinear solvers
Posted
over 5 years ago
by
HPC Trekker
2
Comments
Nonlinear solvers are essentially solving a system of nonlinear equations. X^2 + x -1 =0 is a nonlinear equation. As we recall from Calculus 101, to solve these equations, one has to use some variants of Newton’s method because it has fast convergence...
Wenming's Big Data and Big Compute Blog
Math under the hood
Posted
over 5 years ago
by
HPC Trekker
2
Comments
We recently had a company called Simulia visiting us at a deep dive lab. Their product, Abaqus, a commercial software package for finite element analysis prompted me to quickly brush up on my numerical computation knowledge. After all, you can't compute...
Wenming's Big Data and Big Compute Blog
Problogue
Posted
over 5 years ago
by
HPC Trekker
3
Comments
Super computing is crucial for science in the 21st century. For a long time people have been theorists or experimentalists, those have worked in synergy to develop scientific theory and explain natural phenomenon. The incredible development...
Page 3 of 3 (61 items)
1
2
3