As you may have read in some of my previous posts, I spent the first 7 months of 2010 contributing to the SharePoint Online standard 2010 infrastructure. This infrastructure will provide SharePoint 2010 based services to tens of millions of people worldwide. In fact, it makes SharePoint fly in the Cloud, using Microsoft “boxed” / available products.
There are few keys to have in mind when thinking about this:
If you follow my blog, you will know that SharePoint Automation is a whole topic in itself, and one that I am passionate about.
I have developed the following broad thinking for automation and optimization of the services:
I spent a lot of time studying these concepts with 2 aspects in mind:
It led me realizing that: Cloud computing is the "Industrial age" of Datacenters!
My academic background is in Industrial Engineering, with a (French equivalent) Master of Science diploma in Industrial Engineering and certain advanced specializations.
Cloud computing terminology is very close to that of Industrial Engineering (sometimes closer to than to Computer science). Check for yourself terms you’ll find in the references and books at the end of this post, such as:
ALL these words are from mechanics, physics or industrial engineering that have been developed for more than a century, when “factories” were invented.When you see a “modern – Internet scale” Datacenter … what do you see? You see a huge building, looking like a car supplier factory more than a “data processing” facility, don’t you? So I started to analyze the core similarity between the “factories” that I used to work with while in automotive industry, and the Cloud computing concepts. This is how I came to the “Digital Plant” concept.
While I studied which Industrial approaches and tools could be transferred to design Digital Plants, I found common points between Computer and Industrial science:
Based on these roots, I searched for technics and mathematical tooling used in Industry that could be applied to Cloud computing. I found some of them very useful and interesting when transferred into a Digital plant. They include:
=> Resource optimization is the essence of Industrial Engineering.
It means Digital plants mix and optimize a lot of different distributions, like:
Here are few examples of what should be considered relevant models:
If you transform this measure into time spent in "ranges" (like 0 to 10%, 10 to 19%, etc.), you'll obtain a CPU resource distribution close to this model
Now let's zoom on the first 10%, and the trend is clearer: This is an exponential distribution
And the funny part. This same LUN, now seen through the items counts per file extension: same pattern!
As I moved on to sort out all these ideas, I realized various things:
To end this call for a story to write, I'd like to emphasis 2 things:
Contact me if you're interested too :-)
Thanks reading this long post, which is broader than just SharePoint automation.
< Emmanuel />
The evolution of Cloud Computing and the changing anatomy of a Microsoft data center: http://sharepointineducation.com/the-evolution-of-cloud-computing-and-the-changing-anatomy-of-a-microsoft-data-centre
Data Center knowledge: http://www.datacenterknowledge.com/
Microsoft Datacenters Blog: http://blogs.technet.com/b/msdatacenters/
Automation definition: http://en.wikipedia.org/wiki/Automation
Automation Outline: http://en.wikipedia.org/wiki/Outline_of_automation
Principles & Theory of Automation: http://www.britannica.com/EBchecked/topic/44912/automation/24841/Principles-and-theory-of-automation
The Cloud: Battle of the Tech Titans: http://www.businessweek.com/magazine/content/11_11/b4219052599182.htm
The Datacenter as a Computer, Luiz Barroso, Urs Hölzle (Google Inc.), Morgan & Claypool, http://www.morganclaypool.com/doi/pdf/10.2200/S00193ED1V01Y200905CAC006
Monitoring the Data Center, Virtual Environments, and the Cloud, Don Jones, http://nexus.realtimepublishers.com/dgmdv.php
The Big Switch, Nicholas Carr, W. W. Norton & Company, http://www.nicholasgcarr.com/bigswitch/