Kamal Hathi - Analysis Services, SSIS, BI, data integration and beyond

Analysis Services, SSIS, BI, data integration and beyond. The focus in on SQL server Business Intelligence. Including but not limited to OLAP, Data Mining, Reporting, ETL and general Data Integration using Analysis Services, Integration Services and Reporting Services.

  • What’s in a name or "The Tale of Two Locations"

    It’s been a while, well a very long while since I wrote a blog entry, which reflects the fact that I do very little “real” work anymore and spend most of my time being a the pointy haired facilitator/manger/overhead. One thing though that overhead types like me do get drawn to and even sometimes add marginal value, is in product code-names. Especially here at Microsoft where code names have a life and meaning of their own (try “Longhorn” or even better “Chicago” or even better “Cairo”) and in SQL Server, each release has had an enduring code name (Sphinx for 7.0, Shiloh for 2000, Yukon for 2005, Katmai for 2008) which internally is how we talk about our releases and the history of the product.

    So, as it came time to put a label to the work we have been doing with regards to Self-Service BI for public consumption and disclosure, the question of code names inevitably came up. Both around what to call the project focused around Self Service Analytics/BI and the release vehicle for that work (which has a few more things in it beyond the Self Service Analytics part). For the Self-Service Analytics it was easy, primarily because we already had an internal code name: “Gemini”. Gemini has a lot of interesting connotations. To me it represents a project with ambitious goals, borrowing from NASA and the Gemini project which was the first and vital step in our journey to the moon (and if anything, we love to shoot for the moon). Gemini also followed the Mercury project in the quest to explore space and Mercury is the God of business and is associated with speed, which make an interesting fit for OLAP (you know, speed, business oriented). Anyway from that point of view Gemini was a great name for a project with huge ambitions, representing the next step in BI for Microsoft.

    Then there is the second connotation with Gemini, which is that of the constellation, the “twins”, and Gemini is all about the twins. The twins of IW (information workers) and IT. The twins of end user empowerment and central management. It is all about aligning the tensions between end users who want to create solutions quickly and arrive at insights instantly, and the IT departments who want to ensure compliance and data stewardship. It is all about delivering an enterprise credible product that is instantly accessible and appealing to end users and IT professionals alike. If it weren’t Gemini, another name may have been Janus. This duality of the product, emphasizing benefits for both constituencies and attempting to reconcile the tensions between IW and IT that we all are so familiar with is at the heart of Gemini and is reflected in the name.

     

    Then there is the code name for the release of SQL Server in which the Gemini technologies will be delivered. SQL Server has a history of code names that have national park/nature related locations, such as Yukon and Katmai. So this time around it seemed natural to go that way as well, except that given the “flat” nature of the world it made sense to go beyond, the US and North America and pick an instantly recognizable location and name. Kilimanjaro, is just that. The roof of Africa, the largest free standing mountain in the world, rising majestically in a surrounding void of anything even remotely similar. An inspiring summit, that is challenging, yet very achievable for all the climbers that attempt to scale it. Personally for me there is another link, which is that I am going to attempt this challenging yet (hopefully) achievable summit at the end of December (for details, check out my other blog).

     

    If at this point you are wondering what all this talk about Gemini and Kilimanjaro is and are not familiar with the future product release plans for SQL Server, do a search (of course on Live.com) for SQL Server Kilimanjaro or SQL Server Gemini. Or just check out the following:

     

    Article in the New York Times

    Forrester Blog

    OLAP Report

     

  • Books written by Analysis Services team members

    A number of members of the AS team have written (in some cases are still writing) books on SQL Server 2005.

    Check out:

    MDX Solutions : with Microsoft SQL Server Analysis Services 2005 and Hyperion Essbase by Siva  ( http://www.amazon.com/gp/product/0471748080/sr=8-1/qid=1146200161/ref=pd_bbs_1/103-8030353-4082221?%5Fencoding=UTF8)

    and

    Data Mining with SQL Server 2005  by Jamie and Zhaohui  (http://www.amazon.com/gp/product/0471462616/ref=pd_sim_b_3/103-8030353-4082221?%5Fencoding=UTF8&v=glance&n=283155)

    The title of the MDX Solutions book is one which makes a lot of people do a double take, seeing Microsoft AS and Hyperion in the same line. This really shows the power of having industry standards, allowing a common skill set to be leveraged across different products and vendors. The recent announcement of collaboration between us and Hyperion only reinforces this.

     Happy reading !

     

    Oh, another book to read is http://www.amazon.com/gp/product/0764584359/ref=pd_sim_b_4/103-8030353-4082221?%5Fencoding=UTF8&v=glance&n=283155 - if nothing else for the foreword !

  • SP1

    We released SP1 on the 18th of this month (April). For Analysis Services this was an important milestone in that we had identified a number of important fixes based upon feedback from the community that we wanted to make, and SP1 was the vehicle for releasing them. For me personally this was the first release after returning to AS and I was keen on us delivering a really solid SP1. I am really proud of the team in not only putting in the hard work required to meet the time bound milestones, but also having the discipline and focus required to reach really high quality bar.

     

    I would love to hear from you about any feedback you have on SP1. In general any feedback on SQL Server is welcome.

  • Now that we have RTM...

    It is hard to believe that SQL Server 2005 (aka Yukon) has finally been released to manufacturing. That happened last week, but it is still sinking in. Real proof comes in the form of http://www.sqlserverdatamining.com (run by Jamie and the rest of the DM crew) now running on the RTM build of SQL Server 2005 ! Check out the "The Art of Clustering" (http://www.sqlserverdatamining.com/ArtOfClustering/).

    I have been roped into writing the foreword for a couple of books and as I step back and reflect on the development cycle for Yukon, the magnitude of this product is finally hitting me. In the two areas that I have been most involved with - Integration Services and Analysis Services, the changes have been nothing short of revolutionary. Integration Services (SSIS) is a new product (evolved from DTS, but not DTS) and Analysis Services is pretty much a re-write and it too is in many ways a new product.

    Next week I am off to Europe to participate in the SQL Server 2005 launch activities and I guess when I see the product "unveiled" on stage it will hit me some more ...

  • ROI on Software Development

    A few weeks ago I met up with an old class mate of mine from Engineering College. Vijay Sikka is a great guy, smart, hard working and sincere and so it was so nice to meet after almost 16 years. In the meantime he had worked at Intel for a long time (in the research labs) and then moved on to do his own startups. The current one is Sikkasoft (http://www.sikkasoft.com/) and develops software for managing medical practices. Now, Vijay has a ton of experience in developing software and also is an intellectual. Add this all up, and what do you get ? A book ofcourse ! Check out "Managing ROI on Software Development" (Amazon sells it). It is about the only book that I know, which attempts to tackle this important yet difficult to quantify topic. I think that Vijay has done a great job in writing this book and if you are a software engineer or project manager or an IT business manager struggling with the complexities of managing software projects and trying to quantify what ROI you are getting, then this book is a must read.

    Now if I only can get him to write a book on SQL BI !

  • New blog home, new team ...

    I have decided to move my blog from sqljunkies.com to msdn.

    I haven't had time in the past 3 months or so to post anything. In the meantime I have changed teams within SQL Server and am now part of the Analysis Services team. SSIS though will always remain a part of me, a product and a team that I am immensely proud of. Certainly one of the highlights of my career.

    Analysis Services is also a big part of me, I worked on that team (the original Plato/OLAP Services) from 1997 to 2001 before I moved on to manage the DTS/SSIS team and so in a sense I have returned home. The AS team is bigger than the SSIS team and so this transition places more responsibilities on me and includes new and bigger challenges. I am very excited about this change, it reunites with some old friends but also lets me help drive Business Intelligence (BI) further into the mainstream. We (Microsoft) already have made huge strides in bringing what traditionally were exclusive and expensive BI technologies like OLAP and Data Mining to pretty much anyone who wants to work with these technologies. Now we have the challenge and opportunity to make these technologies even more approachable and allow them to work against the largest scale data sets and the most complex problems.

    Besides, making our products more approachable and address more and varied business scenarios, I am also excited about making the product even faster and in general more reliable (even more so than what it already is today).

    I don't have any insights (not even my usual little and obvious ones) to post about AS yet, but hopefully that will be changing soon.

     


© 2009 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker