Irwin Dolobowsky's Blog

SqlXml / MDAC Clarification

irwando — Mon, 07 Feb 2005 18:26:00 GMT

Apparently there's been a bit of confusion out there lately about the list of deprecated technologies in the Data Access Road Map. Both Ken and Bryant blogged about it, and I just wanted to clarify a few things:

- This article specifically referrs to SqlXml in MDAC. That's the SqlXmlx.dll file that provides nifty things like Templates and Updategams through SqlOleDB directly. This is actually a fairly old (1.0+) version of our code.

- SqlXml will be removed from future versions of MDAC, as in MDAC > 2.X. SqlXml still provies its own OleDb provider that can be used with MDAC or SQLNCLI (in Sql Server 2005). We will remain in the 2.X line.

- Notification Services has a dependency on SqlXml, but on the stand-alone version that contains Bulkload. The MDAC plans should not affect this at all.

So, SqlXml will be hanging around for a while, have no fears. Hope that clarifies a few things.

Xml Team is back!

irwando — Wed, 05 Jan 2005 04:28:00 GMT

Well, we're all back from the holidays here, spinning up again, looking forward to kicking out Yukon Beta 3 and Whidbey Beta 2. As I promised, changes are coming after the new year. The Xml Team blog should replace this one in the next day or two. In the mean time, go check it out here. I'm also going to add all of our indiviual blogs as links to the XmlTeam blog for a one-stop shop for finding all of your friendly neighborhood XML team members.

Site Change - New Year, New Blog

irwando — Wed, 15 Dec 2004 22:16:00 GMT

Tomorrow, hopefully, you'll all notice some changes to the blog here on the MSDN XML Dev Center. No, I'm not leaving, I promise. However, the blog here is being changed to move to a new blog - the XmlTeam blog. This blog will have contributions from various members of the XML team. My hope is that with more folks contributing you'll see more frequent posts and a bigger variety of posts.

You can see the new blog now up at http://blogs.msdn.com/XmlTeam .

He's Back Folks!

irwando — Fri, 10 Dec 2004 21:41:00 GMT

I know everyone missed me the last two weeks, but rest assured, I'm back and on top of things. Thanks to all those who were patient in waiting for a response from me. I was bouncing around the East for two weeks in Bermuda and New Jersey, loving every minute of it. Of course, now I'm back in bright, sunny Seattle. Well, I'm back in Seattle at least.

Coming Up

I know articles have been a bit slow lately, mostly from folks out on vacation. End of November to the end of December is always a bit of a slow down around here as everyone heads out for the holidays. Fear not though, we've got a few in the pipe:

Venkat Prasad writes a piece on Exchanging XML data with SQL Server 2000 and Reporting Services via Web Services.
Helena Kupkova will show us how to create bookmarks in XML Streams with the ResetableXmlReader.
Radhakrishnan Srikanth will present a series of articles on different components within System.Xml giving advice on usage patterns and scenarios. Should be great intro reference material for anyone developing XML apps.

We'll also be mixing in some Sql Server XML related articles now and then, and hopefully some other app-building stuff as well. We're actually doing some internal app-building here to test our Whidbey components, and I'm hoping to turn a lot of the development work there into articles up here. I've also set a goal for myself of the new year for updating the home page layout. We're going to do a bit of re-organizing which should result in a more dynamic, relevant front page.

From You!

Keep the questions and feedback coming, I appreciate it all. Over the last couple of weeks I have seen a few general problem areas:

XML in Compact Framework - Unfortunately, this is not something our team owns. The Mobile team owns this, so if you have questions about XML components in the Compact Framework head over there.
XML Downloads - The page is a bit old, that should be updated next week. Just to clarify the latest bits are:

As I continue to see more trends in questions I'll try and point them out up here.

Of course, it wouldn't be a blog post if I didn't ask for some feedback. Starting soon (right after the new year) we'll being thinking about Tech Ed '05. The XML group should be there with talks and a booth again, but is there something you specifically want to see? A particular topic discussed in a talk or other forum? No promises, of course, but send me your ideas and I'll see what I can do.

Happy Holidays!

Praise XML!

irwando — Fri, 19 Nov 2004 21:07:00 GMT

Read through my RSS items, I found a reference to this post about "The Church of XML". Seems like someone's been burned by this stuff a bit, huh? While the article is a obviously dripping with sarcasm, I actually thought it was a pretty funny read that, at the center, may actually have a few grains of truth. Here's what I seemed to get out of it (putting a little more positive spin on things):

XML is here to stay and you're probably (eh, definitely) going to have to deal with it
Just because XML is here doesn't mean you have to use it; there are times, many of them, when it isn't needed

The first point is something we all need to accept now and move on. Our group has recently begun our roadmap work for the next version of our products and I have been writing the section on SqlXml. One of the sections involves messaging to customers as to what benefits the proposed technologies will offer. Right off the bat I start with, "Plain and simple, if a customer is producing an application which transmits or receives data or other information from another system, they will more likely than not have to deal with XML." Anyone want to argue with me on that? Feel free to drop me a line, but I'm going to stand by that. XML has become the defacto standard for communication between systems. Unless you control the whole system being built and will never need to share with someone out of your control, I'm better that XML will be involved somehow, somewhere.

This brings me to the second part. If you do control everything, if you have a small app that doesn't communicate over a network or does so with a restricted set of clients, do you need XML? Maybe, maybe not. I have, in the past, recommended folks not use it. Building a small app to act as a front end to Sql Server that only a couple of folks around the office need access to? I'm pretty sure Dataset and ADO.NET will satisfy you quite well. Now am I going to stop folks from using XML if they want to? Nah, that's just not good for my job security. But I'll gladly recommend an alternate technology if need be. I think that's why I love being in the SqlXml group here. Really, it's all about how to get XML to and from other formats so you don't have to deal with it when it isn't appropriate. Hopefully going forward we will expand that beyond just to and from the database.

News from the Front

First, congrats to Jean Paoli on his being awarded the IDEAlliance XML Cup Award.

As for the rest of us around here, most of our work now has been focused on Sql Server 2000 Service Pack 4, Sql Server 2005, and Visual Studio 2005 Beta 2. We're also beginning roadmap planning for the next version of our products after that. Always an interesting process where we get to review what we've done, where we want to go, and what is going to get us there. Its still early in the process, but I'll try and keep everyone up to date on thought as I can.

Ooooh, good segue here...if you want to learn a lot more about this and want to help us out, we're hiring! Click here to check the career center for jobs available in the group. There's a place up there for you to submit your resume if you're interested. I'll even make a special deal for my loyal readers of one week, if you contact me with a link to your resume on-line, I'll forward it along for you. Please indicate preference for a position.

That's it for this week folks. Thanks to everyone who's already sent in questions and comments on the site, I've enjoyed speaking to you all. There will probably not be a post next week due to Thanksgiving, but I should be back the week after that. Happy Turkey Day to all!

First Post (redux)

irwando — Wed, 10 Nov 2004 08:46:00 GMT

Redux? Yes, that seems to be appropriate. I think I've done 2 or 3 of these "first post" entries now, but a new endeavor calls for a new First Post for what I'm sure will become the millions of my fans out there. So here we go...

Welcome to my blog! My name is Irwin Dolobowsky and I've been a Program Manager at Microsoft for 3.5 years now, all within the XML group. After interning at Microsoft in 2000, I came back to work on SqlXml, which I've owned since about month two of my employment. Since then I've also had the opportunity to work on various technologies here, including System.Xml and the SOAP Toolkit. My latest gig is this place - I've now taken ownership of the MSDN XML Developer Center from Dare. Whether this is a good or bad thing remains to be seen.

What can you expect out of my blog? Well, I must admit my knowledge of all things XML is not nearly as extensive as my predecessor, but I think I can hold my own. Expect to hear about what the latest out of the XML team is here at Microsoft as well as comments and pointers on whatever pops up on my XML Radar (which is actually RSS Bandit and a Search Folder searching titles, but it works quite well). I've also have some ideas on how to update this Developer Center to make it more dynamic and a one-stop shop for all XML related info at Microsoft. If you're curious, the following are a list of items I'd like to change here:

Bring out the MVP's - I love these folks. I always enjoy meeting up with them at conferences or chatting with them over MSN Messenger. They're out there championing our technologies every day. I want to let everyone know who they are and what they do! Other Dev Centers have the MVP of the month, links to blogs, latest posts from them, etc. Well, so too shall the XML Developer Center
Bring out the Team - My goal is to walk around the office here and poke some folks with a stick to get them to start up (or post to existing) blogs and newsgroups. We've got some brilliant folks here, and while we many not always have the most intellectual conversations, a lot of the time we do. A number of people here are already blogging, but you have to find them! We'll make that easier.
The Latest and Greatest - Releases, Newsgroup Postings, KB articles. These are dynamic things and to keep track of all of them requires visits to several sites and applications. Instead, come here to see what the latest happenings are and decide what you want to drill down into.

You'll see some other changes as well, perhaps a few tweaks to site layout and organization. I've gotten a few comments already, but if you have more feedback for me on the above or anything about the Dev Center, please drop me a line. I look forward to hearing from you! And now, off to play a little Halo 2...

SqlXml 3.0 SP3 Now Available!

irwando — Tue, 26 Oct 2004 15:21:00 GMT

SqlXml 3.0 SP3 has just been released and is now availalbe for download from http://www.microsoft.com/downloads/details.aspx?FamilyId=51D4A154-8E23-47D2-A033-764259CFB53B&displaylang=en.

This release includes bug fixes and QFE rollups, as well as the removal of SqlXml's dependency on the SOAP Toolkit. Users no longer have to install the SOAP Toolkit to enable SqlXml Web Services functionallity. This also simplifies the installion process on Windows Server 2003, on which the SOAP Toolkit was not supported. This removes barriers our customers have toward upgrading their servers to Windows Server 2003.

Thanks, and spread the word!

Irwin

Still Here, New Beginnings

irwando — Mon, 25 Oct 2004 04:30:00 GMT

Yes, for my faithful readers, I am still here. It has been quite some time since I last posted, but I hope to make these much more frequently again. Curious what I've been working on? Well...

SqlXml 3.0 SP3 - We're fixing issues with SqlXml running on Windows Server 2003, including removing our dependency on the SOAP Toolkit. This should be out this week.
SqlXml in Sql Server 2005 - Still working on that. As anyone who grabbed Beta 2 saw, we're there! Now to finish nailing that down.
SqlXml Long Term - We had planned on a new mapping stack in Whidbey, but that was cut due to varying circumstances. However, there are those of us who still believe greatly in a mapping technology as well as the need for tools and components which shred XML into ANY other form. I'm currently investigating the possibilites there.
.Net Framework 1.0 SP3 & 1.1 SP1 - I was the System.Xml contact point for the Framework's recent service packs, so I spent lots of time running around with shipping resposibilities.

As you can see, I've managed to keep myself pretty busy lately.

New Responsibilities

As Dare mentinoed, he is leaving our group for greener pastures and is leaving me the Xml Dev Center on MSDN to run. I'm very excited about this opportunity and have already formed some plans for updating it. Current thinking has the Dev Center becoming more dynamic with links to latest KB articles, downloads, conference information, maybe standards information, etc. I hope to make it a one-stop shop for any XML related information you need. Of course, the biggest thing is to make everyone out there happy with it and make it useful for you. So if you have suggestions for me, please leave a comment and let me know what you'd like to see!

Chat with us now!

irwando — Thu, 08 Jul 2004 17:08:00 GMT

Sorry, got this rather late, but for anyone interested, the System.Xml team be on for the next hour or so:

Title: C# and XML

Use XML? Use C#? Have some questions, comments, or just want listen to people talk about your favorite technologies? Join members of the C# team and Dare Obasanjo <http://blogs.msdn.com/DareObasanjo/> of the XML/Data team for a discussion about C# and XML.

Chat room: http://communities2.microsoft.com/home/chatroom.aspx?siteid=34000014

The Daily WTF

irwando — Tue, 06 Jul 2004 22:10:00 GMT

I'm sure many of you have seen it, but the Daily WTF is among the sites I check everyday (works well with the “daily” part). If not, check it out, it provides a new, amusing bit of computing wizardry each day. Today's hit particularly close to home.

Two New Articles - Bulkload in .Net and FOR XML in SQL Server 2005

irwando — Mon, 28 Jun 2004 17:45:00 GMT

There are a few new SqlXml-related articles up on MSDN.

First we have Amar Nalla's XML to SQL: Using SQLXML Bulkload in the .NET Framework which gives great examples on constructing annotated schemas and using Bulkload within .Net. Amar goes into great detail on how to feed Bulkload with a stream, a process that takes some work when going from .Net through managed interop to Bulkload. If you're using Bulkload within .Net check it out, its a great article and well worth your time to read.

A little bit older is Michael Rys's article What's New in FOR XML in Microsoft SQL Server 2005 which discusses enhancements to the FOR XML extensions to T-SQL offered by SQL Server. I've played with the new extensions a bit, not nearly as much as I should have, but am none the less very enthused about them. I think the new PATH syntax will go a long way toward helping people construct complex shapes from there relational table quicker and easier than they could be for with EXPLICIT.

Of course, this brings up the question, if we have this great new PATH mode for making complex XML shapes, why do we need mapping? Its a question I've been asked on more than a few occasions, so here are a few reasons why I still consider mapping a valuable investment:

Composability - Let's say you want to produce results that conform to the same XML schema from several queries. If you're using FOR XML, each time you have a new query, you have to make sure the output matches your target schema. However, with mapping, you define your output once, and can then query it in many ways, each time only re-writing the query. You can also then allow others to give you queries to execute and you're still guaranteed the same output format - not possible with FOR XML.

Updates - FOR XML is wonderful for producing XML from your relational data. But what about if you want to update that same data? Now you have to have a stored procedure to do the update and a FOR XML to retrieve the data, and you have to figure out how the data produced by the FOR XML statement maps back to the database. With mapping, we provide both query and update technologies, so you only have to think about one thing - the XML.

Multiple Databases - This actually relates back to Composability. You have a few different SQL databases, some 2000, some 2005, maybe with the same relational schemas, maybe not. With mapping, you can establish a mapping to each database and then query them using the same XPath queries each time, and let us handle generating the query for that particular database. If you're using FOR XML, you have to write a query for each of those databases and make sure they all resolve to the same schema.

This isn't to say I don't think FOR XML is useless or anything (though I'm obviously a bit biased toward mapping), quite the contrary. You will get much more control of the queries you're doing by using it. There is just simply more you can do by constructing the query yourself, things SQLXML does not support. You can store those queries inside stored procedures within the database, making your DBA much happier I'm sure. You can leverage your existing SQL knowledge without having to know about mapping and XPath as well.

So what am I saying here? Which one you use depends on what you consider most valuable. Do you need every last bit of performance and do you need to fine tune every query? Go with FOR XML. Can you give up some control of your queries in exchange for more composability or the ability to update? Mapping is the way to go. You can even mix the two together, don't be afraid! Query all you like with FOR XML, but when you get that 30 meg XML document, look to Bulkload to get it loaded into your database. Its ok, all of the pieces will play very nicely together, I guarantee.

Bulkload Sample Code

irwando — Sat, 29 May 2004 03:08:00 GMT

As promised, the sample code for my presentation. The Object Demo was from Andy Conrad's article “Death, Taxes, and Relational Databases, Part 2”. The other demo was mine, and here's the code. Again, the point of this demo was to show how two parties can exchange data from their databases using SqlXml. Each database has a different schema and XML is used to transfer the data. Both parties agree on a common XML schema for the data to to be transfered, and then each create a mapping to that XML schema for their database. An XPath is issued against mapping one to retrieve data and bulkload is then used with the data and mapping two to load the second database.

Mapping against Northwind:

<xs:schema elementFormDefault='qualified' xmlns:xs='http://www.w3.org/2001/XMLSchema' xmlns:sql='urn:schemas-microsoft-com:mapping-schema'> <xs:element name='Employee' sql:relation='Employees' sql:key-fields='EmployeeID'> <xs:complexType> <xs:sequence> <xs:element name='AddressList' sql:is-constant='1'> <xs:complexType> <xs:sequence> <xs:element name='Address' sql:is-constant='1'> <xs:complexType> <xs:sequence> <xs:element name='Street' type='xs:string' sql:field='Address' /> <xs:element name='City' type='xs:string' sql:field='City' /> <xs:element name='State' type='xs:string' sql:field='Region' /> <xs:element name='Zip' type='xs:string' sql:field='PostalCode' /> <xs:element name='Type' type='xs:string' sql:mapped='false' /> </xs:sequence> </xs:complexType> </xs:element> </xs:sequence> </xs:complexType> </xs:element> <xs:element name='FirstName' type='xs:string' sql:field='FirstName' /> <xs:element name='LastName' type='xs:string' sql:field='LastName' /> <xs:element name='EmployeeID' type='xs:int' sql:field='EmployeeId' /> <xs:element name='Title' type='xs:string' sql:field='Title' /> </xs:sequence> </xs:complexType> </xs:element>

<xs:annotation> <xs:appinfo> <sql:relationship name='EmployeeAddress' parent='Employee' parent-key='EmployeeId' child='Address' child-key='EmployeeId' /> </xs:appinfo> </xs:annotation> </xs:schema>

Code to Query:

   try
   {
    SqlXmlCommand mycmd = new SqlXmlCommand("Provider=SQLOLEDB;Server=localhost;database=Northwind;uid=test;password=test;");
    mycmd.CommandType = SqlXmlCommandType.XPath;
    mycmd.SchemaPath = "NWEMP.xml";
    mycmd.CommandText = "/Employee";
    mycmd.RootTag = "root";

    FileStream fs = new FileStream("EmpList.xml", System.IO.FileMode.Create);
    mycmd.ExecuteToStream(fs);
    fs.Close();
   }
   catch(Exception ex)
   {
    Console.WriteLine(ex.ToString());
   }

Mapping against Sample DB (Same database as in Andy's article, making the ID field an identiy column):

<xs:schema elementFormDefault='qualified' 
xmlns:xs='http://www.w3.org/2001/XMLSchema' 
xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance'  
xmlns:sql='urn:schemas-microsoft-com:mapping-schema'
id='EmployeeMappingSchema'> 

<xs:element name='Employee' sql:relation='Employee' sql:overflow-field='Overflow' sql:key-fields='EmployeeID'> 
  <xs:complexType> 
    <xs:sequence> 
      <xs:element name='AddressList' sql:is-constant='1'>
        <xs:complexType> 
          <xs:sequence> 
            <xs:element name='Address' sql:relation='Address' sql:relationship='EmployeeAddress' sql:key-fields='AddressType'>
              <xs:complexType> 
                <xs:sequence> 
                  <xs:element name='Street' type='xs:string' sql:field='Street' /> 
                  <xs:element name='City' type='xs:string' sql:field='City' /> 
                  <xs:element name='State' type='xs:string' sql:field='State' /> 
                  <xs:element name='Zip' type='xs:string' sql:field='Zip' /> 
                  <xs:element name='Type' type='xs:string' sql:field='AddressType' default="Work"/> 
                </xs:sequence> 
              </xs:complexType> 
            </xs:element>
          </xs:sequence> 
        </xs:complexType> 
      </xs:element>
      <xs:element name='FirstName' type='xs:string' sql:field='FirstName' /> 
      <xs:element name='LastName' type='xs:string' sql:field='LastName' /> 
      <xs:element name='EmployeeID' type='xs:int' sql:field='EmployeeID' /> 
      <xs:element name='Title' type='xs:string' sql:field='Title' /> 
    </xs:sequence> 
  </xs:complexType> 
</xs:element>

<xs:annotation> <xs:appinfo> <sql:relationship name='EmployeeAddress' parent='Employee' parent-key='EmployeeID' child='Address' child-key='EmployeeID' /> </xs:appinfo> </xs:annotation> </xs:schema>

Code to Bulkload (using COM Interop):

   try
   {
    SQLXMLBULKLOADLib.SQLXMLBulkLoad3Class objBL = new SQLXMLBULKLOADLib.SQLXMLBulkLoad3Class();
    objBL.ConnectionString = "Provider=SQLOLEDB;Server=localhost;database=SampleEmployees2;uid=test;password=test;";
    objBL.ErrorLogFile = "error.xml";
    objBL.KeepIdentity = false;
    objBL.Execute ("SEDB.xml","EmpList.xml");
   }
   catch(Exception ex)
   {
    Console.WriteLine(ex.ToString());
   }

Tech Ed Wrap-Up

irwando — Fri, 28 May 2004 05:53:00 GMT

So I was hoping to have updated the blog a bit more during the week, but the internet access in the Cabana areas was iffy, and sitting back in the room here I usually just fell asleep. This was my first Tech Ed US (I went to Barcelona last year) and I can say that it was very tiring but also very enjoyable. I just got back from the big party at Sea World and some drinks with friends, and thought that I'd throw down my thoughts before enjoying a well-deserved nights rest. You can see some stuff from the trip on my personal blog here.

Overall, I thought the conference was great. Every attendee I've talked to seems to agree and has told me that they've found it to be very well run and very valuable. Always makes you good to hear that MS is doing well, so thanks to any and all of you who came out to see us.

Booth duty was probably the most tiring part, standing up for 3 hours at a clip. Data Access seems to be a a bit of a nitch area - either you love it a lot and have a deep, technical issue or you don't care about it at all. So, our visitors tended to be fewer, but always great quality when they stopped by. It was a great chance to hear how folks are using our stuff and answer some questions.

The Cabanas were a great idea too - a bit more inimate area in which to sit and chat and answer questions. It was a great place to hang out though the internet access was kinda iffy for me. It was great that customers could come find us whenever they needed a SQL question answered.

My talk went pretty well I think. Probably had 80-100 folks in the room, not bad for the last session on Thursday right before the big party. Thanks to Kent Tegels for the praise and great write up here. I did purposefully skip details on the next SqlXml release, mostly because we're still defining it. As a result of pushing back our mapping plans to post-Whidbey, SqlXml has gained a renewed interest as the client platform for XML and Yukon. So, we're looking at what we can do to improve it. Details to follow as I get them.

Here are some other folks who've been blogging on Tech Ed if you're interested (in no particular order):

And with that, I'm off to collapse into bed. As promised, I'll get my sample code posted up ASAP, hopefully in the morning.

Thanks again to all who attended. Please feel free to leave any comments/questions for me here.

New Article - Xml Support in Microsoft Sql Server 2005

irwando — Fri, 21 May 2004 19:30:00 GMT

There's a great new article up on MSDN giving an overview of the XML Support in Sql Server 2005:

XML Support in Microsoft SQL Server 2005

How do I know its great? Well, because I contributed of course! Just a little, I did the section on SqlXml. Shankar Pal and Mark Fussell did most of it. Check it out for a great overview though.

Off to San Deigo tomorrow to get in a little golf before Tech-Ed. Demos and slides are mostly done, hopefully everyone will enjoy my talk. I've ended up with 23 slides, but that also includes a nice bulkload demo and an objects out of the database demo using SqlXml. Hopefully that will be “Extreme” enough for everyone.

Tech Ed Prep

irwando — Fri, 07 May 2004 18:08:00 GMT

The past couple of weeks I've been working on my slide deck and demos for Tech Ed (DAT 405 if you're coming). My biggest concern is to make sure that my talk isn't stale. I want to ensure that anyone who comes, whether they're brand new to SqlXml or they've used it for years, gets something out of the talk. Therefore, I'm approaching it a bit differently.

Usually we give the standard history of SqlXml, go through each feature, explain what it does, one or two small demos and an “application” demo which usually consists of a small winforms app and a few lines of code that fill a text box with XML. This year though I've (we've, to those who've helped put it together) tried to focus more on real-world application scenarios.

For example, for one of my demos I've taken Dare's RSSBandit news aggrigator and SqlXml-ified it. In this demo alone I get to cover Annotated XSD, XPath, Managed Classes, Updategrams, and Bulkload. Making it even better is that you can see how each of these fit into an actual application rather than just a form with some text and buttons.

Oh, and I think the other demo will be Andy Conrad's excellent work on using SqlXml to create Decoupled Domain Models (apparently this is the new buzz word for the old buzz word of “business objects“.

I'm hoping that this will be a much more enjoyable way to present the capabilities of SqlXml, both for me so I don't have to talk about slides for 45 minutes and for attendees so they (YOU!) can see SqlXml in action rather than just listening to these abstract thoughts.

So, come by and meet me, pound me with all those buring questions I know you have, yell at me for not having feature X, or just come out for drinks. Webdata as a while will also have a booth there, I encourage you to come check it out.