One of the consistent pieces of feedback from our Australian TechEd attendees is “the schedule builder is difficult to navigate”
Rob Farley, of Lobster Pot Solutions in Adelaide used Live Labs Silverlight Pivot to create a Session Browser view. According to Rob, he screen-scraped the data.
Viewing complex data sets, such as TechEd session data, in Pivot is just beautiful. And useful.
This Pivot was highlighted by Michael Kordahi in the TechEd keynote:
In the week prior to TechEd, a magical URL appeared that exported a 3Mb XML file. This contained Session, Topic, Speaker and Room data all mashed up in XML. Only 25% of the data corresponded to real sessions. And there were other small pieces of clean up required.
My goal was to generate an OData feed of the raw data for others to use for their nefarious reasons. The easiest way would be to add an OData feed from the original source. As with most IT situations, it wasn’t that easy as the system contains PII data and the cost to implement outweighed the immediate benefit.
Onto data munging.
At this point I will have to make an admission. I like to code first. Research post the event showed that I could have used SQL Server SSIS to import the data via a schema. My attitude is that the less you deal with XML the better life is.
After downloading the XML, it is processing time.
Waitlisted = string.IsNullOrEmpty(ss.Element("waitlisted").Value) ? 0 : Convert.ToInt32(ss.Element("waitlisted").Value)
For future work, a worker-role in Azure capturing and updating the data would have reduced personal intervention in updating the data.