7:41pm ::  We have received notification from our Ops team that the failure on our servers has been fully corrected.  All functionality has been restored. 

 

1:36pm :: I'm seeing reports from users that things are coming back online.  Our operations team is still working on verifying the server, so you may see intermittent wonky behavior.

11:45am :: The downloads, product keys and personalization functionality of the Subscriptions system is currently offline.  The server that contains all of our data related to these functionalities experienced a catastrophic failure this morning. 

Normally we run in a mirrored configuration and would just have failed over, but we removed one of the servers from the mirror to upgrade it to SQL 2008 RTM - Murphy's Law at its sweetest. 

I'll update this thread as more information becomes available.

Chris - Subscriptions Dev Lead