As you’ve likely noticed, we’ve been experiencing problems with the Photosynth site for a few hours.  Around 7pm PST one of the data centers hosting our servers experienced a power failure.  By unfortunate chance we were upgrading some of our database servers at the same time which caused a cascading failure.  Our engineers are working around the clock to restore the service but in the meantime you may see missing thumbnails, our maintenance page, or other errors on the site while we troubleshoot.  Synthing will also be impacted and you may see slow uploads or synthing may not work at all.

 

We’ll post an update here when everything is in the clear.  Thanks for your patience.

 

UPDATE: 4/14 10am PST - We've got most systems back online now (most content on the site should be viewable, and we're accepting uploads).  We're still working through some details and will update this post once we've got a more complete status.

 

UPDATE: 4/14 12:25  PST - As many of you have reported, there are still a large number of "missing" synths that produce the message "This synth could not be loaded. The owner many have deleted it." We are restoring these synths at the moment, and sometime tomorrow all synths created before 6pm PST on April 13th should be back online. Synths created during our power failure (7pm -- 11pm PST) are currently in limbo. The may get published tomorrow, but if you want access to them now, you'll need to re-synth them. I'll update this thread when the restored data is back online. Thank you for bearing with us.

 

UPDATE: 4/16 19:00 PST -- All the content has been restored. Thanks for your patience, and please let us know (at photosynth@live.com) if you see any further issues.

 

UPDATE: 4/22 -- We had an issue unrelated to the power outage Monday night that caused a problem on our view page.  This too has been fixed, and all synths should be viewable.  Please let us know if you see any further problems.