The new udpate for the Office Developer Tools (March 2014) contains an update with a new Template called Cloud Business App. The following article describes how to create an App connected to an SAP Service on an Office 365 tenant:

http://blogs.msdn.com/b/officeapps/archive/2014/03/11/how-to-build-a-cloud-business-app-with-sap-data.aspx 

I have followed the article and created a video of the resulting App on my O365 tenant:

http://1drv.ms/1m9wzJM

The article explains also how to connect to a demo environment provided by SAP:

http://scn.sap.com/docs/DOC-31221#section6