Looks like David, another program manager on the team, wrote about how to get OneNote Notebooks on USB drives and SD cards.  Check out the post for more details, this is pretty cool stuff to be honest and it works even when Windows gives your USB drive another drive letter than what it was using earlier.