Download Research Tools
First to explain… no, there is no time. Let me sum up: you are a scientist with complex geospatial data visualization challenges. We at Microsoft Research have a solution for you and we’re enhancing this through the release of a software library called Narwhal. (We threw in some example applications as well.) The parent project is Layerscape and the geospatial stories are told by using the WorldWide Telescope visualization engine. The release of Narwhal is in line with our philosophy of “As long as we’re going to build some tools, let’s share them and save others having to re-invent.” Inconceivable! For more: read on!
Suppose you have some data that you’d like to look at… and it is complicated data. What do I mean by complicated? Perhaps you have a model of an electrical impulse travelling through a maze of 7,000 neurons. Or you have recovered the dive trajectories for the 43 Weddell seals you tagged last summer, or you just derived the magnetic field interactions between Jupiter and Callisto, or the Jaguar supercomputer has finally finished your solution for the thermodynamic structure of the Earth. Let’s run through the two questions that occur to the data visualizer—you—at a time like this: What format should my data be in? And how do I look at it?
WorldWide Telescope visualization of data on Puget Sound water flow
Unfortunately, there is as yet no single answer to these two questions; and to be fair, you probably already know what format your data is in (be it MATLAB, Comma Separated Value, NetCDF-CF, Microsoft Excel, or whatever). But because your data is complicated, you find it difficult to render and examine on your laptop. Well, we built WorldWide Telescope (WWT) to take advantage of your PC graphics card and now you can look at 500,000 data points as they unfold in time; watch this tour to get the idea. The ability to see the data is just the beginning; we are painfully aware that even though you can see the data, there are lots of other tasks to perform before it is useful, and that is why we built both the Layerscape website (to support content sharing) and the WorldWide Telescope Add-in for Excel (to help you import your data into WWT). All of this you can learn about at Layerscape.
So far, so good; but if you are really a technical programmer, you will see more potential here—more visualization power—than you can readily access by using Excel. In fact, you may want to be able to connect directly from your software—which helps make sense of your data—to WWT where that data will appear as pixels and lines and circles and polygons and moving sidewalks and drifting balloons and neural impulses and seal-dive trajectories and magnetic fields. Enter Narwhal: software that helps you organize your data and send it to WWT. Narwhal is in its first release, so it is not the ultimate solution, but it does take big jump in that direction. To see what sorts of things Narwhal can help you do, take a look at this video.
To wrap this up: we are certain that visualization is a key to understanding data, and that humans—and specifically, researchers—are increasingly good at deluging ourselves with massive, complex, hard-to-understand datasets. At Microsoft Research we are both happy and fortunate to get to work on related tools: Layerscape, WorldWide Telescope, and the WWT Add-in for Excel… and now Narwhal. We hope that they find their way to the scientists and educators who need them—and we will continue to refine them, so watch this blog for updates.
—Rob Fatland, Senior Research Program Manager, Microsoft Research Connections
“Despite its size, Puget Sound is ecologically delicate; and while its symptoms of trouble are not easily visible, they are undeniable and getting worse.” —The Puget Sound Partnership
We at Microsoft Research Connections have begun work on a cooperative research and development (R&D) project with the U.S. Environmental Protection Agency (EPA) that centers on the restoration of large aquatic ecosystems, particularly Puget Sound. On Friday, November 30, we got together and put our respective imprimaturs on the Cooperative Research and Development Agreement (CRADA), the formal agreement for this partnership. Now all that remains is to do the actual work! Here are some details about the project, which was created under the auspices of the Federal Technology Transfer Act, and why it is so exciting for us.
As you may know, we have a history—under the leadership of Vice President Tony Hey—of collaborating with researchers outside of Microsoft. Often, we collaborate with academicians doing research in computer science or—in my case—using technology to cope with environmental and geoscience data. We’re also very interested in how science registers in the public domain. For example: land-use policy can benefit from scientific insight, and we think that if technology can help scientists do data-intensive research, it should also help us manage resources, find better ways to preserve habitat, and better share this information with farmers, tribes, municipalities, and the general public. Taking an active role in the stewardship of our shared environment is what the EPA is about, so we began talking with them about working together.
Tony Hey, vice president, Microsoft Research Connections, and Dennis McLerran, regional administrator, EPA Region 10, shake on the agreement.
It can be difficult to comprehend how big our environment is and yet how tiny its essential elements are. Viewing Puget Sound from 40,000 feet above, it is a vast, beautiful expanse of waterways, inlets, islands, and peninsulas that are crisscrossed with the indelible stamp of cities, roads, and ferry boats supporting the lives of a few million people. Drop your perspective to the shoreline of Fir Island (Washington), and you find green strands of eelgrass washed up on the beach; under a microscope, these strands explode into millions of nodules of chlorophyll, the stuff that converts sunlight into sugar and powers the entire food web all the way up through the salmon. My point is that we inhabit the land and we depend on the health of our natural environment: from the great waterways we use for shipping to the smallest microbes and molecules. As the Puget Sound Partnership has stated, we have work to do to restore and protect the ecological health of Puget Sound, but where to begin?
The idea of this new cooperative R&D project with the EPA is to explore how available data and technology might be fused to help us better understand and meet the needs of the restoration community, including the kinds of cooperative relationships the community members want to build between the public, the land-holders, the decision makers at the county and city level, and so on. From this learning perspective, we are confident that we can imagine and build proof-of-concept solutions that would be openly available for further development and adoption. For example, we imagine (from preliminary work) applying PhotoSynth technology to the challenge of creating a more robust depiction of the shoreline. Human-built structures like sea walls are distributed throughout Puget Sound and can impact habitat, particularly for grazing fish that spawn in shallow water. More broadly, we see similar efforts at organizations like the Northwest Association of Networked Ocean Observing Systems (NANOOS) that aim to assemble and disseminate data about sea conditions, tides, and weather to help commercial fishing operations become more efficient.
What more can be done? The opportunities are boundless! What is really exciting is that our colleagues at EPA and in the broader Puget Sound community share a passion for this work; we feel very fortunate to be a part of it and are enthusiastic about the opportunity to contribute.
As readers of this blog know, Microsoft Research Connections has a deep collaborative relationship with the Brazilian research community, particularly through the Microsoft Research-FAPESP Institute for IT Research. Together, we are using computing to explore bioenergy, global warming, healthcare delivery, agronomy, and data mining, just to mention some of our current joint efforts to provide innovative solutions for the benefit of individuals, society, and our planet.
Now, I’m elated to report Microsoft Research’s 2013 Software Engineering Innovation Foundation (SEIF) awards will include a new grant of US$25,000, specifically intended to help fund a project from Brazil. This award is tangible recognition of the outstanding work being done by Brazilian investigators. As with all SEIF awards, the money is in the form of an unrestricted gift, delivered directly to the university for the purpose of funding the winning proposal. And Brazilian projects are free to compete for all other Microsoft Research awards and grants, so this new SEIF money is truly “icing on the cake.”
For me, this award is just one more reason why I love my job. I get to collaborate with Brazilian scientists from a host of disciplines at top universities—women and men who are looking for solutions to some of the world’s most vexing problems. With this additional SEIF award, I’ll have even more opportunities to work with some of Brazil’s most talented and dedicated researchers. —Juliana Salles, Senior Research Program Manager, Microsoft Research Connections