• Kinect for Windows Product Blog

    Hackers display their creativity at Amsterdam hackathon

    • 2 Comments

    We recently traveled to the Netherlands’ capital for our latest developer hackathon. The venue, Pakhuis de Zwijger, a former refrigerated warehouse located on one of Amsterdam’s many canals, made for a very unique setting. Developers from all over Europe came for the 28-hour event, which was hosted by Dare to Difr. There were some very innovative projects, and we couldn’t have been happier with the energy of the attendees and the quality of their work.

    The participants’ energy and creativity resulted in innovative projects during the Kinect for Windows hackathon in Amsterdam (September 5–6, 2014).
    The participants’ energy and creativity resulted in innovative projects during the Kinect for Windows hackathon in Amsterdam (September 5–6, 2014).


    First place

    Team Hoog+Diep took the top prize (€1000 and one Windows v2 sensor and carrying bag per team member) for their app My First Little Toy Story 3D, which allows users to capture playful adventures with favorite toys and share them as videos with friends. The app tracks the movement of dinosaurs and helicopters while the user plays with them, then it “magically” makes the user disappear from the video before sharing it.

    Team Hoog+Diep took first place for their augmented play app, My First Little Toy Story 3D.
    Team Hoog+Diep took first place for their augmented play app, My First Little Toy Story 3D.


    Team AK took second prize with their retail analytics solution, Clara.Second place

    Team AK earned second place (€500 and one Windows v2 sensor and carrying bag per team member) for Clara, an app that provides real-time analytics for a retail store, showing how many shoppers came through and providing insights on customer behavior and product popularity.


    Team motognosis took third place for their medical rehab and analysis solution, In exTremory.Third place

    Team motognosis won third place (one Windows v2 sensor and carrying bag per team member) for their work on In exTremory, a “catch-the-shape” game for tremor analysis in clinical, rehabilitation, and home scenarios.


     Other projects presented

    Developers from all over Europe came for the 28-hour event
    Developers from all over Europe came for the 28-hour event.

    • Hero (team Hero), a tool for emergency responders that enables distant risk assessment
    • AdoptAGeek (team KiMeet), which uses natural interactions to describe a user’s soul mate and provide a picture of the perfect match
    • Connect Your Home (team Connect Your Home), a building management system with tactile feedback
    • Midi Connector* (team Connector), a virtual band experience for two people: one rocking a mean air guitar and the other on drums
    • 1999: A Space Oddysey (sic; team LUSTlab), a personal virtual reality experience that involves the physical movement of the user
    • MeTricorder (team Metrilus), an app that makes the veins in the user’s arm clearly visible via projection mapping, thereby preventing multiple needle sticks during blood draws
    • Hackathon participant ponders the codeDocinector (team Metrilus), which automatically scans documents by using Kinect
    • Cool Guys Don't (team Michael Bay Fan Club), which demonstrates that cool guys don't look at explosions—really
    • Gesture Enabled Netsupport Webservice (team Netsupport), which lets users control Bing and Google maps in the browser by using gestures
    • BodyType (team Semper Five), a game in which players form letters by using the shape of their body
    • Sign Language Interpreter (team Sign Language Interpreter), which recognizes, transcribes, and teaches the gestures of sign language
    • Defy Graphics* (team Defy Graphics), an dance game in which the environment in a club responds to what’s happening on the dance floor
    • Desert race (team Fireball), an immersive full-body experience for up to six players, who each drive their horse to the fullest by vigorously exercising and making key gestures
    • Dorky Date (team ThreeManCamel), a first-person, physics-based date similar that plays up how awkward dating can be
    • Blijft dat zo (team Vastgoed), a physics collider and forces experience that uses joint position and particles


    Upcoming events

    Developers took advantage of the enhanced skeletal tracking capabilities of Kinect for Windows v2.

    Our next hackathon will take place in Vancouver, British Columbia, November 8–9; registration opens in October, so keep an eye on our blog.

    Thanks to all the attendees of the Amsterdam event and to our wonderful hosts at Dare to Difr. I look forward to watching the projects progress and to seeing you all again at a future event!

    Ben Lower, Developer Community Manager, Kinect for Windows

    Key links

    _________________
    *Denotes projects awarded an Honorable Mention by the judges

  • Kinect for Windows Product Blog

    Newly released: update to SDK 2.0 public preview

    • 0 Comments

    Today we released another update to the Kinect for Windows SDK 2.0 public preview. This release contains important product improvements that add up to a more stable and feature-rich product. This updated SDK lets you get serious about finalizing your applications for commercial deployment and, later this year, for availability in the Windows Store. Please install, enjoy, and let us know what you think.

    The Kinect for Windows Team

    Key links

  • Kinect for Windows Product Blog

    Hacking away in Canada

    • 0 Comments

    A member of team Kwartzlab++ demonstrates his team's project VR Builder at the Kinect Hackathon in Kitchener, Ontario.
    A member of team Kwartzlab++ demonstrates his team's project VR Builder at the
    Kinect Hackathon in Kitchener, Ontario.

    Last week, we headed north to Canada for the latest stop on our Kinect Hackathon world tour: a three-day event (August 8–10) in Kitchener, Ontario, where developers gathered to develop applications* using Kinect for Windows v2. One of the three cities that make up the Regional Municipality of Waterloo, Kitchener has a booming tech community, fueled in part by the renowned computer science program at the University of Waterloo. So it was no surprise that the Kitchener attendees exhibited boundless energy and enormous creativity. Equally impressive was the hospitality of the people in Kitchener, especially Jennifer Janik and Rob Soosaar of Deep Realities, who were awesome hosts.

    And the winners* are…

    Team CleanSweep took first place.Team CleanSweep took first place.

    • Team CleanSweep took first place (US$500 and three Kinect for Windows v2 sensors) for their app Turtle Curling, an augmented reality version of one of Canada’s favorite games: curling. And no, it doesn’t send real turtles sliding down the ice. It uses two Kinect v2 sensors and a TurtleBot to create an incredibly fun version of this unique Olympic sport.
    • Team Christie Digitalia took second place (US$250 and a Kinect for Windows v2 sensor) for their app Projection Cosplay, which turns anyone into a virtual superhero by using projection mapping. Imagine yourself as a supernaturally endowed crime fighter, the nemesis of virtual bad guys everywhere. 
    • Team Command Your Space took third place (US$100 and a Kinect for Windows v2 sensor) with Command Your Space, an app that enables online shoppers to see how furniture and accessories will fit into real-world environments, as seen by the Kinect sensor. It can also be used with 3D scans of your own furniture, allowing you to do a little virtual rearranging.

    Hard at work: members of team BearHunterNinja (left) and team Titan (right)
    Hard at work: members of team BearHunterNinja (left) and team Titan (right)

    Other projects* presented

    • Angry Asteroid (team Pass/Fail), a game in the style of Angry Birds that uses Kinect motion controls
    • Art Jam (team REAPsters), a kinetic, interactive, multimedia experience in which users simultaneously interact with visual art and music using the Kinect sensor’s ability to detect motion
    • BearHunterNinja (team BearHunterNinja), an app that uses Kinect’s hand-state detection to enable the classic game of “rock, paper, scissors”; also implemented a variation of the game using custom, machine-learning gestures
    • BOHAH (team BOHAH), a therapeutic video game for children with disabilities
    • Bricktastic (team Bricktastic), who adapted their 3D brick-breaker mobile game to work with Kinect and Oculus Rift
    • ConnectConnect (team ConnectConnect), which networks together multiple Kinect sensors to allow sharing and combining of all the data in the same application, enabling more than six users and remote connections
    • Florb (team Titan), an app that lets you virtually fly, using your arms as thrusters
    • GIORP 5000 (team GIORPers), a proof of concept for an interactive retail clothing shopping experience
    • Half-Life 2 Mod for Kinect (team Barney’s Crabs), a Half-Life 2 mod with Kinect for Windows that enables movement and perspective changes
    • InteractionDemo (team Connecteraction), an app that powers experiments with Kinect data from the body, gestures, depth, and color
    • Speechy (team Speechy), a public speaking “training” program that uses Kinect to give you feedback on your posture, voice projection, and use of repeated words during presentations
    • Swish (team Focus on Fun), a marketing app that virtually dresses passersby in a store’s best outfit
    • Voice in Motion? (team Ace of Base?), an app that uses Kinect for Windows to interactively teach people American Sign Language (ASL)
    • VR Builder (team Kwartzlab++), an app that lets users build accurate 3D shapes that can then be placed in the user’s immediate area

    Upcoming events

    • Amsterdam, Netherlands (September 5–6): register at http://aka.ms/k4whackams
    • Vancouver, British Columbia (November 8): registration will open soon (keep an eye on our blog)

    Thanks to everyone who came to the event in Kitchener. I hope to see you at another event in the future!

    Ben Lower, Developer Community Manager, Kinect for Windows

    Key links

    _____________________
    *The names of the hackathon projects and teams are determined solely by the participants and are not intended to be used commercially.

  • Kinect for Windows Product Blog

    V2 meets 3D

    • 1 Comments

    As Microsoft Most Valuable Professional (MVP) James Ashley points out in a recent blog, it’s a whole lot easier to create 3D movies with the Kinect for Windows v2 sensor and its preview software development kit (SDK 2.0 public preview). For starters, the v2 sensor captures up to three times more depth information than the original sensor did. That means you have far more depth data from which to construct your 3D images.

    The next big improvement is in the ability to map color to the 3D image. The original Kinect sensor used an SD camera for color capture, and the resulting low-resolution images made it difficult to match the color data to the depth data. (RGB+D, a tool created by James George, Jonathan Porter, and Jonathan Minard, overcame this problem.) Knowing that the v2 sensor has a high-definition (1080p) video camera, Ashley reasoned that he could use the camera's color images directly, without a workaround tool. He also planned to map the color data to depth positions in real-time, a new capability built into the preview SDK.

    Ashley shot this 3D video of his daughter Sophia by using Kinect for Windows v2 and a standard laptop.

    Putting these features together, Ashley wrote an app that enabled him to create 3D videos on a standard laptop (dual core Intel i5, with 4 GB RAM and an integrated Intel HD Graphics 4400). While he has no plans at present to commercialize the application, he opines that it could be a great way to bring real-time 3D to video chats.

    Ashley also speculates that since the underlying principle is a point cloud, stills of the volumetric recording could be converted into surface meshes that can be read by CAD software or even turned into models that could be printed on a 3D printer. He also thinks it could be useful for recording biometric information in a physician’s office, or for recording precise 3D information at a crime scene, for later review.

    Those who want to learn more from Ashley about developing cool stuff with the v2 sensor should note that his book, Beginning Kinect Programming with Kinect for Windows v2, is due to be published in October.

    The Kinect for Windows Team

    Key links

  • Kinect for Windows Product Blog

    Updated preview SDK now available

    • 7 Comments

    Today, we are releasing an updated version of the Kinect for Windows SDK 2.0 public preview. This new SDK includes more than 200 improvements to the core SDK. Most notably, this release delivers the much sought after Kinect Fusion tool kit, which provides higher resolution camera tracking and performance. The updated SDK also includes substantial improvements in the tooling, specifically around Visual Gesture Builder (VGB) and Kinect Studio, and it offers 10 new samples (such as Discrete Gestures Basics, Face, and HD Face Basics) to get you coding faster. All of this adds up to a substantially more stable, more feature-rich product that lets you to get serious about finalizing your applications for commercial deployment and, later this year, for availability in the Windows Store.

    The SDK is free and there will be no fees for runtime licenses of commercial applications developed with the SDK.

    If you’ve already downloaded the public preview, please be sure to take advantage of today’s updates. And for developers who haven’t used Kinect for Windows v2 yet, there’s no better time to get started!

    The Kinect for Windows Team

    Key links

  • Kinect for Windows Product Blog

    Get in the game…literally!

    • 5 Comments

    You’re the hero, blasting your way through a hostile battlefield, dispatching villains right and left. You feel the power as you control your well-armed, sculpted character through the game. But there is always the nagging feeling: that avatar doesn’t really look like me. Wouldn’t it be great if you could create a fully animated 3D game character that was a recognizable version of yourself?

    Well, with the Kinect for Windows v2 sensor and Fuse from Mixamo, you can do just that—no prior knowledge of 3D modelling required. In almost no time, you’ll have a fully armed, animated version of you, ready to insert into selected games and game engines.

    The magic begins with the Kinect for Windows v2 sensor. You simply pose in front of the Kinect for Windows v2 sensor while its 1080p high-resolution camera captures six images of you: four of your body in static poses, and two of your face. With its enhanced depth sensing—up to three times greater than the original Kinect for Windows sensor—and its improved facial and body tracking, the v2 sensor captures your body in incredible, 3D detail. It tracks 25 joint positions and, with a mesh of 2,000 points, a wealth of facial detail.

    You begin creating your personal 3D avatar by posing in front of the Kinect for Windows v2 sensor.
    You begin creating your personal 3D avatar by posing in front of the Kinect for Windows v2 sensor.

    Once you have captured your image with the Kinect sensor, you simply upload it to Body Snap or a similar scanning software program, which will render it as a 3D model. This model is ready for download into an .obj file format designed for Fuse import requirements, which takes place in Body Hub, which, like Body Snap, is a product of Body Labs.

    In Body Hub, your 3D model is prepared for download as an .obj file.
    In Body Hub, your 3D model is prepared for download as an .obj file.

    Next, you upload the 3D model to Fuse, where you can take advantage of more 280 “blendshapes” that you can push and pull, sculpting your 3D avatar as much as you want. You can also change your hairstyle and your coloring, as well as choose from a large assortment of clothing.

    With your model imported to Fuse, you can customize its shape, hair style, and coloring.
    With your model imported to Fuse, you can customize its shape, hair style, and coloring.

    The customization process gives you an extensive array of wardrobe choices.
    The customization process also gives you an extensive array of wardrobe choices.

    Once you’ve customized your newly scanned image, you export it to Mixamo, where it gets automatically rigged and animated. The process is so simple that it seems almost unreal. Rigging prepares your static 3D model for animation by inserting a 3D skeleton and binding it to the skin of your avatar. Normally, you would need to be a highly skilled technical director to accomplish this, but with Maximo, any gamer can rig a character. Now you’re ready to save and export your animated self into Garry’s Mod and Team Fortress 2—which are just the first two games that have community-made workflows for Fuse-created characters. Support for exporting directly from Fuse to other popular "modding" games is on the Fuse development roadmap.

    On the left is a customized 3D avatar created from the scans of the gamer on the right.
    On the left is a customized 3D avatar created from the scans of the gamer on the right.

    The beauty of this system is not only its simplicity, but also its speed and relatively low cost. Within just minutes, you can create a fully rigged and animated 3D character. The Kinect for Windows v2 sensor costs just US$199 in the Microsoft Store, and Body Snap from Body Labs is free to download. Fuse can be purchased through Steam for $99, and includes two free auto-rigs per week.

    In Mixamo, your image gets automatically rigged and animated.
    In Mixamo, your avatar really comes to life, as auto-rigging makes it fully animated.

    The speed and low cost of this system make it appealing to professional game developers and designers, too, especially since workflows exist for Unity, UDK, Unreal Engine, Source Engine, and Source Filmmaker.

    Rigged and ready for action, your personal 3D avatar can be added to games and game engines, as in this shot from a game being developed with Unity.
    Rigged and ready for action, your personal 3D avatar can be added to games and game engines, as in this shot from a game being developed with Unity.

    The folks at Mixamo are committed to making character creation as easy and accessible as possible. “Mixamo’s mission is to make 3D content creation accessible for everyone, and this is another step in that direction,” says Stefano Corazza, CEO of Mixamo. “Kinect for Windows v2 and Fuse make it easier than ever for gamers and game developers to put their likeness into a game. In minutes, the 3D version of you can be running around in a 3D scene.”

    And here's the payoff—the gamer plays the 3D avatar of himself. Now that’s putting yourself in the action!
    And here's the payoff—the gamer plays the 3D avatar of himself. Now that’s putting yourself in the action!

    The expertise and equipment required for 3D modeling have long thwarted players and developers who want to add more characters to games, but Kinect for Windows v2 plus Fuse is poised to break down this barrier. Soon, you can thrill to an animated version of you fulfilling your gaming desires, be it holding off alien hordes or building a virtual community. It’s just one more example of how Kinect for Windows technology and partnerships are enhancing entertainment and creativity.

    Kinect for Windows Team

    Key links

  • Kinect for Windows Product Blog

    Hats off to hackers—innovative solutions aplenty at Redmond hackathon

    • 1 Comments

    This past weekend, we were delighted to host a Kinect for Windows v2 hackathon on the Microsoft campus in Redmond, Washington. We saw some very cool, extremely ambitious projects. We were also joined by some special guests: Christian Schaller and Hannes Hofman of Metrilus came from Germany to share their finger tracking library with participants, and Adrian Ferrier, Mitch Altman, and Aaron Bryden came to show the progress they’ve made on their New York Hackathon project, lightspeed.


    And the winners are…

    • Team C-Labs took first place (US$500 and two Kinect for Windows v2 sensors) for their app Factory-Relay, an Internet of Things factory automation, safety, and control system.

    First-place winners, Team C-Labs

    • Team Ah Kon Cha! earned second place ($250 and a Kinect for Windows v2 sensor) for their game Ah Kon Cha!, a fresh twist on the classic Japanese game show Hole in the Wall.

     Second-place winners, Team Ah Kon Cha!

    • Team BodyMetrics took third place ($100 and a Kinect for Windows v2 sensor) with their project BodyMetrics JointCenterOfMass, which demonstrated how to interpret joint velocities and the center of mass hierarchy for limbs not touching the ground.

    Third-place winner, Team BodyMetrics

    Honorable mention

    Three other projects were recognized by the judges. Each team received a Kinect for Windows v2 sensor.

    • K4Health (team K4Health), which uses Kinect for Windows for smart monitoring and analysis of sleep, posture, and other body states.

     Team K4Health

    • Mini-Mech (team Quaternionundrum) supports robot avateering by applying the joint orientations of a Kinect skeleton to a mechanical system.

     Team Quaternionundrum

    • Tumble Rumble in the Jungle (team The Jungle) is a game in which two players must discover how move their little creature as fast as possible, using their body to push, shove, and fling their way to victory.

    Team The Jungle

     

    Other projects presented

    • 2048-K (team Metrilus), the puzzle game 2048 with Kinect-enabled interactions
    • Dynamic Perspective (team K-n00bs), which tracks the location of your head to dynamically change the perspective on screen and create an immersive, 3D experienceConnectify (team Connectify), which combines Kinect for Windows and Microsoft Azure to build interactive displays with dynamic content and provides real-time analytics on user engagement for the purpose of customizing the content
    • K-Kontroller (by Chet Lemon), which uses custom Kinect gestures and puts them into any game on your PC
    • K-Polygraph (by Dwight Goins), a Windows Store application that uses Kinect for Windows to evaluate subtle facial expressions, voice pitch, and body movements to determine the truthfulness of responses
    • NUI MoCap (by Jackson Fields), which provides motion capture by using body joints of the Kinect for Windows v2 sensor and rigging them to a character in Unity3D
    • NUIConductor (team NuiStar), which lets users change the tempo and selection of music by using gestures


    Upcoming hackathons

    Thanks again to everyone who came to the event in Redmond this past weekend! It was great to meet new people and to see innovative ideas put into action.

    I hope to see you at another event in the future!

    Ben Lower, Developer Community Manager, Kinect for Windows

    Key links

  • Kinect for Windows Product Blog

    Developing with Kinect for Windows v2 on a Mac

    • 5 Comments

    With the launch of the Kinect for Windows v2 public preview, we want to ensure that developers have access to the SDK so that you can start writing Kinect-based applications. As you may be aware, the Kinect for Windows SDK 2.0 public preview will run only on Windows 8 and Windows 8.1 64-bit systems. If you have a Windows 8 PC that meets the minimum requirements, you’re ready to go.

    For our Macintosh developers, this may be bittersweet news, but we’re here to help. There are two options available for developers who have an Intel-based Mac: (1) install Windows to the Mac’s hard drive, or (2) install Windows to an external USB 3.0 drive. Many Mac users are aware of the first option, but the second is less well known.

    First, you need to ensure that your hardware meets the minimum requirements for Kinect for Windows v2.

    Due to the requirements for full USB 3.0 bandwidth and GPU Shader Model 5 (DirectX 11), virtualization products such as VMWare Fusion, Parallels Desktop, or Oracle VirtualBox are not supported. If you’re not sure what hardware you have, you can find out on these Apple websites:


    Installing Windows on the internal hard drive of your Intel-based Macintosh

    We’re going to focus on getting Windows 8.1 installed, since this is typically the stumbling block. (If you need help installing Visual Studio or other applications on Windows, you can find resources online.)

    Apple has provided a great option called Boot Camp. This tool will download the drivers for Windows, set up bootable media for installation, and guide you through the partitioning process. Please refer to Apple’s website on using this option:


    Alternative to installing Windows on your primary drive

    Boot Camp requires Windows to be installed on your internal hard drive. This might be impractical or impossible for a variety of reasons, including lack of available free space, technical failures during setup, or personal preferences.

    An alternative is to install Windows to an external drive using Windows To Go, a feature of Windows 8 and 8.1 Enterprise. (Learn more about this feature in Windows 8.1 Enterprise.)

    In the section, Hardware considerations for Windows To Go, on Windows To Go: Feature Overview, you can find a list of recommended USB 3.0 drives. These drives have additional security features that you may want to review with your systems administrators, to ensure you are in compliance with your company’s security policies.


    Getting started with Windows To Go

    • You will need the following to proceed:
    • Existing PC with USB 3.0 that has Windows 8/8.1 Enterprise installed (the “technician computer”)
    • USB 3.0 flash or external hard drive
    • Windows 8/8.1 Enterprise installation media (CD or ISO)
    • Windows 8/8.1 product key

    You will need to log in as the administrator. Start the Windows to Go tool, press Win-Q to start the search, and enter Windows To Go:

    press Win-Q to start the search, and enter "Windows To Go"

    Launch the Windows To Go application from the list. From the main application window, you will see a list of the attached drives that you can use with the tool. As shown below, you may be alerted of USB 3.0 drives that are not Windows To Go certified. You can still use the drive but understand that it might not work or could have an impact on performance. If you are using a non-certified USB 3.0 drive, you will have do your own testing to ensure it meets your needs. (Note: while not officially supported by Microsoft, we have used the Western Digital My Passport Ultra 500 GB and 1 TB drives at some of our developer hackathons to get people using Macs up and running with our dev tools on Windows.)

    "Choose the drive you want to use" window

    Select the drive you wish to use and click Next. If you have not already done so, insert the Windows 8.1 Enterprise CD at this time. If you have the .ISO, you can double-click the icon or right-click and select Mount to use it as a virtual drive.

    If you have the .ISO, you can double-click the icon or right-click and select Mount to use it as a virtual drive.

    If you do not see an image in the list, click the Add search location button and browse your system to find the DVD drive or mounted CD partition:

    Browse your system to find the DVD drive or mounted CD partition.

    It should now appear in the list, and you can select it and click Next.

    Select your Windows 8.1 image and click "Next."

    If you need or wish to use BitLocker, you can enable that now. We will Skip this.

    "Set a BitLocker password (optional)" screen 

    The confirmation screen will summarize the selections you have made. This is your last chance to ensure that you are using the correct drive. Please avail yourself of this opportunity, as the Windows To Go installation process will reformat the drive and you will not be able to recover any data that is currently on the drive. Once you have confirmed that you are using the correct drive, click Create to continue.

    "Ready to create your Windows To Go workspace" window

    Once the creation step is complete, you are ready to reboot the system. But first, you’ll need to download the drivers necessary for running Windows on Macintosh hardware from the Apple support page, as, by default, Windows setup does not include these drivers.

    I recommend that you create an Extras folder on your drive and copy the files you’ll need. As shown below, I downloaded and extracted the Boot Camp drivers in this folder, since this will be the first thing I’ll need after logging in for the first time.

    Extracting the Boot Camp drivers from the Extras folder I created.

    Disconnect the hard drive from the Windows computer and connect it to your Mac. Be sure that you are using the USB 3.0 connection if you have both USB 2 and USB 3.0 hardware ports. Once the drive is connected, boot or restart your system while holding down the option key. (Learn more about these startup key shortcuts for Intel-based Macs.)

    Connect the hard drive to your Mac and restart your system while holding down the option key.

    During the initial setup, you will be asked to enter your product key, enter some default settings, and create an account. If your system has to reboot at any time, repeat the previous step to ensure that you return to the USB 3.0 workspace. Once you have successfully logged in for the first time, install the Boot Camp driver and any other applications you wish to use. Then you’ll have a fully operational Windows environment you can use for your Kinect for Windows development.

    Carmine Sirignano
    Developer Support Escalation Engineer
    Kinect for Windows

    Key links

     

  • Kinect for Windows Product Blog

    Media wall promotes engagement at Liberty University

    • 0 Comments

    Ah, the college library: a place of studious reflection and solipsistic quietude—and these days, a whole lot more. On many campuses today, parts of the library have become centers of interactive, multimedia experiences. And perhaps no school has taken this aspect of the modern library further than Liberty University in Lynchburg, Virginia. Serving more than 100,000 students—some 12,000 on campus and more than 90,000 online—Liberty University has established itself as a leader in digital education. Their commitment to using technology to engage and connect with students is front and center in the university’s Jerry Falwell Library, a $50 million, state-of-the-art facility that opened to rave reviews in January 2014.

    Upon entering the library, visitors are greeted by an enormous visual display—a media wall measuring 24 feet by 11 feet, composed of 198 interactive tiles that are controlled by three Kinect for Windows sensors. The wall displays animated visualizations of photos submitted, via social media, by Liberty students and staff. The sensors enable library visitors to use gestures to grab the photos and reveal details about what’s being depicted.

    The media wall thus provides a current snapshot of life at Liberty University—not just on campus but around the world, since most of the school’s students are distance learners. Tim Siegel, systems librarian at Liberty, feels that the wall helps students realize they are part of a bigger picture by “showing the impact that Liberty is having.”

    In order to meet the challenge of providing interaction across the entire width of the wall, Liberty teamed up with InfoStrat, a Kinect for Windows partner located in Washington, D.C., to develop the visualizations and create a custom service that enables the simultaneous use of multiple Kinect for Windows sensors. The sensors are critical to engaging students in this experience and demonstrating Liberty’s technical leadership. Marcy Pride, dean of the library, praises the Kinect feature for the way it draws students in, noting that it “positions us nicely as a twenty-first-century library that uses the technology to engage students, to allow them to have a sense of control, and to give them the opportunity to be creative and innovative.”

    The Falwell Library installation isn’t the first university media wall, but it’s certainly one of the most technologically advanced. The staff surveyed other university installations but wanted to do something bigger and better. When they asked InfoStrat how to make a richer media wall experience, the obvious answer was to make it interactive with Kinect for Windows. The payoff was substantial, as Joshua Blake, technical director of InfoStrat’s Advanced Technology Group, describes. “When students first visit the library, they may not know that the video wall is interactive. As they walk through the space, or they see someone else interacting, it’s a bit of a surprise—this huge video wall responds to them, thanks to the Kinect sensors.”

    As Blake explains, Kinect for Windows is the key to this interactive experience. The arrangement of the three sensors creates a continuous interactive space in front of the entire video wall. These sensors are connected to a single computer via USB extenders, and a Windows Service processes and combines the data from each sensor.

    The media wall visualization is driven by a Unity application, which gets social media and configuration data from a custom web service on a server located elsewhere, and the Kinect interaction data from the local Windows Service through shared memory. The web server ingests the social media posts and images and hosts a management website that allows administrators to moderate posts and remotely configure what is displayed on media wall through the Unity application.

    All that technical wizardry makes the media wall work seamlessly for the visitors who stand in front of it, excitedly waving their arms to move images around and gesturing to access additional information. In the process, they become more deeply connected to the university’s worldwide student body and its many outreach programs. Who knew that the library could be such a potent social force?

    The Kinect for Windows Team

    Key links



  • Kinect for Windows Product Blog

    Hackers push the new Kinect for Windows sensor and preview SDK

    • 0 Comments

    The Kinect for Windows hackathon in Dallas last weekend, July 18–19, was an amazing event, thanks to the 114 developers and designers who willingly gave up their Friday evening and all day Saturday to explore the potential of the new Kinect for Windows v2 sensor and the SDK 2.0 public preview.

    Big thanks to Skip Howard and Computer Visionaries for helping to organize such a great event, to The Dallas Entrepreneur Center for providing the awesome venue, and to local Microsoft evangelists Jason Fox, Nathalie Goh-Livorness, and Anna Lergaard for going above and beyond in collaborating with us in Dallas!
     
    The projects

    My team and I left inspired by the creativity and passion that all of the 15 presented projects displayed. We were absolutely blown away by the three winning efforts. The top prize of US$500 and two Kinect for Windows v2 sensors went to the creators of Super Dueling Golem Dudes, a two-versus-two game in which a player’s gestures control moving platforms that help his or her teammate shoot at their opponent. Earning second-place honors—and $250 and a Kinect for Windows v2 sensor—was the team that developed Kinectergarden, an educational app that lets young children explore their environment and learn new words, objects, and skills. The third-place prize of $100 and a Kinect for Windows v2 sensor was snagged by Put Me in Space, a project that allows users to create a photograph of themselves anywhere in (or out) of this world.

    More than 100 eager hackers put the Kinect for Windows v2 sensor and the SDK 2.0 public preview through its paces.
    More than 100 eager hackers put the Kinect for Windows v2 sensor and the SDK 2.0 public preview
    through its paces.

    And the winners are…

    • Super Dueling Golem Dudes took first place ($500 and Kinect for Windows v2 sensors)

    First-place winners, Super Dueling Golem Dudes

    • Kinectergarten took second place ($250 and a Kinect for Windows v2 sensor)

    Second-place winners, Kinectergarten

    • Put Me in Space took third place ($100 and a Kinect for Windows v2 sensor)

    Third-place winners, Put Me in Space

    The other 12 projects presented on Saturday night were:

    • WaveMeIn, an app that makes passwords passé.  Wave me in, Scotty!
    • Cori App, a digital assistant that controls other applications and connected devices.
    • BorgVision, a utility to help users assimilate into the Borg Kinective.
    • Fly Up, an app that gets you airborne, as your Kinect avatar flies up and off the screen.
    • Sync or Not, an app that maps two people's locations in 3D space and determines if they are moving in sync.
    • STOP!, a potentially lifesaving app that visually detects stop signs and forcefully instructs the driver to stop. 
    • Virtual Skan, an online shopping app that selects the appropriate garment size for the shopper based on a Kinect sensor scan.
    • Talk Charms, an augmentative and alternative communication system that allows nonverbal children to communicate by selecting words and phrases to be played via text-to-speech.
    • Wakie Wakie, another potential lifesaver that prevents drivers from falling asleep at the wheel.
    • Booty Bounce, an app that brings the aerobic power of twerking to your screen, letting you use a variety of twerks to get in shape or just have fun. Miley Cyrus would approve.
    • Clubby VJ, an app that lets you create a cool avatar, whose special effects are perfect for a night of clubbing.
    • Capable Home Kinect, an app that tracks facial movements and uses facial cues to allow quadriplegics to operate devices within the home.

    Upcoming events

    We have more hackathons scheduled this summer, and we’d love to see you at one of them. Just click the link to register.

    Thanks again to all who took the time to join us in Dallas. I got a big jolt of energy from the collected creativity and passion. If you have questions or need help, please use the following resources:

    You can also email me at kinectninja@microsoft.com if you have other questions or just want to say hi.

    I hope to see you at a future event!

    Ben Lower, Developer Community Manager, Kinect for Windows

    Key links



Page 1 of 11 (103 items) 12345»