Engineering Windows 7

Welcome to our blog dedicated to the engineering of Microsoft Windows 7

Media Streaming with Windows 7

Media Streaming with Windows 7

We’ve blogged about a number of features related to home networking and media in Windows 7.  A scenario which brings all these together in a pretty cool way is Media Streaming.  This scenario allows you to use a Windows 7 PC as a hub for media sharing—where you can share media with other PCs and devices on your home network via streaming, and even stream this information securely over the internet.  Scott Manchester on the Devices & Media program management team coordinated this post, but as you will see it represents work across the Core User Experience, Media Center, Networking, and even Windows Live chose to take advantage of the new APIs in this scenario.  This is a pretty detailed post and there’s a lot to try out.  Those of you using the RC to test things out, you can always install on another PC and use it for the 30-day period without requiring a new PID key.  Have fun!  --Steven

Windows 7 includes a number of exciting new media streaming features that enable you to enjoy your media collection on other PCs and devices in the home and while on the road from across the internet. We’ve created a networked media experience that is more friendly to use and simpler to set up. Now enjoying music, pictures, and video on your network connected PC or media device “just works” without concern for media formats, transports, or protocols.

There are a growing number of Network Media Devices (NMDs) certified to interoperate using an open and widely embraced industry standard called the Digital Living Network Alliance (DLNA). Windows 7 implements this open standard, which means that sharing media between NMDs, Windows PCs, Windows Home Server, and Extenders for Windows Media Center (including Xbox 360) is easier and more natural. Supporting this standard also means that the myriad of NMDs such as electronic picture frames, network radios, televisions, and others are companions to Windows 7 PCs and may seamlessly participate in the whole-home media experience.

Not Just for the Techie

We made it much simpler to configure media streaming. Before Windows 7, media streaming features were focused on media enthusiasts. To improve the setup experience, media streaming has been integrated with the new HomeGroup feature so in a typical home network configuration, media streaming is enabled and works by default. There is also a new “Stream” menu prominently displayed in the Window Media Player user interface (see figure below) that exposes simple scenario-based configuration options. These options allow you to:

  1. Set up your home PC so you can access your media libraries while away from home
  2. Allow other Windows 7 PCs and devices to push media to your Player and control it
  3. Quickly authorize all home PCs and devices to access your media collection

Each of these scenarios will be discussed throughout this post.

Configuring the stream options in Windows Media Player

HomeGroup introduces the concept of “shared libraries” for music, pictures, and video. As described in a previous blog post, these shared libraries are accessible from within the navigation pane of Windows Explorer and Windows Media Player, and from the “shared” view of each media category within Windows Media Center (see figures below). The scope of these libraries is the same from each of these views.

Libraries shared between Media Player and Media Center

Media Center

Windows Explorer will automatically discover and provide access to shared media libraries on other HomeGroup PCs. In addition, Windows Media Player and Windows Media Center will automatically discover shared libraries from:

  1. Windows Media Player 11 and 12
  2. Windows Home Server
  3. All DLNA compliant media servers (e.g. network attached storage)

Who Can Access My Shared Media Libraries?

A HomeGroup is a secured set of Windows 7 PCs that can view and consume each other’s media seamlessly. Sharing is automatically set up among HomeGroup PCs and HomeGroup settings allow you to choose what types of media you would like to share; for example, you may choose to only share your music library and not your video or pictures.

Changing homegroup settings

In addition to all HomeGroup PCs being able to access your media, we made it easy to allow devices to access shared media libraries on Windows 7 PCs. This can be done conveniently from either HomeGroup settings or within Windows Media Player:

Enable streaming.

Allowing devices to share media from Media Player

You can also choose to restrict which specific PCs or devices have access to your media by choosing “more streaming options…” from the Windows Media Player “Stream” menu.

Restricting sharing to specific devices.

Play To: Windows 7 as a Universal Remote Control for your Media Collection

In addition to playing media streamed from other shared media libraries within Windows Media Player, Windows 7 can now send media to be played on other Windows 7 PCs and DLNA-certified digital media renderers. We call this feature “Play To.” With “Play To,” you can browse or search from within Windows Media Player or Windows Explorer to find your desired media, and then choose where you want it to be played. A versatile remote control window is presented for each “Play To” session, providing you with the ability to control the entire experience.

Choosing the Play To device in Media Player

Choosing the Play To device from Explorer

It does not matter where media collections are stored. “Play To” is available for both local media libraries and for shared media libraries. If you would like to send media from one Windows 7 PC to another, choose “Allow remote control of my Player” from the Windows Media Player “Stream” menu on the receiving PC. This will cause Windows Media Player to be discovered in the “Play To” menu of other Windows 7 PCs on the same network.

Allowing remove control of the player

When media streaming is enabled on your Windows 7 PC, “Play To” will be available in Windows Media Player and Windows Explorer via the right click menu for media items. If Windows 7 has not discovered a “Play To” capable PC or device on the network, this context menu will not be available. DLNA provides guidelines to certify different device categories and roles. Not every DLNA-certified device supports the “Play To” feature. Look for DLNA-certified Digital Media Renderers (DMR), and for the best performance, look for DMR devices that carry the “Compatible with Windows 7” logo.

Compatible with Windows 7 logo

Once you’ve selected media items to play on another PC or device, a “Play To” remote control window will launch providing standard controls like play, pause, stop, skip forward and backward, seek forward and backward, volume, and mute. Not every device will support all of the control features and some media types may not support seek. Once the “Play To” remote control window is launched, you can reorder or delete items, add to the queue, or toggle repeat. It’s even possible to add new media items from Windows Media Player or Windows Explorer by dragging them into this window.

Play To remote control window.

There is no artificial limit to the number of “Play To” sessions you can launch. You may send pictures to a picture frame, video clips to a TV, and music to another Windows 7 laptop all at the same time. Furthermore, different types of media can be sent to a single destination, as shown in the example above.

What About the Xbox 360 and Extenders for Windows Media Center?

Xbox 360 has two ways to receive media streams from other Windows 7 PCs, which we refer to casually as “dashboard” mode and “extender” mode.

In dashboard mode, Xbox 360 functions in the role of a simple media player. While it’s not officially a DLNA-certified device, you can use Xbox 360 to browse the shared media libraries from Windows 7 PCs (there is also support for this in Windows Media Player 11) and pull content from those libraries for playback within the dashboard.

Using Xbox 360 for media playback

Using Xbox 360 for media playback

In extender mode, Xbox 360 (and other Extenders for Windows Media Center) is seen by Windows 7 PC’s on the network as both a Digital Media Player (DMP) and a Digital Media Renderer (DMR) device. Using the Extender for Windows Media Center on the Xbox 360, you can browse media libraries on other computers and pull that content for local playback, similar to the process of using Xbox 360 in dashboard mode. However, in extender mode Xbox 360 will also support “Play To” so that users of Windows 7 PC’s on the network can push content to it. All extenders, when associated with a Windows 7 PC, will be discovered in the “Play To” menu of other Windows 7 PCs.

Internet Access to Home Media

With Windows 7 we’ve also extended the media streaming experience outside the home and allow you to access your home media from anywhere in the world via the internet. We’ve made media streaming over the internet a natural extension of the experience within the home. For the experience to be seamless we needed to solve some significant technical challenges, such as:

  1. Discovery – Resolving the computer name at home to a routable IP address
  2. Privacy – Ensuring the home media is only accessible by authorized users
  3. Security – Encrypting browsing and streaming of media to prevent eavesdropping
  4. Reliability – Network connection speeds, media formats and bit rates, and router firewalls all create potential reliability issues for a seamless experience

To overcome these technical hurdles, we designed a model that uses an Online ID Provider to help facilitate discovery, privacy, and security. The new Online ID Provider infrastructure in Windows 7 allows you to link your Online ID (e.g. you@live.com) with your Windows user account. This enables an authentication/authorization server to provide the necessary privacy to establish a protected link between two Windows 7 PCs (e.g. your laptop on the road and your PC at home). Internet access to home media is enabled from the “Stream” menu in Windows Media Player.

Enabling internet access to home media.

The setup process walks you through linking an online ID with your Windows user account, which must be performed on both the home PC and remote PC. The same online ID must be used on both PCs in order to establish the connection between them. In order for remote PCs to access the home media collection, the PC at home (acting as a server) must be on a “Home” network location. Remote PCs (acting as clients) can browse and receive content streamed from the home PC from any network location (Public, Work, or Home). The network location is chosen when first connecting to any network and can be changed later from the Network and Sharing Center.

Specify the network to be a home network

Reliability - Network Connection Requirements

Streaming media over the internet from home works best with an “always on” broadband connection. Broadband uplink speeds vary from a modest 200Kbps to 10Mbps or more. Downlink connection speeds will also vary from crowded hotspots, hotel rooms, and wireless network connections in friends’ homes. Regardless of the uplink or downlink speeds, we wanted to ensure that even high bit rate content (e.g. high definition recorded TV) could be streamed with a good experience. The internet media streaming feature uses advanced bandwidth detection algorithms and end-to-end network heuristics to determine how to stream content that is at a higher bit rate than the smallest link in the network path.

Another challenge with internet access to home media is creating a peer-to-peer connection between the remote client PC and the home PC serving the media. A typical home network will get a single unique IP address from an internet service provider, and this IP address is shared by all the devices and PCs in the home using Network Address Translation (NAT), a function of an Internet Gateway Device (IGD) or Wireless Router. This creates a challenge for a remote PC or device to make an unsolicited connection inside the home, both in terms of resolving the home’s unique IP address and traversing the NAT to communicate directly to a unique PC or device on the home network.

Windows 7 employs some advanced NAT traversal technologies to establish the peer-to-peer connection and, with most IGDs, will allow a reliable connection to the home PC from any remote PC. For best results you should use a wireless router or IGD that has been certified by the Windows Logo program.

Media Formats

In Windows 7 we let you enjoy the media you want and don’t trouble you with the need to know about file types or codecs in most cases. (For more details, see Table 1 below). In addition to supporting local playback of new formats, we can also ensure that the content will play on devices that may not support the codec, bit rate, container, or format of that content. We accomplish this by using the new transcoding support in Windows 7.

Let’s say for instance you have a DivX movie you want to watch on your new DLNA certified television which only supports WMV and MPEG2. Windows 7 will determine the capability of the TV (codec, bit rate, etc.) and dynamically convert the DivX video to a format the TV can play. The general rule of thumb is: if Windows Media Player can play the content on the PC then the content will almost always play back on the network connected device. Bandwidth estimation techniques are used for media streaming within the home and over the internet, which enables Windows 7 to transcode using the most optimal format and bit rate.

Table of media format support.

 Table 1: New Decoders in Windows 7

The format and bit rate chosen for transcoding, especially for video, is highly dependent on the CPU performance of the transcoding PC as identified by its Windows Experience Index:

Windows Experience Index

We also created a flexible model for silicon partners to provide hardware accelerators that automatically work with media streaming and other Windows 7 features. This new acceleration model allows hardware developers to build media foundation proxies for media format encoders and decoders that are fully implemented in their hardware (perhaps in a GPU or additional hardware device). With hardware supported encoding and decoding, Windows 7 can offload the computationally demanding transcoding to dedicated hardware as a background task without affecting the CPU performance of the PC.

Digital Living Network Support in Windows 7

The Digital Living Network Alliance (DLNA) is a consortium of more than 200 companies interested in specifying technologies for exchanging media in home networks. The DLNA architecture is based on the UPnP specification, but in addition, DLNA specifies transport protocols (based on HTTP and RTP) and sets of media formats.

DLNA defines device roles (e.g. servers, players, renderers, etc.) and the protocols that these devices use to discover each other and communicate with each other (e.g. UPnP, HTTP, RTP, etc.). Windows 7 implements several of the DLNA device roles (see table 2 below) and it also implements the DLNA protocols required for communications and media exchange. With Windows 7, your PC will be able to interoperate with a broad variety of DLNA certified devices like TVs, stereo systems, cell phones, DVRs, game consoles, etc.

DLNA acronym table

Table 2: DLNA Device Profiles Supported by Windows 7

Because Windows 7 implements several device roles, there are different ways in which you could choose to use a Windows 7 PC at home. The remainder of this section explains the different scenarios.

Scenario 1: You store your music, video, and pictures on a Windows 7 PC. You’ve recently acquired a TV with a DLNA logo. Using the TV, you can browse the media library available on the Windows 7 PC. You can use the TV to watch the video and pictures, and listen to music stored on the PC. Figure 1 illustrates this scenario. In this case, the Windows 7 PC behaves as a DMS. Notice that this scenario was already available in Windows Vista and in Windows XP using Windows Media Player 11.

Figure 1: The TV unit browses and plays content stored in a PC

Figure 1: The TV unit browses and plays content stored in a PC

Scenario 2: You have a Network Attached Storage (NAS) device where you store your music, video, and pictures. The NAS device implements a DMS. You open Windows Media Player on a Windows 7 PC. You can find the NAS device using Windows Media Player, and you can browse the media library available on the NAS device. You can watch the video or pictures, and listen to music stored on the NAS device. Figure 2 illustrates this scenario. In this case, the Windows 7 PC behaves as a DMP.

Figure 2: A Windows 7 PC browses and plays content stored on a NAS device

Figure 2: A Windows 7 PC browses and plays content stored on a NAS device

Scenario 3: You have a cell phone that not only takes pictures but can push the pictures to a Windows 7 PC. You can show the pictures to your friends using the large-screen display of the PC without the need to physically transfer the files to the PC with a USB thumb drive, for example. Figure 3 illustrates this scenario. In this case, the cell phone acts as a DMS and a DMC and the Windows 7 PC behaves as a DMR.

Figure 3: A cell phone pushes pictures for display on a Windows7 PC

Figure 3: A cell phone pushes pictures for display on a Windows7 PC

Scenario 4: You’ve acquired a stereo system with the DLNA logo. On his Windows 7 PC, you’ve accumulated a vast collection of music with thousands of songs. Because your collection is large, you prefer to search, organize, and select songs using the rich capabilities of the Windows Media Player. Once you select the songs, you simply push the songs to your stereo system using “Play To.” You also have a NAS device containing an additional collection of music and video. You can use the Windows 7 PC to browse the content on the NAS device and push it to the stereo system. Figure 4 illustrates this scenario. In this case, the Windows 7 PC behaves as a DMS and a DMC.

Figure 4: A Windows 7 PC browses local content or shared content on the network. The PC then pushes the content for playback in a TV unit (DMR).

Figure 4: A Windows 7 PC browses local content or shared content on the network. The PC then pushes the content for playback in a TV unit (DMR).

There's definitely a lot to enjoy here.  Have fun!! 

-- Scott, Tim and the Devices & Media team

Leave a Comment
  • Please add 4 and 6 and type the answer here:
  • Post
  • Once again, you guys on the Engineering Windows 7 team have amazed me.  Good job!!

  • Is microsoft working on a way to use theses features on a windows Mobile phone ?

    It would be great to be able to stream video from my Windows7 PC to my WinMo phone.

    Also, I hope that the next version of WHS will have all theses functionalities build in.

    I would hate to have to have 2 computers always on just to stream media over the internet.

    Anyway, great job !

  • Firstly, I am really enjoying reading these blogs. They are very well written and contain very interesting and useful information.

    At home, I have a Win7 PC a, XBOX 360, Apple TV running XBMC and a few other devices.

    I store all my media on my 1TB NAS.

    My NAS does not support UPNP.

    In order to make this work well at home I would need to make NAS availably offline as Win7 will only index network shares if they are availably offline and you can only add network locations to your library if they are indexed. I don’t have the local storage todo this.

    This is a problem for me and for others. Its worth noting that the PDC build did not have this limitation, but I suspect that was not by design.

    I really need to store things on the NAS as it’s really useful for my other devices.

    My work around is going to be; I will by an internal drive for my main PC. I use regedit to make windows 7 use my internal drive as the index location, I will make my NAS availably offline.

    This internal drive will need to be the same size as my NAS.

  • Impressive technology. But there are still too many buttons and settings. My parents (almost 70) wouldn't get it.

    And why is it that computers joined to a domain can't send media over the internet?

  • Looks really good. Great explanation of the plethora of options available.

    Is it planned to have some type of Windows Live integration with 'Stream over the Internet' so that I can just use any web browser. Short of that, just being able to use WMP in XP and Vista would be nice, instead of it only working with Win 7 (the client, not the server, obviously).

    On a slight side note, years ago I saw a presentation where Bill Gates was talking about 'Smart Displays' where my home computer would run everything, but I would be able to see control from many places. This seems particularly useful, for Scenario 4 if my Stereo is in my bedroom and my pc is in the study, I don't want to have to go back there just to change the playlist. Can't I have my laptop or phone with me as well, and control the Home PC (with the horsepower to do the transcoding etc) from there. At the moment I think my only answer would be Remote Desktop, but there must be a more elegant solution.

    Love the blog, keep posting more, it's great stuff.

    Andrew.

  • OK so I have all the hardware I should need for this.

    Ipod, Windows 7, playstation 3

    So with this very common hardware combination what you are saying with your "It Just works" matra is that I can stream my iPod music (encoded using the loosless ALAC format) from my Windows 7 PC my PS3 without configering anything. Sounds great;-)

    I'm going to try this over the weekend to see how well windows has improved.

    Can't wait......However I don't bevieve it will work for a second.

  • My Samsung Omnia is Compatible !!!! :D

    (but download separate software)

  • Excellent work, folks!

    The only problem that I have (as I've stated in other places and other times) is the total abandonment and wholesale jettisoning of the installed base that at one point had XP Media Center and have MCE's that worked with XPMC...but were tossed-aside when it was decided to *not* support MCEs that worked with XPMC but not with Vista Media Center, forcing them to upgrade their hardware yet again to support Vista MCE.

    I know that W7 is "frozen", but come on, guys. It really shouldn't be *that* difficult to take a side-step and include the supported codebase for ,at least, the XP Version for MCE...or is it?

    --ScottKin

  • It's a pity this has been balanced by taking away features from Windows on the immediate workstation.

    I get better performance using my iPhone to wirelessly control a Sonos system from a NAS drive (that Windows won't index), than I do using Media Player with a local copy of my muisc library. In fact even Windows Explorer is faster at finding music on my local HDD than WMP is with its redundant index.

  • "Scenario 4: ... On his Windows 7 PC, you’ve accumulated a vast collection of music with thousands of songs. Because your collection is large, you prefer to search, organize, and select songs using the rich capabilities of the Windows Media Player."

    Not any more, with the Advanced Tag Editor removed from WMP and with cumulative tag errors from WMP confusing Album Artist and Contributing Artist, I'm even less likely to trust Windows Media Player with my vast collection of music.

  • What happened to the equalizer in Media Player?

    Why was the Advanced Tag Editor removed?

    Please, someone put these features back in.

    Thanks.

  • Why is mkv not supported? It's a very popular format these days. And I do not see the ogg container and vorbis audio format. While not that popular, they do still exist out on the net.

    Want to create a rich media experience? Then you implement all kinds of container, video and audio formats, the above listed being lacking and some at least popular.

    And please don't add these technologies are proprietary to WMP. A lot of people don't use it, and I certainly do not.

  • As stated above, why are you artificially limiting Windows Media Player and WMC to such confined formats? Many of the people that would actually use this technology (and would subsequently show it off to everyone else to create buzz and word of mouth) use formats not listed here (Matroska being an EXTREMELY popular format for digital playback).

    It kind of sucks. I've got a Windows 7 PC, formerly Windows Vista. I've got an xbox 360, and we even created a media center PC for our home theater here at the house. And yet I can use none of the technologies listed here nor none of the hard engineering work of the Media Center developers because it simply cannot support the formats I prefer to store my digital media.

    I'm not the only one in this situation, I know a LOT of people whom would love to use an xbox 360 as their media center, and many of them HAVE a 360, but resort to switching to a PC because your solution doesn't fulfill their digital media needs.

  • ONE MAJOR PROBLEM:

    Based on my testing with beta RC 7100, the Homegroup takes over the network settings and isolates Windows 7 from all other network shares. This does not happen immediately, it takes 2 or 3 days for the settings to "take effect".

    So in my case where I have 3 different computers in the LAN all using XP SP3 and have shared folders on each of them including Windows 7. I have tried the Media Streaming settings but none of the other computers or wireless media devices will see Windows 7, and Windows 7 will not see any of the other computers.

  • No MKV! What?! Well, maybe in another 4-6 years..

Page 1 of 10 (141 items) 12345»