Engineering Windows 7

Welcome to our blog dedicated to the engineering of Microsoft Windows 7

The Windows Feedback Program

The Windows Feedback Program

  • Comments 72

Introducing Christina Storm who is a program manager on the Windows Customer Engineering feature team working on telemetry. 

In a previous article Steven has introduced the Windows 7 Feature Teams. I am a program manager working on telemetry on the Windows Customer Engineering team. Our team delivers the Windows Feedback Program, one of several feedback programs in place today that allow us to work directly with customers and make them part of our engineering process.

The Windows Feedback Program (WFP) has been active for several years during the Windows XP and Windows Vista product cycles, and we are currently ramping up to get all aspects of this program ready for Windows 7. At the core of this program is a large research panel of customers who sign up via our website http://wfp.microsoft.com during open enrollment. Customers choose to be part of a survey program, an automated feedback program or both. They then complete a 20-minute profiling survey, which later allows us to look at their feedback based on their profile. We have customers spanning a wide spectrum of computer knowledge in our program, and we are constantly working on balancing the panel to staff up underrepresented groups. The majority of customers who are spontaneously willing to participate in a feedback program like ours are generally enthusiastic about technology. They are early adopters of consumer electronics, digital devices and new versions of software. In contrast, customers who see the PC as a tool to get a job done tend to be a bit more reluctant to join. And we also need more female participants!

Customers who participate in the automated feedback program install a data collection tool developed by the Windows Telemetry Team. The privacy agreement of this program describes the data collections our tool performs. Here are a few examples:

  • Windows usage behavior including installed and used applications.
  • File and folder structures on your computer, including number of types of files in folders, such as number of jpg files in the Pictures folder.
  • System-specific information, such as hardware, devices, drivers, and settings installed on your computer.
  • Windows Customer Experience Improvement Program (CEIP) data.

From the collected data we create reports that are consumed by a large number of Windows feature teams as well as planners and user researchers. This chart below shows the answer to the following question: What is the most common file type that customers who participate in our program store on their PCs and what are the most popular storage locations?

Graph showing common file types and locations.  The most common file type are .jpg across all typical locations.

The results help us both with planning for handling the volumes of data customers store on their PCs as well as mimicking real-life scenarios in our test labs by setting up PCs with similar file numbers and file sizes and distribution of files on the PCs.

These data collections furthermore allow us to create reports based on profiled panelists. The above chart may look different if we created it based on data delivered only by developers and then compare it to data delivered only by gamers, just to name a couple of different profiles that participate in our program. The Windows knowledge level sometimes makes a difference, too. Therefore it is very important to us that customers participate in this program who consider themselves Windows experts as well as customers who don’t enjoy spending too much time with the PC, who just see the PC as a tool to get things done. Based on the data, we may decide to optimize certain functionality for a particular profile.

In general, we utilize this data to better understand what to improve in the next version of Windows.  Let’s take a look at how the representative sample has their monitors configured.  First what resolutions do customers run with on their PCs?  The following table lists typical resolutions and the distribution based on the Windows Customer Experience Improvement Program, which samples all opt-in PCs (Note the numbers do not add to 100% because not every single resolution is included):

Distribution of common screen resolutions.  Approximately 46% of customers run with 1600x1200 and 1280x1024.  Approximately 10% of customers run with HD resolution.

One thing you might notice is that about 10% of consumers are running with HD or greater resolution.  In some of the comments, people were asking if our data represented the “top” or “power users”.  Given this sample size and the number of folks with industry leading resolution I think it is reasonable to conclude that we adequately represent this and all segments.  This sample is a large sample (those that opt-in) of an extremely large dataset (all Windows customers) so is statistically relevant for segmented studies,

We have found that a large percentage of our program participants lower their display resolution from the highest usable for their display. Looking at the data coming from the Windows Customer Experience Improvement Program to compare to, and noticed a similar trend: over 50% of customers with 1600x1200 screen resolution displays are adjusting their resolution down to 1024x768, likely because they find it uncomfortable to read the tiny text on high resolution displays. The negative effect of this resolution change is the loss of fidelity to the point where reading text in editors and web browsers is difficult. High definition video content also won’t be able to render properly.

Here is the data just for customers with displays capable of 1600x1200:

Actual running resolution for customers with 1600x1200 capable displays shows that 68% of customers reduce their actual screen resolution.

In a future blog post, one of the program managers from the Windows Desktop Graphics team is going to describe what we have done with that information to improve display quality and reading comfort in Windows 7.

We also frequently use our data to select appropriate participants for a survey. A researcher may be interested in sending out an online survey only to active users of virtual machine applications. We would first determine that group of users by looking at our “application usage” data and then create the list of participants for the researcher. Sometimes we combine automatically collected data with survey responses to analyze the relationship between a customer’s overall satisfaction and their PC configuration.

At the current point in time, 50% of our panel participants are using Windows XP and 50% are using Windows Vista. We are currently not offering open enrollment. If you are interested in being invited to this program, please send an email to winpanel@microsoft.com indicating “Notify me for enrollment” in the subject line. If you’d like to add a bit of information about yourself, including your Windows knowledge level, that would be much appreciated! We will add you to our request queue and make our best effort to invite you when we have capacity.

When we release the Windows 7 beta we will also be collecting feedback from this panel and asking for participation from a set of Windows 7 beta users. Our current plans call for signing up for the beta to happen in the standard Microsoft manner on http://connect.microsoft.com. Stay tuned!

-- Christina Storm

Leave a Comment
  • Please add 1 and 2 and type the answer here:
  • Post
  • Thanks for the very much appreciated information on the Windows Feedback Program, it is always good to know how things work...

    Plus I think alot of this Blog readers will gladly give feedback as they can, and participate in such programs..

    And for the "Connect" website, we are sure looking forward to the Windows 7 Beta.

  • Just curious.... if we are currently participating in the Windows Early Feedback program and were previously in the Longhorn beta program, will we automatically be invited to the 7 beta program or will we have to sign up for it manually?

    Thanks!

  • I am very much looking forward to the 7 beta. I just signed up for Connect. Can you tell us how participants are chosen from those who are interested?

  • What Microsoft need to do is remove the ambiguity in the display render er.

    You should have to enter the native screen resolution and the diagonal screen size. Then the correct DPI can be calculated. Then a slider to adjust the UI and Text render size to the users preference. Since the display is always render ed at screen native resolution screen is always crisp and aspect ratio is correct.

  • That thing about people adjusting their resolutions down, even though their display handles higher is something which really annoys me. Windows handles high DPI displays *really* badly, and in my opinion, it's even worse in Vista.

    The "programs have to opt-in to being High DPI aware or else we'll use bitmap scaling to scale them" feature is horrible. Most applications actually *do* handle high DPI pretty well (WinForms and MFC, for example, do a reasonable job). Coupled with ClearType, and bitmap scaling windows is just a terrible idea...

  • Thanks for letting us know that the Win7 beta will appear on Connect - I was hoping to have the opportunity to test it and help improve the experience.

  • @Christina Storm

    Pls.

    I recommend, this time , include other countries, not U.S. only in Connect.

    Thank's

  • Thanks for this entry..i always wondered how/why microsoft always wanted our information..

    i see a problem that is easily identifiable and entirely my fault...

    an analogy works best...lets say my computer is my car...well i have painted it black...super dark tinted all the windows on it...i then drive up to the 'microsoft-fix-you-rite' shop and yell through the rolled up window to fix my dashboard displays and then i get frustrated you didn't here a thing or fix anything...the worse part yet is then i go to my nice but totally ignorant friends and say never to use 'microsoft anything' and open my door and show them my opinion why my dashboard is not right...

    well steven i owe you and your design team an apology...i never signed up for windows live id...even my ignorance is my fault..i never even remotely thought i could sign up to be on a feed back team (nor did i think i wanted to)..so i never looked

    as a TopTwoPercenter i have a responsibility to enlighten my computer naive friends how to get there systems running well...what i should not do is gripe about something that is purely my opinion (ford/chevy/dodge thing)..

    see now that i know about WFP (and connect) ...it's kind of like the phrase "if you don't vote, don't complain"...so if i choose not to participate atleast now i know to keep my car door shut to my friends too..

    thanks...keep up the postings...TopTwoPercent

  • OMG OMG I got my copy of Vista from the WFP! Please offer the final RTM version of Windows 7 when it RTMs as a gift for future participants of the WFP.

    Also, this must be the first time MS is actually acknowledging that there'll be a regular beta program for the OS on Connect! Please please I would like to be a beta tester and give very contructive feedback.

  • The reason why we choose non-native resolution is simple, everything is so damn small.

    I don't get it. Compare IE8 site and Windows Download site to rest of the world out there. Both sites use super tiny font.

    Windows GUI is so small that it is not user friendly anymore.

  • @someone

    Pay pay and pay :D

  • The first graph shows quite nicely how much people hate the "My" folders XD

  • @Domenico, the beta was in 120 countries last time around: http://windowsvistablog.com/blogs/windowsvista/archive/2006/09/21/458075.aspx

  • The resolution information is interesting.

    I have found very often that people with poor eyesight will lower the resolution of their monitors to "make the text bigger".

    I have often, very often, wished that Windows would have a nice easy way of keeping the resolution but adjusting the system internal "DPI" to allow these people to have their bigger fonts and icons, but without the nasty compromise of lower actual resolution.

  • @CullenD

    i see only

    Europe

    Europe

    Benelux and Germany

    UK

    Scandinavia

    PS. Im Italian :D :D

Page 1 of 5 (72 items) 12345