Welcome to MSDN Blogs Sign in | Join | Help

Feedback and Microsoft

I have an interesting job. I write software that helps Microsoft manage feedback and connect with customers in a meaningful way. That may sound like marketing-speak, but it's true.

I've found that in my time here, I've learned a huge amount about how "feedback" works. One of the first things I had to do was to re-evaluate my own idea of what the term means. I thought that it just meant that someone could send a note and it would be read. Now, I hadn't come up with some formal definition as such, that's just what my perception of the term meant when I examined it.

Of course, it's a much larger concept. And defining exactly what it means is one of the core challenges to doing what I do. It's not enough to say "we'll set up a form and people can fill it out", or to set up a system where people can submit bug reports that go straight to internal bug tracking. That's not going to work. It may work from the customer's perspective, which is great- but if it doesn't actually help Microsoft create better products, or even hinders  that process, it's broken.

I'm still new enough at this company to have been using Microsoft products for much longer than I've been working here- and I recall my perceptions of Microsoft as a company at times. By many customers, Microsoft is perceived as being a large, monolithic entity with no interest in individual customers or their experiences- only in the aggregate.

There's a syndrome I call the "black hole effect" when it comes to large companies and feedback. It's the perception- warranted or not- that feedback goes into a black hole when you provide it. Any responses that manage to eke their way outside that event horizon are rare indeed. It's not always easy to identify who you should send an email to, or who has the information you need.

In other words, many of our customers don't think we read or respond to feedback. So they don't bother to provide it. Of course, there's another side to this coin. The problem of the "fire hose effect".

What happens if a product team puts out a beta and solicits feedback, and then can't close the loop with the customer simply because of sheer volume? When you can get 1500 bug reports in one day- for one feature area of one product- that is a huge burden on any triage team. Pretty soon, the process will be dropped because it's simply not manageable. And then the loop is broken- customers are back to "throwing it into the black hole".

So, the problem is to manage feedback in such a manner as to allow:

  • Large numbers of customers to communicate with small numbers of product team members in a meaningful fashion.
  • Small numbers of product team members to communicate with large numbers of customers in a meaningful fashion (yes, these are two separate problems).
  • Actual collaboration between customers and product teams, so that the customer's needs, desires and insights actually contribute to the product.
  • Closing of the loop with each and every customer. Nobody's going to bother continuing to provide feedback or bug reports if they don't get any acknowledgement that they're actually contributing in some manner.

So exactly how do you set up a system where you have ten, twenty- a thousand- customers per developer/tester, and they all have something to say? How do you parse that feedback so it's actually useful and allow the team to close that loop- the most critical part of the process- with the customer?

Published Friday, May 26, 2006 11:33 AM by Cyclometh

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

# re: Feedback and Microsoft

Sunday, May 28, 2006 8:40 PM by droid
1. search
2. core community
3. recognition (automation) and categorization
4. feature cues

1. the easier and faster it is while giving good results, the more it'll get used. it might help to look at different types of search uis

2. for the popular products and features there's always few inviduals that'll do a lot more work.. such work could be things like categorizing bugs, validating bugs, marking duplicates etc. hints of incentives for being more active in this respect may activate this better.

3. comprehensive recording of both user and app behaviour and linking the feedback with this data to more precisely group the feedback by what the user and program was doing at the time the user had the urge to give feedback.

4. allow user to visually select (when suitable) the target of feedback

3/4 could be activated by for example pressing the pause/break key after which the beta app would freeze and activities of past few moments would be saved and the user could click a part of the screen (control for example) to point out odd behaviour etc and write comments.


During the feedback reporting, feedback with similar characteristics is automatically filtered down to a small list of existing reports for the user (obviously atleast the title and summary of reports must be semi-public for all reports) who can then pick if one of the earlier submitted ones matches the one (s)he is about to make, thus allowing user to immediately validate existing bugs instead creating a new one.

I'm interested to hear what kind of ideas you've had there...

# re: Feedback and Microsoft

Monday, May 29, 2006 12:36 PM by Tom Stack
bug reports must remain a high priority, in some cases look at Media Player 10 there are still some bugs that date back to version 8 um yea.

Also interaction. I realize it is impossible to react/react to every single piece of input but getting a two way feeback is way better. The reaason the black hole effect is there is they submit a bug or piece of feeback and get a generic thank you message that is auto generated but a real person never gets back them and its that dev-user TWO way interaction that makes people feel better, and that thier feedback is being listned to.

Leave a Comment

(required) 
required 
(required) 

  
Enter Code Here: Required
 
Page view tracker