Darcy Burner's WebLog

Software vendor central

The software crisis

Jim Fawcette, president of Fawcette Technical Publications, talked in his most recent blog entry about the decline in programming jobs and wages, which he attributes to a combination of offshoring and the increasing productivity of developer tools.  He goes on to cite productivity improvements in Visual Studio as a bad thing, based on the idea that if one programmer can do what five programmers used to do, that four programmers are going to be sent packing without jobs.

I think that he’s wrong.  He’s basing his argument on the assumption that there’s a fixed amount of programming to be done, and that we’re at capacity.  That assumption doesn’t make any sense.

There is a crisis in the software industry, and has been for a long time, which is that we can’t develop software fast enough.  There are all kinds of problems we still need to solve where all of the pieces of the infrastructure except the software are in place, and we’re just waiting on having sufficient development capacity to create the software. 

Let me give you a few examples:

  • Medical diagnosis modeling: When I go to the doctor’s office, it ought to be true that a piece of software should be able to analyze my current symptoms, vital statistics, test results, medical history, and local epidemiology information in order to direct my medical professionals to the correct tests to perform to narrow down possibilities – or provide suggested diagnoses.  This would be faster, substantially less expensive, and far more accurate than the current unassisted model of diagnosis – all that’s missing is the software.  (And then, in countries where private insurance applies, billing of my insurance company should happen completely automatically, saving something like 65% of every healthcare dollar spent.)  Potential payoff: billions.
  • Shipping systems: If I need to get some object from point A to point B anywhere in the world, I ought to be able to go online and have some software figure out for me what the most cost-effective shipping method will be based on my constraints, and that software should make all of the necessary arrangements on my behalf – even if what I’m shipping is an elephant or a ton of grain.  Again, the software is missing.
  • Traffic: Why is it not already the case that I get told the fastest way home based on current traffic conditions?  The GPS technology is good enough, the maps exist, we even monitor the traffic.  Software, software, software.
  • Shopping: I want a new scanner – an HP 4670, to be precise, and I want it by the end of the week.  Is it cheapest to get it at the local Staples, Office Depot, Fry’s, Circuit City, or Target?  Or should I pay the shipping and get it from Buy.com or Amazon?  Why isn’t it an easy thing for me to calculate?  Software again could solve the problem.

There is no shortage of potential software projects that could solve real world problems, with real payoff, that would be worth more than enough to pay good employee salaries to every reasonably skilled programmer in the world.

Increasing the worldwide capacity for developing software is a good thing.  Increasing it by increasing the number of skilled engineers in the world is good; increasing it by increasing the productivity of each of those software engineers is good.  We are a very, very long way from a world in which a dollar invested in software development won’t generate a return of many times more than a dollar.  We are not at capacity.  And I, for one, am thrilled that we’re starting to make progress on breaking through the bottleneck.

Published Wednesday, February 25, 2004 9:41 AM by DarcyBurner

Comments

 

Jeff said:

I think he's wrong too. In fact, it's surprising that someone in his position would be so out of touch.

If code monkey wages are going down (and that certainly hasn't been my experience for .NET folks in my area), then it's because the market is over-saturated with people. This has been going on for years in the admin/OS area, and it's now just as bad for the networking people. Cisco certified people are a dime a dozen. Why would anyone pay top dollar for one of these people when they get 200 resumes for the same job?

All of that aside, he's clearly not talking to the same people I talk to. The bigger consulting firms down to the local shops are struggling to line up qualified people for all of the new business that started rolling in or prospecting in late 2003. Maybe that's unique to the Cleveland/Akron area, but I doubt it.
February 25, 2004 10:01 AM
 

Dennis said:

It's always foolish to complain about lost jobs due to increased productivity. That process is the reason we're such a wealthy society.

I can address the issue of medical software...I spent four years as a developer on a project that semi-automated medical referrals and eligibility checks. And the unfortunate fact is, that's a very conservative industry. Our system replaced processes based on phone calls and paper, saving tons of labor, and it took years to convince some clinic networks to use it. And it's a pretty simple system, just set up a computer with web access in the front office and you're good to go.

Billing is pretty well automated right now...mostly based on ancient EDI/mainframe tech but it works. Some schmuck has to type the treatment info into the system, but no matter what your system, you have to tell it how you actually treated the person. Trust me, you won't get the doctor to deal with it. And it's all controlled by IT groups that usually aren't real open to outside ideas anyway.

Expert systems for diagnosis were invented a couple decades ago. If doctors were willing to use them, they'd be everywhere. I read an article last year about someone trying it again, and doctors just didn't like the idea.

In sum...I don't think it's just a lack of time that prevents us implementing such cool ideas. It's a bunch of people not playing well together, not trusting other people's work, afraid of losing control.

(Price comparison is another example...do stores really want their customers comparing prices that easily? Probably not. IIRC, somebody got sued last year for trying to implement that.)
February 25, 2004 12:08 PM
 

John Cavnar-Johnson said:

While I agree with your basic point, your examples show an amazing naivete towards the way the world works.

First, although there is a real need for software and automation in the health care industry, medical diagnosis modeling is so beyond the current capabilities of the software industry that your scenario is laughable. Most medical diagnoses are mind-numbingly obvious. Distinguishing between the obvious (otitis media, allergic rhinitis, high blood pressure, diabetes, depression, etc.) and the obscure isn't usually a question of ordering tests and following some decision tree. More often, it's making a judgment based on the appearance, affect, and history of the patient. Computers are ill-suited to help with these.

Software to enable your shipping and shopping scenarios are actually quite trivial. What's lacking is the rather obvious problem that it's not in the vendors best interest to provide the data to enable you to find the best price. Industry-wide profits would only go down.

The traffic scenario is the most interesting, but again somebody has to see enough benefit to fund the software development and systems deployment. Regional governments are the logical candidates, but they haven't usually been effective at complex systems development.
February 25, 2004 12:34 PM
 

Darcy Burner said:

With respect to my examples: I didn't say that the software was trivial to create, only that the problem could be solved by software. And yes, figuring out appropriate business models is always a needed exercise in this industry (or any other). I expect, in fact, that a post on business models will be forthcoming.

My basic point remains, though: we have a huge unmet need for software, and increased efficiency of development, coupled with increased availability of skilled programmers, is a very good thing.
February 25, 2004 1:11 PM
 

John Cavnar-Johnson said:

I'm afraid you missed my point. None of the problems you described will be solved by software (except maybe the traffic one) because the solutions involve too many people acting against their self-interest. There is no business model to be found in people acting against their own interest (unless you are a con artist or have coercive power over them). I agree that there is a huge unmet need for software development, but let's not confuse that with wish fulfillment.
February 25, 2004 8:07 PM
 

Bill Trowbridge said:

John, I agree. I was was about to put it like this:

Creating the software is easy. Creating the systems is hard.

You pointed out some of reasons that it's hard, infeasible, or even impossible. For the most part this is economics question. Who is willing and able to take the risk and pay the salaries to develop software to support a particular system?

Coincidentally, earlier today, I asked my doctor/client, a family practitioner, about his use of diagnosis systems. He said there are even tiny systems for PDAs that can do partial diagnosis (down to a few possibilities).

Nonetheless, the tone of the original blog is right on. We don't (now) develop software fast and inexpensive enough.
February 26, 2004 5:00 AM
 

Bill's Blog said:

Darcy Burner recently posted her disagreement with Jim Fawcettes analysis that tools such as Visual Studio increase productivity thus eliminating jobs. Darcy claims that there is no shortage of software that needs to be written which Darcy then extrapolates as...
April 17, 2004 12:33 PM
 

Software Information » Darcy Burner’s WebLog : The software crisis said:

January 20, 2008 6:28 PM
 

Employment Wages » Darcy Burner’s WebLog : The software crisis said:

March 31, 2008 2:48 AM
 

Ezines and Web Magaizines » Darcy Burner’s WebLog : The software crisis said:

April 29, 2008 11:02 PM
 

Darcy Burner s WebLog The software crisis | Paid Surveys said:

May 29, 2009 6:36 PM
 

Darcy Burner s WebLog The software crisis | Weak Bladder said:

June 7, 2009 9:15 PM
 

Darcy Burner s WebLog The software crisis | Quick Diets said:

June 9, 2009 11:08 PM
 

Darcy Burner s WebLog The software crisis | low cost car insurance said:

June 17, 2009 12:31 AM
Anonymous comments are disabled

© 2009 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker