Software Engineering, Project Management, and Effectiveness
I've seen a few customers asking how to structure projects for Team Foundation Server. I don't blame them. Finding a structure that works well for you can be tricky, particularly if you don't have the benefit of hind-sight or a bunch of reference examples to draw from.
My team spent some time this past week evaluating various approaches and lessons learned from various projects We boiled it down to something that seems to be working well, and distills what's worked for some teams. With the caveat that we're still evaluating, here's what we learned ...
SolutionLocal File System
Source Control (Team Foundation Server)
Key pointsHere's a few highlights about this approach:
Repro StepsHere's a brief walkthrough to test using a file-based Web:
Verify your folder structure on your File System:
Adding to TFS
Verify your folder structure in Source Control Explorer
More InformationYou should know that while I talked through the single solution scenario, there are additional patterns. Here's the key patterns we see:
You can find more on these patterns at Team Development with Visual Studio .NET and Visual SourceSafe. You should also know that we have a few How Tos on structuring your projects coming your way. We'll post them to our VSTS Guidance Project.
Share Your StoryIf you've got lessons learned the hard way or practices to share, I'd like to hear them. Now's a great time to share since we're actively building guidance. Either comment here or write a post and leave a link.
When Ward Cunningham was on our team, I learned a lot about building Wikis. He walked me through my first Wiki page. He probably didn't expect that 4 days later, I'd have more than 500 Wiki pages (he added a counter to my wiki!)
Ward told me Wiki Wiki was Hawaiin for fast, and he wanted to simplify publishing (the writeable web). This explained away my initial complaints of formatting and features, and I adopted the mindset of shapable content you can evolve over time. I thought of Wikis as notepad for the Web.
Ward and I had a lot of insightful conversations around various Wiki issues: one Wiki vs. many, choosing namespaces, choosing names, collaboration ... etc. The most important lesson for me was to think in terms of great pages. This meant, choosing better page names and make pages that matter. How to eat an elephant? ... one bite at a time. How to build a useful Wiki? ... one page at a time.
This conversation (er, debate) comes up a lot. What's the difference between performance, load and stress testing? I'm sure there's tons of *official* definitions. At the end of the day, I think about them like this:
I could say more, but sometimes less is better. If you want to read more, check out our patterns & practices Performance Testing Guidance Project on CodePle or browse through Scott Barber's exhaustive collection of performance testing articles.
Our patterns and practices team has just released new prescriptive guidance for Visual Studio Team System!
Since my previous post we've made significant updates with the addition of the following content:
This puts us on course to deliver on these main outcomes we have in mind for our Visual Studio Team System Guidance Project
Project OverviewWhile Visual Studio Team System provides powerful new tools, customers are asking "where's the guidance?" ... "where do I start?" ... "how do I make the most of the tools?" In response, our team is building a definitive Body of Guidance (BOG) for Team System. This includes How Tos, Guidelines, Practices, Q&A, video-based guidance, and more.
We’re helping customers walk before they run, so we’re starting with the foundation. On the code side (for developers) – this includes source control, building your dev and test environments and setting up a build process. On the project side (for PMs) – this includes work items and reporting. Once we have the foundation in place, we can move up the stack to making the most out of Team System for the various roles (tester, architect, developer … etc.) We're framing out the tough problems using Scenario Frames (for an example see Source Control Scenario Frame). We then identify where we need guidance and perform solution engineering. This involves building out reproducible customer scenarios, vetting potential solutions, and sharing the ones we can generalize enough to be broadly useful, yet still specific enough to be actionable. We're partnering with customers, product teams, support, field, MVPs, and subject matter experts. We’re working closely with Jeff Beehler to synchronize efforts with the VSTS Rangers, such as the Branching Guidance.
How do you share code in Team Foundation Server? That's what our team is working through at the moment. We're looking at what's working, what's not working, and what should customers be doing.
Here's how we're basically thinking about it so far:
Here's what seems to be our emerging guidance:
The problem with workspace mappings is that they're developer specific. Each developer will need their own mapping. You'll also need to lock down permissions to avoid accidental changes. Branching has the advantage that you can be explicit about taking changes, so you have stable builds but with the overhead of merging. You can branch within the same project or cross-project. A separate project might make sense if you have multiple projects consuming the code.
I need to still look across more customer sets, but so far I mostly see binary reuse.
I'm particularly curious in any lessons or insights those of you would like to share. I think this is an important area for effective source control practices.
The secret to time management isn't more time management hacks at all. Here's the keys I've found:
I often here the argument, "if I had more time for this or that, I could ..." Well, unfortunately, having more time doesn't always mean getting more done. It doesn't guarantee getting the right things done either. Sometimes I get more done in an hour than I can sometimes get done in a week. Why is that? For me, it's actually about energy. There's only so many hours in a day. While I can't make more hours in a day, I can use my energy better. Sure there's lots of interesting little time savers, but there's plenty of time wasters too. I find the force that makes the most measurable difference is the energy and engagement I bring to the table.
Assuming I have all my energy ready to tackle my day, I need to distinguish between urgent and important. If I'm only reacting to urgent, then I'm missing out on opportunity to deal with important, whether that's job impact or personal growth. The moral of the story is, if I don't make time for the big rocks, the fillers in my day won't leave room. I like Steven Covey's perspective on urgent vs. important in his First Thing's First book. Here's a nice summary of the popular Make Room for the Big Rocks story.
Anticipation is a actually a skill that I haven't worked on as much as I should. I actually plan to do a 30 Day Improvement Sprint, when the time is right. It's funny how many recurring things happen each year, that take me by surprise. Birthdays. Holidays. Reviews. Events. Geeze! You'd think I'd see the patterns ;)
Well, I do. I've seen the pattern of me reacting to events I don't anticipate. While the corporate ninja expects the unexpected, I also find that with a little anticipation, a stitch in time saves nine. If I make project plans, and there's a major event I didn't account for, I shouldn't be surprised when suddenly nobody's around. At the same time, I'm sure I can find a way to leverage the sudden spurt of energy some folks have right after mid-year discussion.
I'm using 30 day improvement sprints as a way to sharpen my skills. I pick a focus to work on and I committ to improving it for a 30 day timebox. Committing to 30 days of improvement in a focused area, is easier to swallow than changing for life. However, improving an area for 30 days, is actually life changing.
With 30 days, persistence and time are on my side. It's a big enough time box that I can try different techniques, while building proficiency. Using 30 days makes working through hurdles easier too. A lot of the hurldles I hit in my first week, are gone by week 2. Little improvements each day, add up quickly. I look back on how many things I tried for a week and stopped thinking I hadn't made progress. The trick was, I didn't get to week 2 to see my results. Lesson learned!
Building software involves a lot of communication. Behind this communication, lies perspectives. These perspectives often get lost somewhere between initial goals and final product, which can lead to failed software. I found that by using a simple Perspectives Frame, I improve my chances for success.
In PracticeI could easily over-engineer it, but in meetings and hallways, this quick, memorable frame of four categories helps. OK, so it looks simple enough, but how do I use it? Here's how I use it in practice:
This perspectives frame becomes even more powerful when you combine it with MUST vs. SHOULD vs. COULD and What Are You Optimizing.
Whether I'm dealing with software requirements, or I'm prioritizing my personal TO Dos, I think in terms of MUST, SHOULD, COULD. It's simpple but effective.
Here's an example of some scenarios and usage:
It's easy to get lost among SHOULDs and COULDs. I find factoring MUSTs from the SHOULDs and COULDs helps get clarity around immediate action.
In my 30 Day Improvement Sprints post, a reader asked, what tips do I have to make 30 days sprints more effective. Here's my short list
Few problems withstand sustained focus. There's a bit of captive genius in everyone that just needs to be uncorked. 30 days of focused improvement seems to be a great way to pop the cork. I'm finding improvement sprints refreshing because I now have a schedule for exploration. I can rotate through more interests. Most importantly, rather than tackle everything all at once, I just wait for my next 30 day focus. It's easier to put something aside for the moment, if I know I'll have a chance to immerse myself in it in the future. If I enjoyed something so much and I want to continue, I just do another 30 days.
Hope that helps!
I got some face time with Rudy Araujo today. I always enjoy our meetings because we talk about anything from security to personal productivity to future software trends.
Today, we bounced around topics including compliance, agile, systemic problems, software scenarios, security guidance for business, mash ups, virtualization, blogging practices, password management, MindMaps, and managing action.
The highlight for me was that Rudy shared my belief that businesses need more help rationalizing how to bring security into the picture. While there's a lot of technical guidance available, there's simply not enough prescriptive guidance for the business stack. I've talked to analysts and customers about incrementally adopting security, but I think it's time to make that information more broadly available.
Today I got some relevant training for today's world - how to succeed when you don't have authority and control over execution. This is a common scenario in cross-team, cross-group scenarios. At Microsoft, you don't get rewarded by saying, "...if only I had control over authority and execution ... I would be successful."
At the heart of the class was the model of influence without authority:
You obviously deal with relationships throughout the process. If you assume those you need to influence are allies, you're in a more resourceful state. If you don't clarify goals or understand the world of those you influence, then you can miss out on finding mutual purpose or understanding why or where you get stuck. Currency is more than money; it's any type of exchangable value, such as expertise, resources, ... etc.
I liked the class. The ideas weren't brand new, but instead of sit back and think, it was roll up our sleeves and apply the tools.
David Anderson distills his software management learnings down into four bullets:
He names this set a recipe for sucess. Here's what the recipe mean to me.
Focus on Quality. For me, focusing on quality means pushing quality upstream, and choosing quality over scope or quantity. It also means quality isn't somebody else's job.
Reduce work-in-progress. Reduce work-in-progress really hits home. Carrying too much in-flight work leads to excessive task-switching and administrative overhead. In the buffet of work to be done, frequent small plates, wins over the single, large plate that over-floweth.
Balance capacity against demand. Thinking in terms of demand, helps me right-size execution. Specifically, it helps me think in terms of frequency (how often do I need to deliver value), size (how big does the value need to be), and quality (what does good enough look like now versus perfect down the road).
Prioritize. There's always more work than we can possibly do. To prioritize problems, I think about pervasiveness and impact. Sometimes I need to prioritize a lesser problem that hits more people, over a bigger problem that hits few. I also keep my teams focused on value delivered vs. work completed. It's a subtle shift in mindset, but it makes all the difference.
One of my readers asked me if I could provide a bit more insight on branching. I think the best thing I can do here is summarize a few tips and then point to some useful resources.
Here's an example starting point.
In this case, Main is your main source tree and project assets. Development is a root level folder for isolating your features or teams (branched off your Source folder in Main).
The Team Foundation Server Branching Guidance whitepaper is now available! It's a comprehensive whitepaper that covers strategies, patterns and anti-patterns for branching and merging with TFS. You can view the branching guidance online or you can download the PDF version.
Branching Guidance Index
My team works closely with Graham and Mario of the Branching Guidance team as we build out our patterns & practices VSTS Guidance Project. We're sharing learnings and synchronizing recommendations as we go along. We'll be adding more cross-references to the Branching Guidance Project and VSTS product documentation on MSDN from our guidance so you can easily hop for more information.
Why 30 Day Improvement Sprints? I get asked this often enough that I think I should distll the keys:
Because my 30 Day Improvement Sprints are so effective for me, I have to resist the urge to bite off too many areas at once. In general, I try to balance between mind, body, career, financial, and relationships. My scannable outcome lists help me checkpoint. As a pattern, I do tend to focus heavily on career, but now that I see it, I can change it, if it makes sense.
I'd like to share some of the insights that others have shared with me over the years about choosing paths. My favorite insights have always been guiding questions that help me choose my own adventure.
As more folks ask me about their careers, I've found myself talking about three things
One of the metaphors I use to explain the distinction between documentation and guidance is Driver's guide vs. Owner's Manual. While I could go into the finer details, it's a good starting point. From an owner's manual, I expect to see how things work and how they're intended to be used. From a driver's guide, I expect "how to get the most out of it."
I see the two bodies of information as very complimentary. I also see them as distinct. I wouldn't want to mix my driver's guide with my owner's manual. However, I do want to be able to seamlessly go from one to the other, when I need to. I also want my owner's manual written by the people that built it and I want my driver's guide written by the people who use it in action.
In practice, I use my owner's manual when I care and tune my RV. When I take a cross country trip, I use my driver's guide. Knowing this distinction helps me choose the right tool (information set) for the job, as well as set my expectations about the type of information I'll find.
I think finding the right metaphors is important because it helps illustrate a distinction that's not always obvious or hard to explain. I don't think guidance is yet a pervasive part of our technical landscape, and yet I see it as a key differentiator between success and failure. By pervasive, I mean I can use any product or technology and easily find the driver's guide. I mostly see owner's manuals.
Today ends my 30 day experiment eating living foods. I'm a burger and pizza boy at heart, so this was a big change. Friends and family noticed my slimmer look and healthy glow. A friend of mine said I found the Fountain of Youth.
Here's what I noticed:
I didn't expect to shed my skin so that surprised me, but I liked what was underneath. I was also surprised by how some issues were dietary vs. natural. Nature vs. nurture strikes again!
Friends asked me what practices I'll carry forward:
Most importantly, I learned how to effectively do living foods for 30 days. This means, I can choose to do 30 day tune ups throughout the year. What I walk away with is a better idea of how foods affect me, how to balance my bad foods with good, and how to tune my body when I get run down (or need to fend the flu season).
We're such thinking, feeling, doing creatures at heart and food has such a big impact on the way we think and feel. I'm going to explore more options. A friend of mine suggested testing intuitive eating, where you eat what your body craves, not what you mind thinks it wants.
If you are a hunter and gatherer of guidance, you'll want Guidance Explorer. Watch Video: How To - Personalize Team System Guidance with Guidance Explorer to see how you can use Guidance Explorer to build a custom collection of guidance from our Visual Studio Team System Guidance project. If you haven't used Guidance Explorer before, or it's been a while, you're in for a surprise. Seriously.
Guidance Explorer is a free tool to help you browse, find, organize, or even create your own guidance. When you launch Guidance Explorer, it synchronizes with our online store. For example, today's additions include a number of brand new Team System guidance items:
My favorite Guidance Explorer features include:
Keep in mind that Guidance Explorer is actually a diamond in the rough. It has its flaws, but it also has unique powers. For example, I could use Guidance Explorer to inform you of brand new, emerging security practices. I could also flag the top performance issues using the priority field. Imagine the alternative of hunting through a whitepaper or article, instead of organized collections and lists of actionable, guidance nuggets.
I know consultants that literally save themselves many hours per week by using Guidance Explorer as a personal knowledge base and for tailoring guidance for customers. I also know of customers using Guidance Explorer as a light-weight and effective way to share guidance among their development teams. It's actually the type of tool where customers surprise me what they use it for.
While Guidance Explorer has nearly 1100 guidance nuggets at last count (across security, performance and .NET 1.1. and 2.0), you can quickly shrink the haystacks to find the needle that you need (Ed and I call this our Shrinking Haystack pattern). You can also discover relationships among the guidance, because related items are linked. Don't take my word for it though, test drive it for yourself. Did I mention it's free? Oh yeah, I should also mention it comes with source, so shape it to your heart's content.
Go ahead and watch Video: How To - Personalize Team System Guidance with Guidance Explorer and then download Guidance Explorer. If you do use Guidance Explorer and you have a story you'd like to share, please leave a comment in this post.
How do I efficiently and effectively prioritize my day ... my week ... my life? In an earlier post, I talked about using Scannable Outcome Lists. For a quick reminder, this is simply a flat set of lists. I name each list by project or area I'm working on (e.g. mind, body, career, project X, project Y, projec Z). Inside each list, is my list of key outcomes. Think of these as a list of lists -- a bird's eye view of the big picture, and then a drill-down view in each list.
I use this to quickly scan across my areas to remind me of what's important to work on. This is the lowest overhead approach I've found so far to keep a wide radar scan, yet be able to drill in as needed.
When I first started, it was easy to simply sort my list by area. Now I find it helps me to sort this list by priority 0, 1, 2 and 99. Priority 0 is for my continuous categories: mind, body, career, financial, relationship, personal dev, professional dev, and recurring. I use recurring to remind myself of things like doing backups. Priority 1 is for my most critical projects or most important areas, compared to my priority 2s which might be ideas I'm somewhat working on or starting to build momentum for, but not critical for success. 99 is on deck or backburner. Collectively I think of this as managing action similar to Maslow's Hiearchy of Needs.
To do this in Outlook, I have a single folder called Queue, to hold all my scannable outcome lists. I drag a short-cut to Outlook's "favorite folders" for fast access. I create a single post for each scannable outcome category. I add priorities by assigning "Categories" to each post -- I tag each one with a 0, 1, 2 or 99. I "Arrange" this older by "Categories", and then I custom sort by Subject. This gives me a very fast sequenced view grouped by P0, P1, P2, P99 and then sorted alphabetically within each group.
I start my days by scanning or updating my scannable outcome lists, then carving out the most important actions into my daily dos list. The entire process generally takes me 5 minutes or less each day, except on Mondays where I have to spend a little more time to figure out outcomes for the week.
Here's some quick blogging tips I shared with a colleague, that they found helpful:
As part of our Video-Based Guidance Experiment, we've released an initial set of VSTS Guidance Videos.
Source Control Videos
Test drive our videos and help shape our experiment by either leaving your comments here or sending your feedback to firstname.lastname@example.org
We did a focused set of security videos with Keith Brown a while back. The problem is they're not very findable (most customers I talk to aren't aware of them). I added them to soapbox and listed them below to see if it helps (note soapbox may prompt you to log in):
Input and Data Validation Videos
They're designed to help you get key concepts behind some of our security guidance. I also wanted to use somebody that was recognized in the field as somebody you could trust. Keith's proven himself for a long time in the security community. He also has the aura of an experienced trainer, which I think comes across in these videos.
This a practice I learned long ago and it's actually helpful whether it's day to day or building software. It's doing worst things first.
It's human nature to move away from pain. Sometimes I have a meeting or a conversation or even just a task for the day that I'm not looking forward to. I'm not talking about the stuff I can ignore forever. I'm talking about stuff that needs to happen sooner rather than later, that I won't enjoy doing.
If I push those things to the end of the day or the end of the week, they loom. Why loom longer than necessary? That's draining. Somebody long ago gave me the tip worst things first and I didn't realize it's actually become one of my most effective habbits.
One of my mentees is going to combine worst things first with a 30 day improvement sprint to see how much energy they get back and how much more they get done. I think this is a great experiment and I look forward to their results.