John, our only SDET (tester) on the team, has written a couple of blog entries on what we’ve learned (sometimes the hard way) about testing open source projects:

What’s different about testing open source projects?  (Part 1)

Recommendations for corporate teams developing Community Based Open Source projects (Part 2)

We hope you find this information useful.  Feedback and discussions are always more than welcomed.