Thursday, February 17, 2011

Building a test plan from Woe to Go using Heuristics, Mind Maps, and Test Charters

Creating a test plan can be a daunting task, especially when under time pressure.  "We need you to test this application and, oh, we go live next Monday."  How do you create a plan to test that is accountable, transparent, and structured, yet lightweight enough that can quickly be understood by developers, project managers, other stakeholders, and new testers that may be brought on to help out?  And not only that, but be created quickly?



I'd like to propose a solution by combining knowledge and techniques from James Bach and others in the context driven community to create a solution which may help, depending on the application under test, and your workplace culture.  It sometimes works for me, and I hope that it may work someone else.

1. James Bach's Heuristic Test Strategy Model
Available here: http://www.satisfice.com/tools/satisfice-tsm-4p.pdf
As it says on the front page: "The immediate purpose of this model is to remind testers of what to think about when they are creating tests."


I like to build from the Quality Criteria categories, although I think you could begin building from any of the categories, depending on the type of model you want to build.

2. Mind Mapping
There's a lot of talk in the context driven testing community right now about mind mapping, and I have to admit I was originally dismissive of the idea.  I had always associated mind mapping with high school social studies teachers for some reason, or, at best, highly paid advertising executives, and wondered if they really had a practical purpose in the 'real world'.  I've since learned, of course, there is no such as the 'real world' so I started looking into it.  There are a few free mind mapping tools out there: http://en.wikipedia.org/wiki/List_of_mind_mapping_software
In these examples I'll be using FreeMind
You can read more about using mind mapping in testing here: http://www.bettertesting.co.uk/content/?p=956

3. Combine
Select the appropriate criteria for your project and map it out (I use the word 'Functionality' instead of 'Capability'):








                     4. Flesh Out
Start fleshing out using the other categories to generate ideas.


5. Post up in a public area
When you think you've finished, or you've run out of ideas, print out, and post up somewhere visible.  This lets PMs and developers see what your model of the application is, and they can point out areas that you may have missed.

6. Create Test Charters
If you're unfamiliar with test charters, or session-based test management, read these:
http://www.satisfice.com/sbtm/
http://www.satisfice.com/articles/sbtm.pdf
http://www.satisfice.com/articles/et-article.pdf

With a little tweaking, you've almost automatically generated your test charters from your mind map.  As you run along the lowest levels of hierarchy, create your test charters from them.  I find that usually each lowest level generates 1 to 3 test charters.  In the example above, some example test charters may be:
  • Create admin user; ensure has admin rights as described in document X, and can create, edit, and delete users
  • Check the claims made by the sales team are present in the application
  • Test the Proin at ligula libero
  • Explore the Quisque quis libero urna using Internet explorer 6
7. Managing the testing process
The mind map lets you visualise the testing process and can be used to report how testing is going.  You can use it to manage the testing process by assigning testers to a branch, letting them take ownership of all sub branches.  This lets you quickly assign work without having to go one by one through requirements and specifications and manually assigning individual tasks.  You could colour branches that you're currently working on, and shade in branches that have been completed.  At a glance, you can see what has been done, what is being worked on, and what is left to do.  

I hope this illustrates a good way to structure, manage, and report on exploratory testing.  The main advantages are that it is quick to do: no lengthy documents with headings and paragraphs of text; and has many emergent properties which also aid the management of the testing process.

45 comments:

  1. Interesting thoughts and a real challenge to my approach to knocking up a test plan in short order (take an old one and do a search and replace on the project name!)

    What is your experience at the 'Make It Public' stage. I have difficulty getting the right people to review and approve a standard plan (however short), Do you find that your people understand the mind map and respond or do you get a low response?

    ReplyDelete
  2. I agree posting the mindmap where it is visible can help focus on charter much better. Just like Agile developers use Scrum and Kanban boards to check the progress within a sprint. The only downside I see is that map becomes bigger and bigger as more and activities are added and to some extent unmanageable. If you have a large posted area then it helps but most workspaces are so cramped that you don't find the room to display a large map.

    ReplyDelete
  3. Hi Aaron,

    Some good ideas here, I really like the collaboration view point of sticking the mind map in a break out area for feedback. That's very good, and cheap.

    I'm not keen on using the mind maps to track planning aspects though; I think that could become confusing.

    Lean reporting is something I'm very interested in, and something I'll be working on for our team over the next six months. So it's really helpful seeing ideas like this.

    I think the real challenge is getting something that’s not only lean, but actually fits everyone's needs. It's often a struggle getting a format together that fits all the recipient’s needs.

    Thanks for taking the time out to share your idea with us.

    Cheers,

    Darren.

    ReplyDelete
  4. @roqueconsulting: Yeah this is very workplace culture dependent. I guess it depends if you need things approved to proceed. Either way, in whatever format you need to eventually present, this could still be a tool to generate good plans and to use for your own planning. You could have your "official" document to tick the boxes, and your "useful" document to actually get your work done.

    ReplyDelete
  5. @Mohinder: Yeah, the size and manageability can become unwieldy. I'll let you know how I get on as the map grows

    ReplyDelete
  6. @Darren McMillan: I'd be really keen to hear more ideas about how to make this work. This is something I'm only just now beginning to explore.

    ReplyDelete
  7. I've followed the same approach in a startup environment and what I also found useful were checklists that kinda followed the mindmap to do regression testing

    Thanks for the read

    ReplyDelete
  8. Hi Aaron,

    Excellent post. You suggest this is a good way of doing planning when time is short and deadlines loom. Do you think it would be a good strategy for a longer term, larger project (like a traditional waterfall) one?

    I've used them a lot for bigger projects too with mixed success (mainly because of management/stakeholder expectations).

    Nice post.

    Thanks
    Rob..

    ReplyDelete
  9. @Rob Lambert: I can't see why you wouldn't use this for a longer term project. It means you never lose sight of the bigger picture as the weeks and months go by. It can also have quite a visual impact as new requirements and features are added, and the map grows like a weed. Really shows the cost of new features in terms of testing time.

    ReplyDelete
  10. I really appreciate sharing this great post. Keep up your work.Thanks for sharing this great article.Great information thanks a lot for the detailed article.Thanks for shearing about this I thinks its very hopeful post and very important post for us.
    test the mind

    ReplyDelete
  11. All Assignment Help is a web portal where students get help in making assignments for all the subjects, with the help of our experts. You will get 100% plagiarism free assignment. Expertes consultation is also available for students. If they have any query they can contact with our experts anytime.

    ReplyDelete
  12. Welcome to the Best writers Reviews, Here you can get the best All Assignment Help reviews sites. We strongly urge you to check our entire website once and we will assure you will find this review website very useful. Our hard work will be rewarded if students like you will appreciate our effort and spread the message about this site with your class-fellows and friends.

    ReplyDelete
  13. Really nice topics you had discussed above. I am much impressed. Thank you for providing this nice information here

    Software Testing Company

    QA Services

    XBOX Game Tester

    Game Testing Companies

    Console Game Testing

    ReplyDelete
  14. Assignmentservicerating is best reviews site.We at Top Quality Assignment believe that there is no shortcut to success and to attain success, hard work, dedication, and commitment must be present. We are an online platform where students check & write reviews for assignments related websites.AllAssignmentHelp.com reviews 

    ReplyDelete
  15. Assignmentservicerating is best reviews site.We at Top Quality Assignment believe that there is no shortcut to success and to attain success, hard work, dedication, and commitment must be present. We are an online platform where students check & write reviews for assignments related websites.AllAssignmentHelp.com reviews 

    ReplyDelete
  16. But may come, he has to submit his assignment before the deadline, therefore he chooses to buy assignment services available to him. To help students complete their assignments My Assignment Services is here to serve them with the best assignment help. All the long and tiring processes are eliminated with our assignment help USA service which is simple and hassle-free. This is where students opt for our ‘Online Civil Engineering Assignment Help Australia’ services.

    ReplyDelete
  17. This post is quite striking and helped me to gain deep understanding of some of my academic topics. I would recommend everyone to choose Assignment Help Australia. You can email us at cs@Myassignmenthelpau.Com or Phone Number: +61-2-8005-8227

    ReplyDelete
  18. Welcome to the review of AllAssignmenthelp.com reviews, a writing service in Britain aimed at USA and Australia students. we will provide best AllAssignmenthelp.com reviews in USA, UK and Australia.

    ReplyDelete
  19. To complete your assignment, make the right choices with the experts of the AbAssignmentHelp and relax, we do it at cheaper rates! Working round the clock with dedication and commitment, we satisfy our customers 100% by providing assignment help and a vast pool of many topics.

    ReplyDelete
  20. During higher studies in colleges, students often have to prepare multiple documents, quizzes, and surprise tests. This is the main reason why most students search for MyAssignmentHelp over the internet and choose only the most proficient and trusted academic writing experts for write my essay no plagiarism.

    ReplyDelete
  21. Are you nursing students and searching nursing essay help? if yes then do not worry about this because myessauhelp is providing the best nursing essay writing service at affordable price.

    ReplyDelete
  22. We don’t believe in gimmicks when you approach us for Tesco case study help. When you come to us with your academic issues, you have to pay a nominal amount without the fear of paying hidden charges. We have segregated the price according to the word count, deadline, and subject.

    ReplyDelete
  23. Thanks to sharing information it’s very helpful to me.
    Paperssolution
    topacademictutors

    ReplyDelete
  24. GPA Calculator : An introduction is the beginning section of an essay, article or assignment; which conveys their purpose or goals. It is generally followed by the body and conclusion of the content.
    It gives general background information about the content of the article or assignment, through a brief explanation. Going through the introduction can help the readers to get an idea about the topic of the content of the assignment.

    ReplyDelete
  25. Fabulous project - Provide the Assignment Helper online support service. Expert writers of US assignment who will help you by providing good high-quality essay help and other assignment assistance services.

    ReplyDelete
  26. PaydayAlabama provides quick and hassle free process for applying Instant Cash loans Akron. The Process of applying is simple. Just fill the valid and up to date required information in the form and send it for approval. Our lenders would then contact you with an offer in case they approve your application. After approval, cash will be deposited to your account within 1 or 2 business days.

    ReplyDelete
  27. Are you seeking Payday Loans Denver?
    You often get into a financial crunch for a small amount towards the end of the month. At that time, you wish that someone could come and help you with just a couple of hundreds of dollars until you get your next paycheck. A lot of Americans started facing such financial crisis in the last decade and to solve such problems payday loans came into existence. Payday loans Denver is a company that helps millions meet their financial requirements instantly. They offer Payday Loans Denver No Credit Check to the residents. Payday loans Denver company has a large network of lenders. Whenever a customer reaches the company for a loan, they pass on the request to their lenders. As soon as a lender gets ready to offer help along with charging a small interest fee, the customer gets money credited to his or her bank account instantly.

    ReplyDelete
  28. Valuable guide on building test plans, really helpful to use in office.

    ReplyDelete
  29. For a change, there is an article that focuses on a specific topic and is not all over the places. I like the fact that it is actually problem-solving and not just random and baseless subject. Great going!
    Marketing Assignment Help

    ReplyDelete
  30. Custom Homework Writer have doctorates credentials that assures to clientele of receiving high caliber Custom Homework Writing Services to realize their aspirations of admirable grades in their College Homework Assignments.

    ReplyDelete
  31. Idealassignmenthelp provides the most effective My Assignment Help service in Australia to the university students pursuing graduation, post graduation. courses. we cater to the assignment writing wants of students and provide them with what they exactly want. That’s why college-goers trust our assignment writing services up to the handle and tell their friends, "IdealAssignmenthelp facilitate provider is that the best!" we are trusted because of the dedicated and professional approach followed by our talented writers. If you want then contact our expert team also visit our website. We have available 24*7

    ReplyDelete
  32. I suggest all members choose Essay assignment help Australia for the best guideline in your academia. The perfect and expert assistant your requirement and learning assignment project by the university.

    ReplyDelete
  33. Hello, I have browsed most of your posts. This post is probably where I got the most useful information for my research. Thanks for posting, we can see more on this. Are you aware of any other websites on this subject.
    dubai mall cinema

    ReplyDelete
  34. getassignmenthelponline.com is the world's best online assignment services provider They do not make empty promises, always achieved what they promised. So you can take help with any academic consultation orAssignment Help . our team of online get assignment help online is available ready to cater to your needs at any given moment.

    ReplyDelete
  35. It is a well-known fact, that whenever a situation becomes difficult to handle, the first thing that comes to our mind is to seek help Grant Writing Services. For example, in each semester the students of every university are burdened with several assignments for which they have to struggle a lot to get it completed. But time and again, they miss a deadline, or they score low grades. In such cases, there arises the need for an Online short story writing that will act as an academic hand for them to score good marks and better ranks. Make My Assignments- Assignment Help has a team of several qualified tutors and researchers who holds expertise in different subjects and coursework areas. However, it should be noted that we do not make assignments on your behalf rather; we assist you to complete your projects, assignments and academic research assignments in the best possible manner. We have been serving students from several countries, including USA, Australia, Canada, UK, etc inducude vrious tool for student to calculator college gpa calculator

    ReplyDelete
  36. ABC Assignment Help is an incomparable online Economics assignment help company delivering excellent academic assignments, essays, coursework and reports. Through a team of over 3000 subject experts we ensure individual attention to every student making the assignment help experience completely personalized in nature. With our round the clock services, you can be assured of high grades every time.

    ReplyDelete
  37. Hope you will keep on offering good content like this more often. I feel more and more people should know about this. Also, I agree on most of the points you have made.
    Dissertation Writing Services

    ReplyDelete
  38. Hire the best experts to avail Online Assignment Help services at best price with the assurity of 100% authentic work.

    ReplyDelete
  39. One of the main reason students opt for online assignment help is the time delivery of the given tasks. Varied tasks at the universities make it a hassle for the students to devote sufficient time to each individual task. As such they either fail to submit the given assignment task within the deadlines or complete the task haphazardly getting scores below the passing marks. If you are stuck with your research projects, essays, case studies, business reports or need Urgent Assignment Help, then myassignmenthelp is the place to be.

    ReplyDelete


  40. When it comes to your academic dreams and grades we try to give our best by supporting you in completing your college assignments.
    Our administrative experts work dedicatedly and passionately to provide top quality essay writing help to the students. Meticulous paper structures,
    subject matter relevance, free from grammatical errors are main characteristics that our highly experienced and talented writers endeavor for.
    Still drowning in the worry to complete your college assignments?

    Assignment helpers Online

    ReplyDelete
  41. We are providing the best master data services around the world....visit our website for more information..

    Selenium Training in Chennai | Certification | Online Courses

    selenium training in chennai

    selenium training in chennai

    selenium online training in chennai

    selenium training in bangalore

    selenium training in hyderabad

    selenium training in coimbatore

    selenium online training

    ReplyDelete
  42. I and my friends often read your posts and discuss on them. We get valuable information through your posts. Thanks a lot.
    java training institute in noida

    ReplyDelete
  43. Your post is very great.i read this post this is a very helpful. i will definitely go ahead and take advantage of this. You absolutely have wonderful stories.Cheers for sharing with us your blog. python training in noida

    ReplyDelete
  44. Thank you for your outstanding article. It contains everything a nurse needs in their career. The idea is to collect everything and have it in one place to easily trace them whenever you need them. There are nursing students who finding compiling the documents and putting them in one place difficult and opt to look for help in a platform like Nursing Professional Portfolio Writing Help . Luckily, we are always here to help

    ReplyDelete