List of the issues looked at, the concrete questions to be tested, necessary task, setup material, possible evidence to indicate test failure or success and finally how that evidence will be collected are listed in detail in the table below:
Category, Issue | Concrete question | Material to be set up, Task | Evidence | How to collect data? |
Terminology C,R,NR labels are used without explanation as to what they stand for Concept of Reconciliation may not be understood as it is not a very common task in current online banking scene. Basic terminology issue of not understanding concept of ‘clear’ state | Can the user understand the difference between clear, reconcile and non-reconcile states? | · Pre-entries of different type C,R,NR · Marketing material of the product stating the principles of double entry method specific to KMyMoney. · Wrong entry that needs to be corrected 1. “You deposited a cheque yesterday and it got cleared today, please change the entry appropriately.” 2. “You got your bank statement of your account abc please confirm/correct the entries for that account.” | · For part 1: Change NR to C Be able to edit an entry · Part 2: Reconcile entire account Rectifying the wrong entry Edit entry | Think aloud, Screen video, Note points where the user gets stuck |
Task flow After creating a scheduled transaction, the way to enter it is to go to home page, or by right clicking it, which may not be intuitive. Also, the right click option calls current month transaction as next transaction. | Can users create a scheduled transaction and enter that transaction for the current bill? | “You have paid your monthly apartment rent today by cheque, now please create a reminder to enter it every month, and enter this month’s rent payment and verify it.” | · Create a schedule transaction. · Find it on home page or by right clicking. · Find entry in the ledger | Think aloud, Screen video, Note points where the user gets stuck |
Task flow Adding a new category needs user to get out of context of Budget. Secondary: Navigation Option to change the year of the Budget is hidden under right click. Budgets icon is below the fold. Calculator and new budget icon are same and close to each other Green check mark to enter the budget is not logically placed enter layout. | Can the user create, view and make changes to the budget? | · Set up budget categories · Prepare required data for 2010 budget, one of the category in the budget should not be in the categories that are initially set up. “You planned your next year’s budget as given, please enter that budget plan into your system.” | · Entering 2010 year could be difficult as the options to edit year information is hidden · Choosing budget categories can be confusing to do inconsistent terminology, here they are called “account” · ‘Clear field’ button may be confusing · The switching between months, year and individual could be confusing. | Think aloud, Screen video, Note points where the user gets stuck |
Navigation Budget visualization to view allocated values to all categories can be done only through reports and is not in context of Budget. Option to view in pie chart is not well exposed and hidden under right click. Pie chart report is hidden under very deep navigation. | Can users view the budget plan as a pie chart? | · Enter 2009 budget · Make sure the report view option is not pie chart already “You want to view the budget you planned in pie chart format” | · Be able to identify ‘report’ as ‘budget report’ · Figuring out use of right click for more options | Think aloud, Screen video, Note points where the user gets stuck |
No comments:
Post a Comment