Exploratory Test Session – 5 for WireMaster v0.46 Test Mission: To find the information of which (might) trouble and seems like a problem to the user while using WireMaster v0.46. Model under Test: WireMaster v0.46 | http://sourceforge.net/projects/wiremaster/ Tester: Ravisuriya Session-ID: 15thAug2009-s5 Test Machine: Windows XP SP2 | English US Start Test Date and Time: 17th August 2009 10:30 PM. End Test Date and Time: 18th August 2009 12:20 AM. Observations or Information: ---------------------------------1. On clicking the ‘Finish’ button in the install wizard with the checkbox Run WireMaster checked, the GUI of model under test will not appear either maximized to the screen or centered to the screen. Instead it appears as in below picture.
Picture – 1 >> Investigation reveals that, either checking the checkbox in the last install wizard of model under test or un-checking that, will not have its influence in showing the GUI of model under test not maximized nor centered to the page nor displaying below the page and the display of Submit Feedback. Unchecked the checkbox and completed the installation of model under test. Later opened the instance of the model under test; observed the above said behavior. 2. Submit Feedback dialog will be displayed to the user on first launch of the model under test on clicking button ‘Finish’ in install wizard with check box in it checked. What if the user not yet used the model under test and being using for the time, how the user can submit the feedback. Should she or he submit the feedback only for the install wizard of model under test, which she or he encountered? >> Investigation shows that, only on first time launch of model under test upon successful installation, the Submit Feedback dialog will be displayed. Later on it will not be displayed. Bangalore Weekend Testers: 15th August 2009
Page 1 of 10
Exploratory Test Session – 5 for WireMaster v0.46 3. Displayed ‘Submit Feedback’ will not have the model under test name in its title bar? What if the user is using another model which also has similar type of feedback dialog? Though it has logo of the model under test, displaying the name of model under test in such dialog will be helpful to the users. 4. Feedback can be submitted even when there is no network connectivity to the machine where model under test is being used. Submitting the feedback by choosing the category, an informative dialog with title “Thank you!” with message “Thanks for your feedback! :)” which was centered to the screen was displayed. This appeared and brought an illusion to the user that feedback was submitted.
>> When no network is available and submitting the feedback, a valid message should be displayed to the user which tells there is no network connectivity to the machine being used and please verify for the network connection. And if still network connection present and feedback is not being able to send using this Submit Feedback dialog, there should be an emailid for which user can mail directly with the feedback. This might be helpful to user and vendor. 5.
No validation for the email field in the displayed Submit Feedback dialog.
6. To send a feedback when network connectivity was present, it took 19.98 seconds to 21.46 seconds. If this time limit is agreeable, then it would not cause any trouble to user and vendor; else if the time taken to submit feedback is more than the desired time than this behavior should be considered for review. 7. Appears as there is no limit on the number of characters entered in the feedback text area and email-id text field. Can this cause problem to the person when trying to open such feedback which will have total number of characters that exceeds 18000 plus? Adding the limit on such entered characters for the feedback will be of any help? Even when no contents entered for feedback or just white space entered for the feedback, still the feedback can be sent provided network connectivity is available to the machine being used. 8. Looks like user will not get message from model under test, in the context scenario – when the network was available while sending the feedback and the machine got disconnected from the network at 5th or later seconds on clicking button ‘submit’. >> User should be intimated by model under test, in such scenarios when the network connectivity will be disconnected in mid of the any business transaction or completing the transactions.
Bangalore Weekend Testers: 15th August 2009
Page 2 of 10
Exploratory Test Session – 5 for WireMaster v0.46 9. The button name in Submit Feedback dialog should be ‘Submit’? Or the current behavior with button label as ‘submit’? >> If displayed any starting alphabet letter with uppercase might be good usability aspect since when all other GUI objects have that behavioral appearances. 10. Doing menu tour of model under test, found that no help document for the model is available. >> Providing help document for the model will be helpful for the user. And it is good usability and efficient character traits of model under test. 11. Looks like there is no log printed in a file for the action, exception, warning, error etc. displayed in using the model under test. >> If the log file for usage of model under test is available and all events are printed into it with consideration of log file size along with memory of it and performance of the model under test will be added advantage in using the model under test if it is usable. 12. If an option given to attach the files in the Submit Feedback dialog, will be helpful for the user and model under test team. >> Should be considered what types of file are allowed to attach. Since the virus file and other threat files can also be attached. Size of the file attaching should also be considered, as it matters while submitting the feedback with the time taken to submit and any problem while submitting. 13. Menu tour helped to find that while overwriting a file or saving a file with a name, that is already having by other file in the same location – will not show any warning of overwriting or asking whether overwrite the existing or not or the message which might help the user to know that file of same type already exist by that name. >> As a user of such tools where I can generate the layout of webpage design, I came across the situations where I copy, cut, paste, edit, undo, redo, undo and redo (for global actions), preview, print, check for updates, find, find and replace, recent files, exit etc. if provided to the users might be helpful in using the model under test. 14. An option for creating a project and saving the related wireframes under it available might be helpful. 15. Wire Frame for the constructed page can be generated, without entering any contents in the Generate Wireframe dialogs ‘page title:’, ‘description:’ and ‘business rules:’. >> Observed that generated wireframe will be saved successfully on providing the file name. 16. Looks like there is no validation or restrictions on entered characters and its length in the Generate Wireframe GUI objects i.e., ‘page title:’, ‘description:’ and ‘business rules:’. Bangalore Weekend Testers: 15th August 2009
Page 3 of 10
Exploratory Test Session – 5 for WireMaster v0.46 17. Should user be asked whether need to open the generated wireframe in the browser or not, before opening by model under test itself. This can be useful to the user. >> If more than one browser are installed, should the user been given an option to choose the browser in which the generated wireframe to be opened or the current behavior of opening in the default browser is agreeable? 18. The previous entered contents in the Generate Wireframe dialog GUI objects will be retained and will be visible opening it again. >> Is this behavior is as expected? If not what should be the expected behavior? 19. If a button ‘Clear’ is available in the Generate Wireframe and Submit Feedback dialog will be helpful to the user if the user does not want anything what she or he has entered. >> Asking the user whether the contents need to be cleared or not, when user clicks the ‘Clear’ button in the Generate Wireframe and Submit Feedback dialog can be useful to the user. 20. The Generate Wireframe dialogs GUI object has label that begins with lower case alphabet letters i.e., ‘page title:’, ‘description:’ and ‘business rules:’ and the button ‘generate’. >> Should they begin with the upper case alphabet letter or the current behavior is acceptable? This behavioral appearance might block the consistency in the appearances of label pattern across the model under test, which in turn can have influence on the usability of model under test. 21. Clicking on button ‘Open’ in the dialog ‘Open’ (Ctrl + O) without entering or choosing any file and its location will not show any message to the user. And also entering incorrect file name to open also does not show any message to the user. >> If the user selects ‘All Files” and chooses the text file and clicks on button ‘Open’ nothing is seen on the console area of model under test. Such and similar scenarios can be explored further and need to be validated. 22. The word ‘Open’ in the File menu of model under test is ambiguous. This might push the user to get confused in opening the type of the file, though the file type it opens is of xml. Since the user generates the wire frame which takes the file extension as html by default, when user looks to open that generated wireframe (html file) will not be able to see since by default xml file will show in file type that can be opened. >> If the ‘Open Data Files’ or ‘Open Wireframe Data Files’ is mentioned in the menu might avoid the ambiguity.
Bangalore Weekend Testers: 15th August 2009
Page 4 of 10
Exploratory Test Session – 5 for WireMaster v0.46 23. If different kinds of files can be opened or needed to be opened to see the data and diagrams of transaction and navigation across the web pages, providing different open for each kind of file might be helpful to the user. For example, if the user wants to see the generated wireframe diagram and also wants to see the wireframe data file, this option of providing option for open each file will be useful to the user. 24. Should the ‘All Files’ need to be displayed in the ‘Open’ dialog’s “Files of type:” combo or only the type of file that can be opened should be shown to the user? 25. ‘Save’ option in File menu will be disabled initially. Dragging any of the web page object to the diagramming area and deleting that dragged object, still the ‘Save’ option in the File menu will be enabled. >> This behavior might cause the confusion in user, while the Save option was disabled earlier with no web page object in diagramming area and after undoing the action i.e., deleting the dragged object still the Save option is enabled to save. User understanding of model under test varies from each user to user. This might be confusion to one and not might be to the other. Decision need to be taken on this behavior. 26. Empty wireframe that is with no components of web page can be saved as xml file. No message shown to the user about this. >> If avoided such behavior, confusion that user can get seeing nothing the generated XML file might be avoided. And the saved wireframe data file had the content as in below picture.
Bangalore Weekend Testers: 15th August 2009
Page 5 of 10
Exploratory Test Session – 5 for WireMaster v0.46 27. The Preferences of ‘Tools’ menu did show a dialog with title ‘Preferences’ which had a combo list – Render Style and button with label ‘submit’. The combo list had two entries that were visible to tester while testing and they were “Hand Drawn” and “Straight Line”. Also the tester inferred other three entries were available but they no characters of English were visible. Moving the mouse over the list, inferred the combo has totally 5 entries – 2 can be seen and three were not visible and appeared to be as null string. Button ‘submit’ had its label beginning from lower case alphabet letter.
28. There is no short cut key to open the Preferences dialog which is present in the ‘Tools’ menu. Also ‘Send Feedback’ does not have shortcut key to open the Submit Feedback dialog. Appears as other entries in menus of model under test have shortcut key. 29. Choosing the any one of the three null strings in the combo list ‘Render Style’ and clicking on button ‘submit’, appears to user as the null string was selected. But opening again the Preferences dialog, second option in the combo list i.e., Straight Line will be selected. 30. User with no help document or context help feature in the model under test, will feel difficult in knowing and understating what does ‘Hand Drawn’ and ‘Straight Line’ means & why it can be used. 31. Another model or applications other than model under test running in the machine also have same shortcut key or hot key similar to the mentioned in the menu of WireMaster. Using that similar shortcut key the other model was triggered, instead of triggering the action in model under test was used and its GUI was active in foreground. Such scenario was witnessed by the tester while testing for this context scenario. This will be confusing to the user if does not insert new component in the diagramming area, but other running application starts to respond for the pressed keys. >> Such incidental behavior witnessed can bring the hard impression on model under test to users. A way or work around should be found for over coming or avoiding such incidents. 32. Keeping pressed one of the short cut key for the components that can be put into diagramming area, model under test was not responsive and looked it took most of the memory and CPU usage. Needed to kill that instance of the model under test.
Bangalore Weekend Testers: 15th August 2009
Page 6 of 10
Exploratory Test Session – 5 for WireMaster v0.46 33. Component Properties dialog appears by default thought no components that are supported by model under test are present in the diagramming area. But the Component Properties shows no data for the fields present within it. Still should it show the Component Properties without adding any components supported by model under test? Should the user be given an option to select whether the dialog to kept opened without any component added or not? 34. The font size in the Component Properties can be 2 or 3 size bigger than the current font size. All users do not have same vision capability. And usage of color for the GUI objects and contents shown in the model under test should be chosen such that it will consider all categories of people who are challenged with the sight ability with their eyes. The contents of Common Properties i.e., ‘label’, ‘font size’, ‘border’, ‘x’, ‘y’, ‘width’ and ‘height’ begins with lower case alphabet letter. Once the corresponding fields value of Component Properties if had its font size 2 or 3 bigger than the current displayed font size, will be helpful to the user. And, if the option given to select that font sizes for Component Properties, will be added advantage. 35. The combo box option displayed for chosen component in Component Properties dialog will look disabled but it will not be disabled. This can be inferred in the below picture where text ‘normal’ appears like disabled, but the combo button is enabled. Clicking on it tester was able to select the other content in the combo box.
Bangalore Weekend Testers: 15th August 2009
Page 7 of 10
Exploratory Test Session – 5 for WireMaster v0.46 36. If the Brightness and Contrast color of screen being viewed by the user is adjusted such that they are below 40 or where the dark contrast color, user cannot make the difference between a highlighted (selected) color to black-in-color. This behavior can be annoying to the user or confusing to the user. User will not know whether she or he has moved her mouse pointer over the other available option in combo list, with the settings of brightness and contrast for the being viewed screen. Only if the user sees the data of below fields are hidden, then user can infer that combo is expanded and mouse is over them. But user cannot guarantee herself or himself with this behavior. The below picture depicts this behavior.
>> Users can be of various categories, where few likes to have brightness and contrast to maximum, few likes to have average and few likes to have at minimum – this varies from user to user. Such user scenarios need to be considered while designing the GUI and its color (background or foreground [text etc.]). While reading this you can adjust contrast and brightness so that said behavior might be witnessed by the reader of this report. 37. If the option given to user to select the background and foreground objects color of the Component Properties, might be helpful to the user. 38. Moving the mouse over the WireMaster supported components the screen tool tip displayed are as follows: ‘Add Container’, ‘Add TextField’, ‘Add TextArea’, ‘Add DropDown’, ‘Add Label’, ‘Add Button’, ‘Add Image’, ‘Add Link’, ‘Add Checkbox’, ‘Add Calendar’, ‘Add ProgressBar’, ‘Add List’, ‘Add RadioButton’, ‘Add Table’ and ‘Remove Selected Component’. But few of these screen tool tip contents looks more technical than user oriented like – ‘Add TextFied’, ‘Add TextArea’, ‘Add DropDown’, ‘Add ProgressBar’ and ‘Add RadioButton’. If there is a white space between the displayed words will it be helpful? Or the current behavior is as expected? 39. What does ‘Snap to Grid’ means? If the user has not heard that and hearing for first time or don’t understand what it is and why, where and when can be used – it can be a source of problem to the user in knowing what it is and how to make use of it. 40. Icon of Text Area and Text Field appears to like same. Should have unique icons for each component. Bangalore Weekend Testers: 15th August 2009
Page 8 of 10
Exploratory Test Session – 5 for WireMaster v0.46 41. Does the provided components in model under test, are the only components that are used in the web pages or web design? Or there are other components also? If exist then the other components also should be supported by the model under test. >> Several other components are used in web page. If they are provided might be helpful. 42. Entering more than 250 characters for the file while saving a wire frame data file, no error or warning message shown to the user. And file will not be saved in the desired location. Also entering a file which exceeds 250 characters to open in the Open dialog of model under test, did not see any warning or error message to the user. 43. Saving the wire frame data file in the desired location and trying to delete the file immediately after saving from the saved location with the model under test still opened with deleted instance, did not show any message to the user. Neither Operating System nor model under test, showed no message for the user on doing this action. Trying to delete the saved file hitting ‘Delete’ button, dragging the saved file to Recycle Bin showed no response. The file remained in the same location as it is. This behavior can make user to get annoyed and confused in using the model under test. 44. The component tool bar can be moved across the diagramming area such that part of it is not seen or not seen completely at all. Clicking on button [x] in the title of tool bar makes again the tool to appear in the place where it is found when the model under test is opened. Below pictures tell the above said.
Picture – 43a
Picture – 43b
Picture – 43c
Bangalore Weekend Testers: 15th August 2009
Picture – 43d
Picture – 43e
Page 9 of 10
Exploratory Test Session – 5 for WireMaster v0.46
>> In the picture – 43b and picture – 43c, the space for diagramming area will be wasted if the use chooses the kind of toolbar position and alignment if she or he is in comfort with than any other position of component toolbar. In picture – 43a why the [x] button is enabled or available; if user clicks on it again the component tool bar appear in its default position – this behavior will confuse the user. In picture – 43d and picture – 43e, only part of the component tool bar is seen. User should not be able to move to the tool bar beyond the visible screen area; doing so should not be possible and if displayed a valid informative message for that user action will be helpful to user. 45. Should there be an option to user to customize the component that needs to be only available for viewing? If this option provided will it be useful to the user? 46. Few of the components supported by model under test will not get highlighted by color that appears to red-in-color when clicked on it. The selected component in diagramming area will have its outer surface or border to be displayed and looks to the tester as red-in-color. And, also there are components by the model under test, when clicked on it, its outer area or border does not appear to be with red-in-color to the tester eyes. Those components are Label, Link and Calendar.
>> Only if the user clicks on these three components one at a time and looking at the Component Properties, should infer that component appears to be selected. This can be annoying, time consuming if there are many similar components in the being constructed Wire Frame diagram. 47. Does only one background that will be seen by user by default, is supported by the model under test? What if the user wants too add her or his background image for the wireframe diagram being diagramed? Is there any option for that? If provided an option to choose the user selected background image might be helpful to the user. ************ End of Test Session – 5 Report ************ Please write your queries, questions, comments, feedbacks, critics and thought to email-id
[email protected]
Bangalore Weekend Testers: 15th August 2009
Page 10 of 10