Abstract
This evaluation report presents the first lab study investigating usability, acceptance, and usefulness of of the di.me userware. The evaluated version of the di.me userware was an early scribble-flow, presenting first user interface concepts and the prospective vision and central functionalities of the future project results.
The lab study was a standard usability test targeted at detailed usability data combined with standardized measures for user experience, usability, and acceptance. The system version test was a pdf-scribble as screenflows of use scenarios. 21 users from the three di.me user groups (professional users on business events, private end-users, CRM users) were tested at 4 test locations in Germany and Spain. In moderated test sessions the participants worked on predefined test tasks and were observed and interviewed.
The overall evaluation of acceptance, user experience, and utility yielded positive results for the general di.me approach. This general feedback is encouraging in particular when considering the early stage of the presented concepts and corroborates the main di.me approaches. Most attractive features were control of personal data, privacy warnings, and self-organised networking on events. Experienced users of several social web systems benefit from the deep and semantic integration of external services. The user-centric system architecture with the decentral storage of personal data on a personal service must be communicated as clear advantage to the end-users. Privacy warnings and intelligent system recommendations based on context information were amongst the most interesting and innovative features. The participant’s feedback made clear that these features strongly rely on the quality and validity of the underlying reasoning and learning mechanisms. The study yielded also many valuable issues of the user interface concept that were worked in a new version of the user interface concept and will guide the research and technical work for the next development cycles.
About
-
Dissemination level: Confidential
-
Nature: Report
-
Workpackage: WP 2 User Driven Design and Quantitative Validation