| |
Authors:
Chesta, C., Fliri, M.,
Martini, S., Russillo, B., Barbero, C., Raymond, S.
Title: First
Evaluation of Tools and Methods
Abstract
This document include
two contributions on CAMELEON tools and methods formative evaluation:
- Usability testing performed by Motorola: this work is aimed at evaluating
how a tool is usable for specific users in specific contexts of use.
An experimental evaluation has been conducted, results have been gathered,
and discussion has been provided.
- Software testing conducted by IS3: this work is aimed at conducting
two types of software centric tests: unit test (some functional test
with respect to hardware/software requirements for each module taken
separately) and integration test (testing the combination of VAQUITA/RUTABAGA
tools and other modules in the IS3 infrastructure)
The usability test focused on TERESA tool. Two studies were conducted
at Motorola GSG Italy on January and April 2003, focusing respectively
on tool usability and effectiveness, with the objective to highlight potential
weaknesses and to provide design recommendations useful while implementing
subsequent versions of the TERESA tool. TERESA emerged from the evaluation
as an appealing and promising solution for designing and developing UIs
on multiple and heterogeneous devices.
The software testing has been conducted informally: IS3 and UCL tested
input/output for RUTABAGA separately, before integration and for integration.
For both tests, several problems have been identified (e.g., options unsupported
in unit test, different versions of libraries used in the integration,
etc.).
|
