*** Call for Papers *** *BELIV 2010 - CHI 2010 Workshop* BEyond time and errors: novel evaLuation methods for Information Visualization A Workshop of the ACM CHI 2010 Conference April 10-11, 2010 - Altanta, GA, USA WORKSHOP WEBSITE http://www.beliv.org/beliv2010/ DESCRIPTION The purpose of information visualization is to provide users with accurate visual representations of data and natural interaction tools to support discovery and sense making. These activities are often exploratory in nature and can take place over days, weeks or months and rarely follow a predefined or linear workflow. While the overall use of information visualizations is accelerating, the growth of techniques for the evaluation of these systems has been slow. To understand these complex behaviors, evaluation efforts should be targeted at the component level, the system level, and the work environment level. The commonly used evaluation metrics such as task time completion and number of errors appear insufficient to quantify the quality of an information visualization system; thus the name of the workshop: “beyond time and errors …”. BELIV 2010 aims at gathering researchers in the field to continue the exploration of novel evaluation methods, and to structure the knowledge on evaluation in information visualization around a schema, where researchers can easily identify unsolved problems and research gaps. This is the third edition of the BELIV workshop series. Based on feedback from past workshop participants, BELIV 2010 will be a *2-day workshop* to provide a more interactive environment where participants can produce a research agenda to be published online. DATES Deadline for submissions: November 30, 2009 (5:00pm PDT) Notification of acceptance: December 21, 2009 Camera ready papers due: Mid-March Workshop: April 10-11, 2008 HOW TO PARTICIPATE To participate to the workshop it is necessary to have a paper accepted and be registered both to the workshop and the main CHI conference. Paper Types We accept 2 types of submissions: position papers or research papers: * Research papers are longer (4-8 pages) and present new work and unpublished results. Research papers will be peer-reviewed by members of the program committee and selected according to their novelty, quality and relevance. Authors of accepted research papers will have a chance to revise their papers before they are published in the **ACM digital library**. * Position papers are short statements (1-2 pages) describing a participant's relevant experience and ideas that can contribute to the discussion during the workshop. They will be made available to the workshop participants only. Submission To submit a paper create an account and submit the paper to the submission system at: https://cmt.research.microsoft.com/BELIV2010/. Please clarify if you are submitting a position or research paper. Format All the submissions should be formatted in the ACM style. Suitable templates, in LaTeX and Word, can be downloaded from: http://<http://goog_1254882892965/> www.acm.org/sigs/pubs/proceed/template.html. Submission should be either in PDF (preferred) or Word formats. TOPICS OF INTEREST Topics include, but are not limited to: • Evaluation in the visualization lifecycle • Utility characterization • Evaluation metrics • Insight characterization • Synthetic data set generation • Taxonomies of tasks • Benchmark development and repositories • Methodology of longitudinal case studies • Evaluation of early prototypes • Evaluation heuristics and guidelines ORGANIZERS Enrico Bertini University of Konstanz Konstanz, Germany Heidi Lam Google Inc. Mountain View, CA, USA Adam Perer IBM Haifa Research Lab Mount Carmel, Haifa, Israel <adamp@il.ibm.com>