*** Call for Papers *** BELIV 2012: Beyond Time and Errors - Novel Evaluation Methods for Visualization A Workshop at the VisWeek 2012 Conference *** October 14(/15), 2012 - Seattle, WA, USA *** WORKSHOP WEBSITE: http://www.beliv.org/wiki/BELIV2012 DESCRIPTION Visualization has recently gained much relevance for its ability to cope with complex data analysis tasks and communication. While the overall use of visualizations is accelerating, the growth of techniques for the evaluation of these systems has been slow. To understand these complex behaviors, evaluation efforts should be targeted at the component level, the system level, and the work environment level. The commonly used evaluation metrics such as task time completion and number of errors appear often insufficient to quantify the quality of a visualization system; thus the name of the workshop: "beyond time and errors ...". The BELIV workshop series is a bi-annual event focusing on the challenges of evaluation in visualization. While it has been focused on information visualization in the past, BELIV 2012 aims at gathering researchers in all fields of visualization to continue the exploration of novel evaluation methods, and to structure the knowledge on evaluation in visualization around a schema, where researchers can easily identify unsolved problems and research gaps. This is the fourth edition of the BELIV workshop series. It will be held as an open full-day workshop with paper presentations and discussions on October 14th and continue on the 15th with focused discussion for attendees interested to follow-up on topics and challenges raised during the first day. The second day is meant as an extended opportunity for participants and organizers to re-engage most active discussion topics of the first day DATES Deadline for submissions: September 1, 2012 Notification of acceptance: September 24, 2012 Camera ready papers due: October 1, 2012 Workshop: October 14/(15), 2012 HOW TO PARTICIPATE All registered attendees of VisWeek will be able to attend the workshop. In order to present a paper and participate as a panelist in the discussions, it is necessary to have a paper accepted. The panel discussion itself is open to everybody. PAPER TYPES We accept 2 types of submissions: position papers or research papers: * Research papers are longer (4-8 pages) and present new work and unpublished results. Research papers will be peer-reviewed by members of the program committee and selected according to their novelty, quality and relevance. We are currently investigating whether we will, as in the past, be able to publish all accepted papers in a digital library including the assignment of DOIs to the papers. We plan to invite a selected subset of the research papers to contribute to a special issue journal publication in a major visualization journal venue such as TVCG. * Position papers are short statements (1-2 pages) describing a participant's relevant experience and ideas that can contribute to the discussion during the workshop. They will be made available online. For past BELIV papers see these links: * BELIV 2006: http://doi.acm.org/10.1145/1168149 * BELIV 2008: http://doi.acm.org/10.1145/1377966 * BELIV 2010: http://doi.acm.org/10.1145/2110192 SUBMISSION Information on the submission procedure and submission system will be published on the website shortly. FORMAT Information on the paper format will be published on the website shortly. Papers have to be submitted in PDF format. TOPICS OF INTEREST Topics include, but are not limited to: * Evaluation in the visualization development lifecycle, * Utility characterization, * Evaluation metrics, * Insight characterization, * Synthetic data sets and benchmarks, * Taxonomy of tasks, * Computational evaluation, * Benchmark development and repositories, * Methods for longitudinal studies and adoption, * Evaluation of early prototypes, and * Evaluation heuristics and guidelines. ORGANIZERS Enrico Bertini (enrico.bertini@uni-konstanz.de): University of Konstanz Adam Perer (adam.perer@us.ibm.com): IBM Research Heidi Lam (heidi.lam@gmail.com): Google Inc. Petra Isenberg (petra.isenberg@inria.fr): INRIA Tobias Isenberg (tobias.isenberg@inria.fr): INRIA