PUMA publications for /group/simtech/data%7D%20thinkingThu May 18 11:32:12 CEST 2017{10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314 USA}{IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS}{JAN}{10th IEEE Conference on Visual Analytics Science and Technology (VAST) / IEEE VIS Conference, Chicago, IL, OCT 25-30, 2015}{1}{61-70}{VA(2): A Visual Analytics Approach for // Evaluating Visual Analytics Applications}{Article; Proceedings Paper}{22}{2016}analytics; evaluation; tracking; aloud; {visual logs; eye thinking qualitative series time interaction data} {Evaluation has become a fundamental part of visualization research and researchers have employed many approaches from the field of human-computer interaction like measures of task performance, thinking aloud protocols, and analysis of interaction logs. Recently, eye tracking has also become popular to analyze visual strategies of users in this context. This has added another modality and more data, which requires special visualization techniques to analyze this data. However, only few approaches exist that aim at an integrated analysis of multiple concurrent evaluation procedures. The variety, complexity, and sheer amount of such coupled multi-source data streams require a visual analytics approach. Our approach provides a highly interactive visualization environment to display and analyze thinking aloud, interaction, and eye movement data in close relation. Automatic pattern finding algorithms allow an efficient exploratory search and support the reasoning process to derive common eye-interaction-thinking patterns between participants. In addition, our tool equips researchers with mechanisms for searching and verifying expected usage patterns. We apply our approach to a user study involving a visual analytics application and we discuss insights gained from this joint analysis. We anticipate our approach to be applicable to other combinations of evaluation techniques and a broad class of visualization applications.}