New project: An Embodied Cognition Approach to Meeting the Challenge of ‘Inclusive InfoVis’

Researchers working in the interrelated fields of interactive information visualization and visual analytics often state that “the eye and the visual cortex of the brain form a massively parallel processor that provides the highest-bandwidth channel into human cognitive centers” (Ware, 2004). This popular view has been reflected in many design decisions. For example, visualizations are prominently featured in the New York Times (e.g., Carter, 2012), contemporary artwork (e.g., Viégas and Wattenberg, 2007), and popular media (e.g., Vizter on TV, 2013). Tools such as Many Eyes (Eyes and Hoag, 2009) and Cognos (Khalid et al., 2010) are intended to help non-technical audiences create visualizations by accessing their own personal datasets.

However, many digital media consumers do not access graphics using vision. For example, vision-impaired screen reader users may use digital media such as text-to-speech audio or braille. The Web Content Accessibility Guidelines (http://www.w3.org/WAI/intro/wcag.php) were developed to make digital media accessible to this 20% of the target market. According to these guidelines, a visual graphic is considered ‘accessible’ if it has been ‘translated’ into a text description that can be read to an audience via screen reader technology. This approach to accessibility seems to ignore the objectives of those who create the visualizations. If text descriptions can adequately convey a visualizer’s intent, then why create a visualization in the first place?

This project will explore what is lost and gained when a visual is described via text, how what is lost may be delivered through another sensory mode (such as sound), and how individual differences shape perception of these media. Together, the results will extend and apply theoretical principles, helping to develop display techniques that use non-visual sensory modes, and thereby engendering a more inclusive approach to presenting this kind of information.

References

Barsalou, L. W. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1521):1281.

Burton, J. and Coppin, P. (2012). Understanding and predicting the affordances of visual logics. In 3rd International Workshop on Euler Diagrams, page 47.

Carter, S. (2012). Four ways to slice Obama’s 2013 budget proposal. Online.

Coppin, P. W. (2012) Research summary: Affordances of realistic pictures, outline drawings, diagrams, and text: Toward a science of visual information design. Social Science Research Network Working Paper Series.

Coppin, P. W. (2011). Reconciling competing accounts of picture perception from art theory and perceptual psychology via the dual route hypothesis. European Perspectives on Cognitive Science, 6170.

Coppin, P. W. (expected in December 2013). Perceptual-cognitive properties of realistic pictures, outline drawings,diagrams, and sentences: toward a science of information design. PhD thesis, University of Toronto.

Eyes, I. M. and Hoag, T. (2009). Many eyes. Many Eyes.

Khalid, R., Cloves, I., and Yip, S. (2010). Introduction to IBM cognos 8 business intelligence. In Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research, page 351. IBM Corp.

Viégas, F. B. and Wattenberg, M. (2007). Artistic data visualization: Beyond visual analytics. In Online Communities and Social Computing, pages 182–191. Springer.

Ware, C. (2004). Information visualization: perception for design. Elsevier.