Category Archives: News

Longer, more in-depth updates from the lab

Prototype presented at IACS 2014

(Screen shot of the prototype rendering data set 2. Click here to run the prototype.)

Our prototype for graph sonification was presented on September 26 at the First Conference of the International Association for Cognitive Semiotics (IACS 2014) in Lund, Sweden. You can follow this link to play around with a slightly updated copy of the prototype that we presented.

Other than a couple of bug fixes and a couple of adaptations to make it work under WordPress, this is the same as what was presented at Lund. It will need the full browser window, and as it uses WebAudioAPI it does require a reasonably recent Chrome, Firefox or Safari.

Three presentations at the cognitive semiotics conference in Lund

We will be presenting three projects at the First Conference of the International Association for Cognitive Semiotics (IACS-2014) that will be held in September 25-27, at Lund University:

  • Progress toward translating ‘visual’ graphics into sound to produce more accessible interfaces (with implications for the picture perception debate).
  • An Embodied Cognition Approach to Distinguishing Pictures, Diagram, and Sentences to Inform Design.
  • ‘Perceptually optimizing’ depictions of blood flow dynamics via caricature, sequential art, and 20th century futurism.

New project: An Embodied Cognition Approach to Meeting the Challenge of ‘Inclusive InfoVis’

Researchers working in the interrelated fields of interactive information visualization and visual analytics often state that “the eye and the visual cortex of the brain form a massively parallel processor that provides the highest-bandwidth channel into human cognitive centers” (Ware, 2004). This popular view has been reflected in many design decisions. For example, visualizations are prominently featured in the New York Times (e.g., Carter, 2012), contemporary artwork (e.g., Viégas and Wattenberg, 2007), and popular media (e.g., Vizter on TV, 2013). Tools such as Many Eyes (Eyes and Hoag, 2009) and Cognos (Khalid et al., 2010) are intended to help non-technical audiences create visualizations by accessing their own personal datasets.

However, many digital media consumers do not access graphics using vision. For example, vision-impaired screen reader users may use digital media such as text-to-speech audio or braille. The Web Content Accessibility Guidelines ( were developed to make digital media accessible to this 20% of the target market. According to these guidelines, a visual graphic is considered ‘accessible’ if it has been ‘translated’ into a text description that can be read to an audience via screen reader technology. This approach to accessibility seems to ignore the objectives of those who create the visualizations. If text descriptions can adequately convey a visualizer’s intent, then why create a visualization in the first place?

This project will explore what is lost and gained when a visual is described via text, how what is lost may be delivered through another sensory mode (such as sound), and how individual differences shape perception of these media. Together, the results will extend and apply theoretical principles, helping to develop display techniques that use non-visual sensory modes, and thereby engendering a more inclusive approach to presenting this kind of information.


Barsalou, L. W. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1521):1281.

Burton, J. and Coppin, P. (2012). Understanding and predicting the affordances of visual logics. In 3rd International Workshop on Euler Diagrams, page 47.

Carter, S. (2012). Four ways to slice Obama’s 2013 budget proposal. Online.

Coppin, P. W. (2012) Research summary: Affordances of realistic pictures, outline drawings, diagrams, and text: Toward a science of visual information design. Social Science Research Network Working Paper Series.

Coppin, P. W. (2011). Reconciling competing accounts of picture perception from art theory and perceptual psychology via the dual route hypothesis. European Perspectives on Cognitive Science, 6170.

Coppin, P. W. (expected in December 2013). Perceptual-cognitive properties of realistic pictures, outline drawings,diagrams, and sentences: toward a science of information design. PhD thesis, University of Toronto.

Eyes, I. M. and Hoag, T. (2009). Many eyes. Many Eyes.

Khalid, R., Cloves, I., and Yip, S. (2010). Introduction to IBM cognos 8 business intelligence. In Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research, page 351. IBM Corp.

Viégas, F. B. and Wattenberg, M. (2007). Artistic data visualization: Beyond visual analytics. In Online Communities and Social Computing, pages 182–191. Springer.

Ware, C. (2004). Information visualization: perception for design. Elsevier.

Update from flow visualization project

Here is a preview of the cover for our forthcoming scrapbook that presents the many visuals we created in Summer 2013. Author list will be posted shortly (author lists are tricky)! Special thanks to Research Assistant John Harvey (MDes Student, Digital Futures Initiative, OCADU and core member of our team during the summer effort) for taking the lead on putting this scrapbook together!