Visualizing text: theory and practice
May 18th, 2010 | Cornelius Puschmann
Bad, bad me — of course I’ve been putting off writing up my ideas and thoughts for THATcamp almost to the latest possible moment. Waiting so long has one definitive advantage though: I get to point to some of the interesting suggestions that have already been posted here and (hopefully) add to them.
I’d like to both discuss and do text visualization. Charts, maps, infographics and other forms of visualization are becoming increasingly popular as we are faced with large quantities of textual data from a variety of sources. To linguists and literary scholars, visualizing texts can (among other things) be interesting to uncover things about language as such (corpus linguistics) and about individual texts and their authors (narratology, stylometrics, authorship attribution), while to a wide range of other disciplines the things that can be inferred from visualization (social change, spreading of cultural memes) beyond the text itself can be interesting.
What can we potentially visualize? This may seem to be a naive question, but I believe that only by trying out virtually everything we can think of (distribution of letters, words, word classes, n-grams, paragraphs, …; patterning of narrative strands, structure of dialog, occurrence of specific rhetorical devices; references to places, people, points in time…; emotive expressions, abstract verbs, dream sequences… you name it) can we reach conclusions about what (if anything!) these things might mean.
How can we visualize text? If we consider for a moment how we mostly visualize text today it quickly becomes apparent that there is much more we could be doing. Bar plots, line graphs and pie charts are largely instruments for quantification, yet very often quantitative relations between elements aren’t our only concern when studying text. Word clouds add plasticity, yet they eliminate the sequential patterning of a text and thus do not represent its rhetorical development from beginning to end. Trees and maps are interesting in this regard, but by and large we hardly utilize the full potential of visualization as a form of analysis, for example by using lines, shapes, color (!) and beyond that, movement (video) in a way that suits the kind of data we are dealing with.
What tools can we use to do visualization? I’m very interested in Processing and have played with it, also more extensively with R and NLTK/Python. Tools for rendering data, such as Google Chart Tools, igraph and RGraph are also interesting. Other, non-statistical tools are also an option: free hand drawing tools and web-based services like Many Eyes. Visualization doesn’t need to be restricted to computation/statistics. Stephanie Posavec‘s trees are a dynamic mix of automation and manual annotation and demonstrate that visualizations are rhetorically powerful interpretations themselves.
I hope that some of the abovementioned things connect to other THATcampers’ ideas, e.g. Lincoln Mullen’s post on mining scarce sources and Bill Ferster’s post on teaching using visualization.
Don’t get me started on the potential for teaching. Ultimately translating a text into another form is a unique kind of critical engagement: you’re uncovering, interpreting and making an argument all at once, both to the text in question and to yourself.
Anyway — anything from discussing theoretical issues of visualization to sharing code snippets would fit into this session and I’m looking forward to hearing other campers’ thoughts and experiences on the subject.
May 18th, 2010 at 8:56 pm
[…] Note: I’ve also posted this on thatcamp.org. […]
May 20th, 2010 at 8:25 pm
Visualizations don’t seem to be living up to their potential, I agree.
I initially considered using Processing as a framework for my own visualization project, but eventually decided on Adobe Flash for prototyping, as it’s already focused on interactive motion graphics. Of course, I’m pretty neutral about platforms — and am in fact more interested in how the development process can be thought through to take more advantage of the strengths of different languages or programs without the current significant barriers of knowledge or technology.
How does one integrate both subjective and textual data together? I think this question, along with the others you mentioned, would be very interesting discussion topics.
May 21st, 2010 at 8:03 pm
Thanks for this handy list of tools that I’ll have to look into. I would be very interested in this conversation and can certainly talk some about geospatial and temporal visualization.
May 21st, 2010 at 9:32 pm
Thanks for the responses, guys!
@John: there’s a growing number of tools out there, both toolkits (i.e. programming languages such as Flash, PHP, Python, R, Processing etc) and ready-made solutions that don’t require programming but are consequently more limited in their capabilities. When it comes to the type of visualizations we can currently do I feel like we have a chicken-egg problem: we need to combine an understanding of humanities data with a solid grasp of visualization (and, if we want to do quantitative stuff, statistics) to build meaningful visualizations.
And yes, combining subjective tagging with structural characteristics is a challenge. Kinda ties in with Hugh Cayless proposal for markup:
thatcamp.org/2010/the-inadequacies-of-markup/
@Brian: I’d definitly like to hear more about geospatial and temporal vis.
May 23rd, 2010 at 6:54 pm
[…] a Twitter graph (=who you are following and who is following you) that I briefly showed at the session on visualizing text today at THATCamp and that I wanted to share. My comments in the code are very basic and there is […]