TokenX

What is TokenX?
TokenX is a text visualization, analysis, and play tool designed for the XML document tree. It was created by Brian L. Pytlik Zillig, who is the digital initiatives librarian for E-Text. The tool was developed with the support of the Center for Digital Research in the Humanities at the University of Nebraska-Lincoln.

TokenX website at the University of Nebraska-Lincoln

What can TokenX do?
TokenX is designed to provide an easy-to-use interface for text analysis and visualization. The features currently available are:

• text highlighting based on patterns in words
• keyword in context
• replacing words with blocks
• word concordances sorted alphabetically or by frequency
• word usage statistics
• word substitution
• user-selected replacement of words with images
• creative exploration

How do I use TokenX?
You can use TokenX with any XML-formatted text available on the web, or try it out with pre-selected sample files. Simply visit the TokenX website at the University of Nebraska-Lincoln and enter your file information.