corpustools: Managing, Querying and Analyzing Tokenized Text

Provides text analysis in R, focusing on the use of a tokenized text format. In this format, the positions of tokens are maintained, and each token can be annotated (e.g., part-of-speech tags, dependency relations). Prominent features include advanced Lucene-like querying for specific tokens or contexts (e.g., documents, sentences), similarity statistics for words and documents, exporting to DTM for compatibility with many text analysis packages, and the possibility to reconstruct original text from tokens to facilitate interpretation.

Version: 0.3.1
Depends: R (≥ 3.2.0), Matrix (≥ 1.2), data.table (≥ 1.10.4)
Imports: memoise, methods, plyr, wordcloud (≥ 2.5), SnowballC, stringi, Rcpp (≥ 0.12.12), R6
LinkingTo: Rcpp
Suggests: testthat, quanteda (≥ 0.99.9), tm (≥ 0.6), topicmodels, RNewsflow, igraph
Published: 2017-12-13
Author: Kasper Welbers and Wouter van Atteveldt
Maintainer: Kasper Welbers <kasperwelbers at>
License: GPL-3
NeedsCompilation: yes
SystemRequirements: C++11
Materials: README
CRAN checks: corpustools results


Reference manual: corpustools.pdf
Package source: corpustools_0.3.1.tar.gz
Windows binaries: r-devel:, r-release:, r-oldrel:
OS X El Capitan binaries: r-release: corpustools_0.3.1.tgz
OS X Mavericks binaries: r-oldrel: corpustools_0.3.1.tgz
Old sources: corpustools archive


Please use the canonical form to link to this page.