Package: textreuse 1.0.1

Yaoxiang Li

textreuse: Detect Text Reuse and Document Similarity

Tools for measuring similarity among documents and detecting passages which have been reused. Implements shingled n-gram, skip n-gram, and other tokenizers; similarity/dissimilarity functions; pairwise comparisons; minhash and locality sensitive hashing algorithms; and a version of the Smith-Waterman local alignment algorithm suitable for natural language.

Authors:Lincoln Mullen [aut], Yaoxiang Li [aut, cre]

textreuse_1.0.1.tar.gz
textreuse_1.0.1.zip(r-4.7)textreuse_1.0.1.zip(r-4.6)textreuse_1.0.1.zip(r-4.5)
textreuse_1.0.1.tgz(r-4.6-x86_64)textreuse_1.0.1.tgz(r-4.6-arm64)textreuse_1.0.1.tgz(r-4.5-x86_64)textreuse_1.0.1.tgz(r-4.5-arm64)
textreuse_1.0.1.tar.gz(r-4.7-arm64)textreuse_1.0.1.tar.gz(r-4.7-x86_64)textreuse_1.0.1.tar.gz(r-4.6-arm64)textreuse_1.0.1.tar.gz(r-4.6-x86_64)
textreuse_1.0.1.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
textreuse/json (API)

# Install 'textreuse' in R:
install.packages('textreuse', repos = c('https://packages.ropensci.org', 'https://cloud.r-project.org'))

Reviews:rOpenSci Software Review #20

Bug tracker:https://github.com/ropensci/textreuse/issues

Pkgdown/docs site:https://docs.ropensci.org

Uses libs:
  • c++– GNU Standard C++ Library v3

On CRAN:

Conda:

peer-reviewedcpp

8.85 score 201 stars 251 scripts 633 downloads 1 mentions 49 exports 28 dependencies

Last updated from:6f8cbe3802 (on master). Checks:14 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-arm64OK167
linux-devel-x86_64OK147
pkgdown docsOK162
source / vignettesOK239
linux-release-arm64OK173
linux-release-x86_64OK177
macos-release-arm64OK113
macos-release-x86_64OK286
macos-oldrel-arm64OK85
macos-oldrel-x86_64OK233
windows-develOK118
windows-releaseOK139
windows-oldrelOK121
wasm-releaseOK168

Exports:align_localas_sparse_matrixcontentcontent<-count_matchesfilenameshas_contenthas_hasheshas_minhasheshas_tokenshash_stringhasheshashes<-is.TextReuseCorpusis.TextReuseTextDocumentjaccard_bag_similarityjaccard_dissimilarityjaccard_similaritylshlsh_addlsh_candidateslsh_comparelsh_probabilitylsh_querylsh_subsetlsh_thresholdmatching_tokensmetameta<-minhash_generatorminhashesminhashes<-pairwise_candidatespairwise_compareratio_of_matchesrehashskippedTextReuseCorpusTextReuseTextDocumenttoken_indextoken_index_candidatestokenizetokenize_ngramstokenize_sentencestokenize_skip_ngramstokenize_wordstokenstokens<-wordcount

Dependencies:assertthatBHclicpp11digestdplyrgenericsgluelatticelifecyclemagrittrMatrixNLPpillarpkgconfigpurrrR6RcppRcppProgressrlangstringistringrtibbletidyrtidyselectutf8vctrswithr

Introduction to the textreuse package
TextReuse classes | TextReuseTextDocument | TextReuseCorpus | Tokenizers | Hash functions | Comparison functions | Parallelization
Rendered fromtextreuse-introduction.Rmdusingknitr::rmarkdown

Last update: 2026-05-05
Started: 2015-10-22

Minhash and locality-sensitive hashing
Rendered fromtextreuse-minhash.Rmdusingknitr::rmarkdown

Last update: 2026-05-05
Started: 2015-10-22

Pairwise comparisons for document similarity
Rendered fromtextreuse-pairwise.Rmdusingknitr::rmarkdown

Last update: 2026-05-05
Started: 2015-10-22

Text Alignment
Rendered fromtextreuse-alignment.Rmdusingknitr::rmarkdown

Last update: 2026-05-05
Started: 2015-10-22

Readme and manuals

Help Manual

Help pageTopics
textreuse: Detect Text Reuse and Document Similaritytextreuse-package textreuse
Local alignment of natural language textsalign_local
Convert candidates data frames to other formatsas.matrix.textreuse_candidates as_sparse_matrix
Filenames from pathsfilenames
Hash a string to an integerhash_string
Locality sensitive hashing for minhashlsh
Add documents to a LSH cachelsh_add
Candidate pairs from LSH comparisonslsh_candidates
Compare candidates identified by LSHlsh_compare
Probability that a candidate pair will be detected with LSHlsh_probability lsh_threshold
Query a LSH cache for matches to a single documentlsh_query
List of all candidates in a corpuslsh_subset
Generate a minhash functionminhash_generator
Candidate pairs from pairwise comparisonspairwise_candidates
Pairwise comparisons among documents in a corpuspairwise_compare
Recompute the hashes for a document or corpusrehash
Measure similarity/dissimilarity in documentscount_matches jaccard_bag_similarity jaccard_dissimilarity jaccard_similarity matching_tokens ratio_of_matches similarity-functions
TextReuseCorpusis.TextReuseCorpus skipped TextReuseCorpus
TextReuseTextDocumenthas_content has_hashes has_minhashes has_tokens is.TextReuseTextDocument TextReuseTextDocument
Accessors for TextReuse objectshashes hashes<- minhashes minhashes<- TextReuseTextDocument-accessors tokens tokens<-
Build an index of tokens and documentstoken_index
Extract candidate document pairs from a token indextoken_index_candidates
Recompute the tokens for a document or corpustokenize
Split texts into tokenstokenizers tokenize_ngrams tokenize_sentences tokenize_skip_ngrams tokenize_words
Count wordswordcount