Summary

Description	Bare-Bones Basics of Full-Text Search—This is a version of a presentation I gave, re-recorded to share more widely. From the introduction: "Most of what we are going to cover is actually more basic than the stuff we do with CirrusSearch, Elasticsearch, and Lucene—which power the search on Wikipedia and other wikis—but it makes for a good mental model of the basic parts of an information retrieval system, and it provides a place to build on to discuss the more complex processing we actually do today. My goal is to start with no prerequisites and go over inverted indexes, tokenization and stemming, basic boolean and proximity retrieval operations, TF/IDF and the vector space model of similarity, field-level indexing, using multiple indexes, and then touch on some of the elements of scoring."
Date	2018-01-18
Source	commons.wikimedia.org
Author	Trey Jones (WMF)

Licensing

CC BY-SA

Attribution: Trey Jones (WMF), 2018-01-18