Lucene for Twitter Backend

Twitter Search is Now Based on Lucene

Jessica Thornsby

Twitter to contribute changes back to Lucene.

Team Twitter have revealed that they launched a new backend for search on over the last few weeks. The new search backend is based on the Lucene search engine library.

Twitter have rewritten parts of Lucene’s core in-memory data structures – with a particular focus on the posting lists – and introduced lock-free data structures and algorithms. They have also worked on the garbage collection performance. Twitter plan to contribute these changes back to Lucene. Despite the changes, support for Lucene’s standard APIs has been retained.

comments powered by Disqus