Lucene for Twitter Backend

Twitter Search is Now Based on Lucene

Team Twitter have revealed that they launched a new backend for search on Twitter.com over the last few weeks. The new search backend is based on the Lucene search engine library.

Twitter have rewritten parts of Lucene's core in-memory data structures – with a particular focus on the posting lists – and introduced lock-free data structures and algorithms. They have also worked on the garbage collection performance. Twitter plan to contribute these changes back to Lucene. Despite the changes, support for Lucene's standard APIs has been retained.

Jessica Thornsby

What do you think?

JAX Magazine - 2014 - 03 Exclucively for iPad users JAX Magazine on Android

Comments

Latest opinions