Skip to content
HomeVideos
AllLongsCategoriesPlaylists
BooksBlogsPodcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K

    What is in a Lucene index? Adrien Grand, Software Engineer, Elasticsearch

    LuceneSolrRevolution

    3 HN recommenders · recommended in 3 months, 2019–2020

    YouTube

    1:04:30 · 80K views · Dec 15, 2013

    Elasticsearch engineer and Lucene committer Adrien Grand explains the design decisions inside a Lucene index and what problems it can and cannot solve. The talk goes into how Lucene stores data for fast search and analytics.

    HN recommends it as an instructive, easy-to-follow look at Lucene internals from a core committer.

    Systems, Networks & SecurityDatabases & storageAlgorithms & data structures
    1. 59:56
      AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401)Amazon Web Services468K views • 7 years ago
    2. 50:31
      How Modern SQL Databases Come up with Algorithms that You Would Have Never Dreamed Of by Lukas EderDevoxx55K views • 9 years ago
    3. 31:44
      The Value of Values with Rich HickeyInfoQ145K views • 14 years ago
    4. 54:54
      Breakout Session Presented by Dan Robinson of Heap at PGConf Silicon Valley 2015Citus Data14K views • 10 years ago
    5. 54:52
      Introduction to NoSQL • Martin Fowler • GOTO 2012GOTO Conferences1M views • 13 years ago
    6. 1:06:24
      Rich Hickey: Deconstructing the DatabaseInfoQ106K views • 14 years ago
    7. 53:43
      AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)Amazon Web Services112K views • 7 years ago
    8. 4:57
      Rich Hickey rants about HttpServletRequest in 1080p: Death By Specificity from Clojure Made SimpleFred Overflow43K views • 6 years ago
    9. 42:31
      "Datafun: a functional query language" by Michael ArntzeniusStrange Loop Conference9.2K views • 9 years ago
    10. 59:13
      AWS re:Invent 2019: [REPEAT 1] Amazon DynamoDB deep dive: Advanced design patterns (DAT403-R1)AWS Events115K views • 6 years ago
    11. 1:07:41
      Modern Dictionaries by Raymond HettingerSF Python150K views • 9 years ago
    12. 58:36
      Advanced Topics in Programming Languages: A Lock-Free Hash TableGoogleTalksArchive29K views • 14 years ago
    13. 1:00:31
      BetrFS: A Right-Optimized Write-Optimized File SystemMicrosoft Research3.1K views • 10 years ago
    14. 49:16
      XFS: Recent and Future Adventures in Filesystem Scalability - Dave ChinnerLinux.conf.au 2012 -- Ballarat, Australia29K views • 14 years ago
    15. 52:29
      "I See What You Mean" by Peter AlvaroStrange Loop Conference59K views • 11 years ago
    16. 1:13:53
      Raymond Hettinger, Keynote on Concurrency, PyBay 2017SF Python161K views • 9 years ago
    17. 52:54
      Rust at speed — building a fast concurrent databaseJon Gjengset225K views • 7 years ago
    18. 47:43
      "Turning the database inside out with Apache Samza" by Martin KleppmannStrange Loop Conference206K views • 12 years ago
    19. 55:53
      Michael Stonebraker | Big Data is (at least) Four Different ProblemsMichigan Engineering30K views • 10 years ago
    20. 25:39
      H3: Tiling the Earth with HexagonsUber Engineering53K views • 8 years ago

    3 comments from Hacker News

    1. @drejJan 2020· in “Elasticsearch from the Bottom Up (2013)”

      I can super highly recommend talks by Adrien Grand on Lucene and Elasticsearch. They are super instructive yet easy to follow. this video [LINK]

      Strongly recommendsView on HN
    2. @stereosteveJun 2020· in “Reducing search indexing latency to one second”

      This is excellent. I was recently reviewing Lucene concepts and found this video really good: this video Also this site has a series of Lucene articles that are pretty nice. The one on Term Vectors in particular: [LINK] Based on some quick research it seems like Lucene is already using a sorted skip data structure for the posting list, so I wonder why they had to do a custom implementation? Perhaps it has to do with their custom Document ID scheme and how they want to preserve order in the Posting List being different from the default behavior. It also sounds like searchers are searching on indexes as they're being written, and there is some custom coordination around visibility, which might require diverging from Lucene default behavior. Either way, pretty impressive!

      RecommendsView on HN
    3. @ddorian43Sep 2019· in “Challenges in Implementing a Full-Text-Search Engine”

      This is extremely high level. A nice view of how lucene internals work by core committer Adrien Grand: [LINK] this video

      RecommendsView on HN