Skip to content
HomeVideosBooks
AllTopicsTrends
BlogsPodcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    Cover of Managing gigabytes

    Managing gigabytes

    Ian H. Witten, Alistair Moffat, Timothy C. Bell · 1999

    "In this fully updated second edition of the highly acclaimed Managing Gigabytes, authors Witten, Moffat, and Bell continue to provide unparalleled coverage of state-of-the-art techniques for compressing and indexing data. Whatever your field, if you work with large quantities of information, this book is essential reading - an authoritative theoretical resource and a practical guide to meeting the toughest storage and access challenges. It covers the latest developments in compression and indexing and their application on the Web and in digital libraries. It also details dozens of powerful techniques supported by mg, the authors' own system for compressing, storing, and retrieving text, images, and textual images. Mg's source code is freely available on the Web."--Jacket.

    Computer ScienceWeb & InternetElectronics & Hardware
    Open LibraryAmazon
    Stats for nerds
    26recommend
    40mentions
    35people
    2008–2026years
    68% recommend30% neutral3% critical

    Mentions per year

    2008201020122014201620182020202220242026

    What Hacker News says

    1. lazamarJul 2024
      Thanks for the link. I was motivated to write the post after reading Moffat’s book ‘Managing Gigabytes’. A pearl from the 90’s.

      The authors mention this technique in the second edition.

      thread
    2. DamonHDNov 2022
      Managing Gigabytes

      https://books.google.co.uk/books/about/Managing_Gigabytes.ht...

      Old but good!

      thread
    3. CoolestBeansNov 2022
      Came here to recommend Managing Gigabytes as well. People these days are managing far more than gigabytes but the fundamental ideas remain useful.
      thread
    4. sanxiynOct 2022
      If you want a book, Managing Gigabytes is still pretty good.
      thread
    5. skoczkoAug 2022
      If by a "search engine" you mean a tool to index and retrieve documents (essentially what the terms mean in the traditional Information Retrieval, e.g Lucene, SOLR, Elastic) then this is a pretty good on the subject that taught me a lot:

      https://www.amazon.com/Managing-Gigabytes-Compressing-Multim...

      thread
    6. injinjMay 2022
      I didn't see binary interpolative coding (BIC) referenced. It is one of my favorites introduced to me by the book "Managing Gigabytes" by Moffett and Bell [1]. It has great compression ratio for sequences and is commonly used in inverted indexes.

      There is neat implementation [2] and technical paper [3] by Giulio Ermanno Pibiri, which I just found today by looking for it.

      [1] https://people.eng.unimelb.edu.au/ammoffat/mg/

      [2] https://github.com/jermp/interpolative_coding

      [3] http://pages.di.unipi.it/pibiri/papers/BIC.pdf

      thread

    Related

    Cover of Hadoop
    2010–2017

    Hadoop

    Tom White
    2 recommend · 4
    Managing Time in Relational DatabasesTom Johnston
    2017–2021

    Managing Time in Relational Databases

    Tom Johnston
    2 recommend · 4
    Cover of Inside Intel
    2007–2016

    Inside Intel

    Tim Jackson
    2 recommend · 4
    Cover of Distributed Operating Systems
    2010–2024

    Distributed Operating Systems

    Andrew S. Tanenbaum
    4 recommend · 7
    Cover of Computer architecture
    2008–2026

    Computer architecture

    John L. Hennessy
    59 recommend · 110
    Cover of Linkers and loaders
    2008–2026

    Linkers and loaders

    John R. Levine
    29 recommend · 45
    Cover of Nanosystems
    2007–2026

    Nanosystems

    K. Eric Drexler
    6 recommend · 30
    Cover of Computer organization and design
    2008–2026

    Computer organization and design

    David A. Patterson
    50 recommend · 101