AnyLearn
All cursus
Computer Scienceadvanced

Probabilistic Data Structures: Answers Without the Data

Answering set questions exactly costs memory proportional to the data, and that is a lower bound rather than an inefficiency. Sketches give up exactness in a specific, chosen direction and get constant memory in return. This path builds the three that run modern infrastructure: Bloom filters for membership, HyperLogLog for distinct counts in twelve kilobytes, and count-min for frequency. It ends on the property that actually explains their ubiquity, which is not the space saving.

0 of 4 lessons complete
Sign in to track progress and earn a certificate.

Lessons, in order

  1. 1
    Computer Science
    The Bargain: Bounded Memory for Bounded Error
    Start
  2. 2
    Computer Science
    Bloom Filters: Membership in a Bit Array
    Start
  3. 3
    Computer Science
    HyperLogLog: Counting Distinct Items in Kilobytes
    Start
  4. 4
    Computer Science
    Count-Min, and Why Sketches Compose
    Start