I haven't read the paper (yet) but thanks for your thorough explanation. I need to go implement a bloom filter to help make them feel less like magic.