Skip the optimization that is not your bottleneck
popzxc explains a storage design using ordinary serialization after trying a more complex zero-copy approach. File-system costs were not dominant. Data is written after indexing, writes take a lock, and query transactions hold loaded data only for their lifetime.
Original excerptOriginal discussionHacker News discussion“Well, it's hard to give a concise overview, but in short -- I use `wincode` for serde (without zero-copy deserialization though; I've tried zero-copy”
Read the full original