Hotel Trader interview question

How would you handle deduplication in a distributed system?