MS MARCO click-translation expansion tables ("poor man's" DSSM) [P]
Reddit r/MachineLearning1d4 min read
TLDR: I made "poor man’s" DSSM (Deep Structured Semantic Model) — the count-based translation table that can enrich the inverted index for full-text search. This trick can improve baseline BM25. So the idea is the following: - You have supervised pairs (query, relevant document), e.g., MS MARCO or click logs. - You tokenize both sides into some units (char n‑grams, wordpieces, words). - You count cross‑pair co‑occurrences: unit u on the document side vs. unit v on the query side (not co‑occurrence within the same text). - For each document‑side unit u, you keep the top‑k query‑side units v wit