Graph-based time-space trade-offs for approximate near neighbors

  • Thijs Laarhoven

Research output: Contribution to journalArticleAcademic

37 Downloads (Pure)

Abstract

We take a first step towards a rigorous asymptotic analysis of graph-based approaches for finding (approximate) nearest neighbors in high-dimensional spaces, by analyzing the complexity of (randomized) greedy walks on the approximate near neighbor graph. For random data sets of size $n = 2^{o(d)}$ on the $d$-dimensional Euclidean unit sphere, using near neighbor graphs we can provably solve the approximate nearest neighbor problem with approximation factor $c > 1$ in query time $n^{\rho_q + o(1)}$ and space $n^{1 + \rho_s + o(1)}$, for arbitrary $\rho_q, \rho_s \geq 0$ satisfying \begin{align} (2c^2 - 1) \rho_q + 2 c^2 (c^2 - 1) \sqrt{\rho_s (1 - \rho_s)} \geq c^4. \end{align} Graph-based near neighbor searching is especially competitive with hash-based methods for small $c$ and near-linear memory, and in this regime the asymptotic scaling of a greedy graph-based search matches the recent optimal hash-based trade-offs of Andoni-Laarhoven-Razenshteyn-Waingarten [SODA'17]. We further study how the trade-offs scale when the data set is of size $n = 2^{\Theta(d)}$, and analyze asymptotic complexities when applying these results to lattice sieving.
Original languageEnglish
Number of pages27
JournalarXiv
Publication statusPublished - 8 Dec 2017

Bibliographical note

26 pages, 4 figures

Keywords

  • cs.DS
  • cs.CC
  • cs.CG
  • cs.CR
  • cs.IR

Fingerprint

Dive into the research topics of 'Graph-based time-space trade-offs for approximate near neighbors'. Together they form a unique fingerprint.
  • Graph-based time-space trade-offs for approximate near neighbors

    Laarhoven, T., 1 Jun 2018, 34th International Symposium on Computational Geometry, SoCG 2018. Toth, C. D. & Speckmann, B. (eds.). Dagstuhl: Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 14 p. 57. (Leibniz International Proceedings in Informatics, LIPIcs; vol. 99).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Open Access
    File
    8 Citations (Scopus)
    91 Downloads (Pure)

Cite this