微软研究峰会2021 | 讲座:SPTAG++: 毫秒量级千亿超大规模向量搜索解决方案
日期
2021-12-14
演讲者
微软亚洲研究院主管研究员陈琪
左侧概览
Current state-of-the-art vector approximate nearest neighbor search (ANNS) libraries mainly focus on how to do fast high-recall search in memory. However, extremely large-scale vector search scenarios present certain challenges. For example, hundreds of billions of vectors coupled with limited memory creates a capacity issue. There is also a scalability issue because increasing the number of serving machines increases query latency and computation costs. This occurs as a result of the search being done in each machine, and latency increases with the increased number of aggregating candidates. To address these challenges, we propose SPTAG++, a distributed ANNS system. In this talk, we’ll discuss SPTAG++, which is now integrated into production to support hundreds of billions-scale vector searches in production with millisecond response time and more than ten thousand queries per second.
Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit