Visual Search at Pinterest

We demonstrate that, with the availability of distributed computation platforms such as Amazon Web Services and open-source tools, it is possible for a small engineering team to build, launch and maintain a cost-effective, large-scale visual search system. We also demonstrate, through a comprehensive set of live experiments at Pinterest, that content recommendation powered by visual search improves user engagement. By sharing our implementation details and learnings from launching a commercial visual search engine from scratch, we hope visual search becomes more widely incorporated into today's commercial applications.

cs.CV Computer Science

Paper

References (29)

01Retrieving Similar Styles to Parse ClothingKota Yamaguchi, M. Kiapour, Luis E. Ortiz et al.2015 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 151 citations

02Fully convolutional networks for semantic segmentationEvan Shelhamer, Jonathan Long, Trevor Darrell2014 · Computer Vision and Pattern Recognition · 43k citations In Library

03Going deeper with convolutionsChristian Szegedy, Wei Liu, Yangqing Jia et al.2014 · Computer Vision and Pattern Recognition · 48k citations In Library

04Very Deep Convolutional Networks for Large-Scale Image RecognitionK. Simonyan, Andrew Zisserman2014 · International Conference on Learning Representations · 113k citations In Library

05ImageNet Large Scale Visual Recognition ChallengeOlga Russakovsky, Jia Deng, Hao Su et al.2014 · International Journal of Computer Vision · 43k citations In Library

06Large-Scale Video Classification with Convolutional Neural NetworksA. Karpathy, G. Toderici, Sanketh Shetty et al.2014 · 2014 IEEE Conference on Computer Vision and Pattern Recognition · 6.7k citations

07Caffe: Convolutional Architecture for Fast Feature EmbeddingYangqing Jia, Evan Shelhamer, Jeff Donahue et al.2014 · ACM Multimedia · 15k citations In Library

08Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionKaiming He, X. Zhang, Shaoqing Ren et al.2014 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 13k citations In Library

09Return of the Devil in the Details: Delving Deep into Convolutional NetsKen Chatfield, K. Simonyan, A. Vedaldi et al.2014 · British Machine Vision Conference · 3.5k citations In Library

10Large scale visual recommendations from street fashion imagesVignesh Jagadeesh, Robinson Piramuthu, Anurag Bhardwaj et al.2014 · Knowledge Discovery and Data Mining · 143 citations In Library

11Using Web Co-occurrence Statistics for Improving Image CategorizationSamy Bengio, J. Dean, D. Erhan et al.2013 · arXiv.org · 20 citations In Library

12Scalable Object Detection Using Deep Neural NetworksD. Erhan, Christian Szegedy, Alexander Toshev et al.2013 · 2014 IEEE Conference on Computer Vision and Pattern Recognition · 1.2k citations In Library

Scroll for more · 17 remaining

Similar papers

Visual Discovery at PinterestAndrew Zhai, Dmitry Kislyuk, Yushi Jing et al.2017 · The Web Conference · 84 citations In Library

Shop The Look: Building a Large Scale Visual Shopping System at PinterestRaymond Shiau, Hao-Yu Wu, Eric Kim et al.2020 · Knowledge Discovery and Data Mining · 29 citations In Library

Visual Search at eBayF. Yang, Ajinkya Kale, Y. Bubnov et al.2017 · Knowledge Discovery and Data Mining · 107 citations In Library

Shop The LookRaymond Shiau, Hao-Yu Wu, Eric Kim et al.2020 In Library

Visual Search at AlibabaYanhao Zhang, Pan Pan, Yun Zheng et al.2018 · Knowledge Discovery and Data Mining · 148 citations In Library

Web-Scale Responsive Visual Search at BingHoudong Hu, Yan Wang, Linjun Yang et al.2018 · Knowledge Discovery and Data Mining · 67 citations In Library

Amazon Shop the Look: A Visual Search System for Fashion and HomeMing Du, Arnau Ramisa, Amit Kumar K C et al.2022 · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · 29 citations In Library

Towards Practical Visual Search Engine within ElasticsearchCun Mu, Jun Zhao, Guang Yang et al.2018 · eCOM@SIGIR · 20 citations In Library

Smart visual search engines for e-commerce: Leveraging deep feature embeddings for enhanced product retrievalShylaja Chityala2023 · International Journal of Computing and Artificial Intelligence In Library

Learning a Unified Embedding for Visual Search at PinterestAndrew Zhai, Hao-Yu Wu, E. Tzeng et al.2019 · Knowledge Discovery and Data Mining · 60 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal