Recommender systems — a retrospective

Image for post
Image for post

You probably already know that recommender systems are all around you:

  • they select and rank products in marketplaces (Amazon, Yandex) and movies on Netflix/Disney to find the most relevant one to you,

As a result, today's recommender systems affect almost every aspect of user experience. And the current demands for personalized user experience and advances in machine learning are constantly pushing the field towards new scientific advances.

Image for post
Image for post
Falcon 9 SpaceX launch

Hi, I am Sergey, the author of the Catalyst — PyTorch library for deep learning research and development. In our previous blog posts, we covered an introduction to the Catalyst and our advanced pipeline for NLP on BERT distillation. In this post, I would like to share with you our development progress for the last month. Let’s check what features we have added to the framework in such a short time.


  • Training Flow improvements: BatchOverfitCallback, PeriodicLoaderCallback, ControlFlowCallback

You can find all…

Image for post
Image for post
Break the cycle — use the Catalyst!

PyTorch is great framework to create deep learning models and pipelines. Nevertheless, for all its merits, it could use improvements in terms of writing training loops, validating and testing neural networks. Moreover, PyTorch users are likely to introduce more bugs during the research and development process as they mix in complicated things like mutli-GPU, mixed precision, and distributed training.

For real breakthroughs in deep learning, we need a strong foundation. In this blog post, I would like to introduce Catalyst framework, developed with focus on reproducibility, fast experimentation and code/idea reusing. …

2 weeks ago, 13 November, one of the most exiting RL competitions of this year finally end. NIPS 2017: Learning to Run was really interesting and hard to solve. Nevertheless, me and my friend Mikhail Pavlov took 3rd place in the final round and we invited to NIPS conference. For more detailed description you can read our article or PyTorch/Theano source code.

Long story short, we use DDPG as a main agent and speed up environment as fast as we can. Our final agent was trained on 36 cores for about 5 days. …

Sergey Kolesnikov

R&D Lead @tinkoff_bank. @catalyst_core Lead.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store