web builder

Posts

Mobirise

AISTATS: 1 accepted paper

We have 1 paper at the main conference (poster):

Stochastic Frank-Wolfe: Unified Analysis and New Faces of Classical Method (with Ruslan Nazykov, Aleksandr Shestakov, Vladimir Solodkin, Gauthier Gidel, Alexander Gasnikov)

Jan 20, 2024

Mobirise

ICLR: 1 accepted paper

We have 1 paper at the main conference (poster):

Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting (with Aleksei Ustimenko)

Jan 20, 2024

Mobirise

New paper out

"Activations and Gradients Compression for Model-Parallel Training" - joint work with Mikhail Rudakov, Yaroslav Kholodov, Alexander Gasnikov.

Jan 18, 2024

Mobirise

New paper out

"Optimal data splitting in distributed optimization for machine learning" - joint work with Daniil Medyakov, Gleb Molodtsov, Aleksandr Beznosikov, Alexander Gasnikov.

Jan 18, 2024

Mobirise

New paper out

"Optimal Analysis of Method with Batching for Monotone Stochastic Finite-Sum Variational Inequalities" - joint work with Alexander Pichugin, Maksim Pechin, Alexander Gasnikov.

Jan 18, 2024

Mobirise

Yandex ML Prize

I received the Yandex ML Prize award in the "Yandex researchers" category! Thank you to everyone who was there for me!

Dec 16, 2023

Mobirise

New paper out

"About some works of Boris Polyak on convergence of gradient methods and their development" - joint work with Seydamet Ablaev, Alexander Gasnikov, Darina Dvinskikh, Aleksandr Lobanov, Sergei Puchinin, Fedor Stonyakin.

Nov 30, 2023

Mobirise

AI Leaders Award

I received the AI Leaders Award in the "Researchers" category! This is our joint victory! Thank you to everyone who helped and supported!

Nov 23, 2023

Mobirise

AI Journey Best Paper Award

Our joint paper with with Mikhail Rudakov, Yaroslav Kholodov, Alexander Gasnikov "Activations and Gradients Compression for Model-Parallel Training" the AI Journey Best Paper Award!

Nov 22, 2023

Mobirise

New paper out

"Bregman Proximal Method for Efficient Communications under Similarity" - joint work with Darina Dvinskikh, Andrei Semenov, Alexander Gasnikov.

Nov 14, 2023

Mobirise

Teacher on the Optimization in ML course

In the new semester we (with Alexander Gasnikov and Roland Hildebrand) teach the Optimization in ML course at Skoltech.

Oct 31, 2023

Mobirise

New paper out

"Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting" - joint work with Aleksei Ustimenko.

Oct 11, 2023

Mobirise

NeurIPS: 2 accepted papers

We have 4 papers at the main conference (posters). These papers are

1) Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed
Variational Inequalities (with Martin Takac, Alexander Gasnikov) - arxiv

2) First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities (with Sergey Samsonov, Marina Sheshukova, Alexander Gasnikov, Alexey Naumov, Eric Moulines) - arxiv

Sep 22, 2023

Mobirise

New paper out

"Real Acceleration of Communication Process in Distributed Algorithms with Compression" - joint work with Svetlana Tkachenko, Artem Andreev, Alexander Gasnikov.

Sep 14, 2023

Mobirise

Teacher on the Probability Theory course

In the new semester I teach the Optimization in ML course at Innopolis University as a lecture.

Sep 1, 2023

Mobirise

Lecturer on the Optimization course

In the new semester I teach the Optimization course at MIPT as a lecture and the Probability Theory course (also at MIPT) as a seminar teacher.

Sep 1, 2023

Mobirise

New paper out

"Optimal Algorithm with Complexity Separation for Strongly Convex-Strongly Concave Composite
Saddle Point Problems" - joint work with Ekaterina Borodich, Georgiy Kormakov, Dmitry Kovalev, Alexander Gasnikov.

Jul 26, 2023

Mobirise

New paper out

"Decentralized Optimization Over Slowly Time-Varying Graphs: Algorithms and Lower Bounds" - joint work with Dmitry Metelev, Alexander Rogozin, Alexander Gasnikov, Anton Proskurnikov.

Jul 26, 2023

Mobirise

New paper out

"Non-Smooth Setting of Stochastic Decentralized Convex Optimization Problem Over Time-Varying Graphs" - joint work with Aleksandr Lobanov, Andrew Veprikov, Georgiy Konin, Alexander Gasnikov, Dmitry Kovalev.

Jul 3, 2023

Mobirise

New paper out

"First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities" - joint work with Sergey Samsonov, Marina Sheshukova, Alexander Gasnikov, Alexey Naumov, Eric Moulines.

May 27, 2023

Mobirise

New paper out

"Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features" - joint work with David Dobre, Gauthier Gidel.

Apr 25, 2023

Mobirise

New paper out

"Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities" - joint work with Alexander Gasnikov.

Feb 15, 2023

Mobirise

Teacher on the Probability Theory course

In the new semester I teach the Stochastic Process and Numerical Optimization courses in MIPT as a seminar teacher. Also I am a co-lecturer of "Optimization in Machine Learning" course in VK Academy.

Feb 6, 2023

Mobirise

AISTATS: 1 accepted paper

We have 1 paper at the main conference (poster):

Stochastic Gradient Descent-Ascent: Unified Theory and New Efficient Methods (with Eduard Gorbunov, Hugo Berard and Nicolas Loizou) - arxiv

Jan 20, 2023

Mobirise

New paper out

"Randomized gradient-free methods in convex optimization" - joint work with Alexander Gasnikov, Darina Dvinskikh, Pavel Dvurechensky, Eduard Gorbunov and Alexander Lobanov.

Nov 24, 2021

Mobirise

New paper out

"Decentralized optimization over time-varying graphs: a survey" - joint work with Alexander Rogozin, Alexander Gasnikov and Dmitry Kovalev.

Oct 18, 2022

Mobirise

New paper out

"SARAH-based Variance-reduced Algorithm for Stochastic Finite-sum Cocoercive Variational Inequalities" - joint work with Alexander Gasnikov.

Oct 12, 2022

Mobirise

NeurIPS: 4 accepted papers

We have 4 papers at the main conference (posters). These papers are

1) Optimal Gradient Sliding and its Application to Distributed Optimization Under Similarity - arxiv

2) Optimal Algorithms for Decentralized Stochastic Variational Inequalities (with Dmitry Kovalev, Abdurakhmon Sadiev, Michael Persiianov, Peter Richtárik, Alexander Gasnikov) - arxiv

3) Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees (with Peter Richtárik, Michael Diskin, Max Ryabinin, Alexander Gasnikov) - arxiv

4) Decentralized Local Stochastic Extra-Gradient for Variational Inequalities (with Pavel Dvurechensky, Anastasia Koloskova, Valentin Samokhin, Sebastian U Stich, Alexander Gasnikov) - arxiv

Sep 15, 2022

Mobirise

Teacher on the Probability Theory course

In the new semester I teach the Probability Theory course in MIPT as a seminar teacher.

Sep 1, 2022

Mobirise

New paper out

"Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems - Survey" - joint work with Boris Polyak, Eduard Gorbunov, Dmitry Kovalev, Alexander Gasnikov.

August 29, 2022

Mobirise

New paper out

"Compression and Data Similarity: Combination of Two Techniques for Communication-Efficient Solving of Distributed Variational Inequalities" - joint work with Alexander Gasnikov.

June 19, 2022

Mobirise

New paper out

"On Scaled Methods for Saddle Point Problems" - joint work with Aibek Alanov, Dmitry Kovalev, Martin Takáč, Alexander Gasnikov.

June 16, 2022

Mobirise

Master thesis defence

On 14 June I had a master thesis defence at MIPT.

June 14, 2022

Mobirise

ICML: 1 accepted paper

We have one paper at the main conference:

The Power of First-Order Smooth Optimization for Black-Box Non-Smooth Problems (Alexander Gasnikov, Anton Novitskii, Vasilii Novitskii, Farshed Abdukhakimov, Dmitry Kamzolov, Aleksandr Beznosikov, Martin Takáč, Pavel Dvurechensky, Bin Gu) - main conference (short talk) - arxiv

Jun 13, 2022

Mobirise

New paper out

"Stochastic Gradient Methods with Preconditioned Updates" - joint work with Abdurakhmon Sadiev, Abdulla Jasem Almansoori, Dmitry Kamzolov, Rachael Tappenden, Martin Takáč.

June 1, 2022

Mobirise

New paper out

"Optimal Gradient Sliding and its Application to Distributed Optimization Under Similarity" - joint work with Dmitry Kovalev, Ekaterina Borodich, Alexander Gasnikov, Gesualdo Scutari.

May 30, 2022

Mobirise

New paper out

Stochastic Gradient Descent-Ascent: Unified Theory and New Efficient Methods" - joint work with Eduard Gorbunov, Hugo Berard and Nicolas Loizou.

Feb 15, 2022

Mobirise

New paper out

"Optimal Algorithms for Decentralized Stochastic Variational Inequalities" - joint work with Dmitry Kovalev, Abdurakhmon Sadiev, Michael Persiianov, Peter Richtárik and Alexander Gasnikov.

Feb 6, 2022

Mobirise

Teacher on the Stochastic Processes course

In the new semester I begin to teach the Stochastic Processes course in MIPT as a seminar teacher (lecturer: Maksim Shirobokov).

Feb 1, 2022

Mobirise

New paper out

"The Power of First-Order Smooth Optimization for Black-Box Non-Smooth Problems" - joint work with Alexander Gasnikov, Anton Novitskii, Vasilii Novitskii, Farshed Abdukhakimov, Dmitry Kamzolov, Martin Takáč, Pavel Dvurechensky and Bin Gu.

Jan 28, 2022

Mobirise

New paper out

"A Unified Analysis of Variational Inequality Methods: Variance Reduction, Sampling, Quantization and Coordinate Descent" - joint work with Alexander Gasnikov, Karina Zainulina, Alexander Maslovskiy and Dmitry Pasechnyuk.

Jan 28, 2022

Mobirise

Grant for young researchers

Our team: Eduard Gorbunov, Alexander Rogozin, Vladislav Matyukhin and me, became the winner of a grant for young research groups.

Nov 30, 2021

Mobirise

New paper out

"Random-reshuffled SARAH does not need a full gradient computations" - joint work with Martin Takac.

Nov 26, 2021

Mobirise

NeurIPS: 4 accepted papers

We have one paper at the main conference. Also we have submitted 3 papers to OPT 2021: Optimization for Machine Learning and New Frontiers in Federated Learning: Privacy, Fairness, Robustness, Personalization and Data Ownership workshops. All were accepted! These papers are

1) Distributed Saddle-Point Problems Under Similarity (with Gesualdo Scutari, Alexander Rogozin and Alexander Gasnikov) - main conference (poster) - arxiv

2) Decentralized Personalized Federated Learning: Lower Bounds and Optimal Algorithm for All Personalization Modes (with Abdurakhmon Sadiev, Ekaterina Borodich, Darina Dvinskikh, Martin Takac and Alexander Gasnikov) - OPT ML workshop (spotlight) - arxiv

3) Random-reshuffled SARAH does not need a full gradient computations (with Martin Takac) - OPT ML workshop (poster)

4) Decentralized Personalized Federated Min-Max Problems (with Ekaterina Borodich, Abdurakhmon Sadiev, Vadim Sushko, Nikolay Savelyev, Martin Takac and Alexander Gasnikov) - NF in FL workshop - arxiv

Oct 22, 2021

Mobirise

New paper out

"Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees" - joint work with Peter Richtárik, Michael Diskin, Max Ryabinin and Alexander Gasnikov.

Oct 7, 2021

Mobirise

I am in MBZUAI till December

My internship as Research Assistant at Martin Takac's group has started today! It is a great pleasure for me to be a part of Martin's team and MBZUAI!

Oct 3, 2021

Mobirise

Paper accepted to NeurIPS

Our joint work with Gesualdo Scutari, Alexander Rogozin and Alexander Gasnikov got accepted and will be presented at NeurIPS in December. Now you can read it on arxiv.

Sep 29, 2021

Mobirise

Teacher on the Probability Theory course

In the new semester I teach the Probability Theory course in MIPT as a seminar teacher.

Sep 1, 2021

Mobirise

New paper out

"Distributed Saddle-Point Problems Under Similarity" - joint work with Gesualdo Scutari, Alexander Rogozin and Alexander Gasnikov.

Jul 22, 2021

Mobirise

New paper out

"Decentralized and Personalized Federated Learning" - Abdurakhmon Sadiev, Darina Dvinskikh and Alexander Gasnikov.

This is a draft version! Work in progress!

Jul 15, 2021

Mobirise

New paper out

"Optimal Decentralized Algorithms for Saddle Point Problems over Time-Varying Networks" - joint work with Alexander Rogozin, Dmitry Kovalev and Alexander Gasnikov.

Jul 13, 2021

Mobirise

New paper out

"One-Point Gradient-Free Methods for Composite Optimization with Applications to Distributed Optimization" - joint work with Ivan Stepanov, Artyom Voronov and Alexander Gasnikov.

This is my students' semester project! I am very glad they did it! That's not all! There will be more projects from my students!

This is a draft version! Work in progress!

Jul 13, 2021

Mobirise

Join Yandex Research team

It is my pleasure to join Yandex Research as a research intern!

Jul 12, 2021

Mobirise

Participation in Conference dedicated to the anniversaries of Yurii Nesterov and Vladimir Protasov

I am taking part in the conference "Optimization without borders" in Sochi. The conference is dedicated to the anniversaries of Yurii Nesetrov and Vladimir Protasov

Jul 11, 2021

Mobirise

Participation in all-Russian Optimization Seminar

I gave a talk about distributed optimization at the all-Russian Optimization Seminar.

Jun 30, 2021

Mobirise

New paper out

"Decentralized Local Stochastic Extra-Gradient for Variational Inequalities" - joint work with Pavel Dvurechensky, Anastasia Koloskova, Valentin Samokhin, Sebastian U Stich, Alexander Gasnikov.

Jun 15, 2021

Mobirise

New paper out

"Decentralized Personalized Federated Min-Max Problems" - joint work with Vadim Sushko, Abdurakhmon Sadiev, Alexander Gasnikov.

Jun 14, 2021

Mobirise

Participation in Control, Information and Optimization Summer School

During the school I will give a 1.5 hour lecture on saddle point problems and variational inequalities.

Jun 11, 2021

Mobirise

Participation in Moscow Conference on Combinatorics and Applications

I gave a 30 minute talk about distributed saddle point problems.

Jun 2, 2021

Mobirise

Poster on Communication Efficient Distributed Optimization Workshop

I was pleased to present my poster, as well as listen to speakers and discuss other posters

Apr 9, 2021

Mobirise

Junior Researcher at the Laboratory of Advanced Combinatorics and
Network Applications

I'm glad to be part of the laboratory team (head: Andrei Raigorodskii)

Mar 1, 2021

Mobirise

New paper out

"One-Point Gradient-Free Methods for Smooth and Non-Smooth Saddle-Point Problems" - joint work with Vasilii Novitskii, Alexander Gasnikov.

Mar 1, 2021

Mobirise

New paper out

"Solving smooth min-min and min-max problems by mixed oracle algorithms" - joint work with Egor Gladin, Abdurakhmon Sadiev, Alexander Gasnikov, Pavel Dvurechensky, Mohammad Alkousa.

Mar 1, 2020

Mobirise

I was awarded a scholarship in the field of numerical optimization methods

The scholarship was established by Professor Andrei Raigorodsky.

Feb 27, 2021

Mobirise

New paper out

"Distributed Saddle-Point Problems: Lower Bounds, Optimal Algorithms and Federated GANs" - joint work with Valentin Samokhin and Alexander Gasnikov. 

Feb 16, 2021

Mobirise

New paper out

"Decentralized Distributed Optimization for Saddle Point Problems" - joint work with Alexander Rogozin, Pavel Dvurechensky, Darina Dvinskikh, Dmitry Kovalev and Alexander Gasnikov.

Feb 15, 2021

Mobirise

Research assistant at the International Laboratory of Stochastic Algorithms and High-Dimensional Inference

I'm glad to be part of the laboratory team (heads: Eric Moulines, Alexey Naumov)

Feb 1, 2021

Mobirise

Teacher on the Stochastic Processes course

In the new semester I will teach the Stochastic Processes course at MIPT as a seminar teacher (lecturer: Maksim Shirobokov).

Feb 1, 2021

Mobirise

New paper out

"Recent theoretical advances in decentralized distributed convex optimization" - joint work with Eduard Gorbunov, Alexander Rogozin, Darina Dvinskikh and Alexander Gasnikov.

Nov 26, 2020

Mobirise

New paper out

"Local SGD for Saddle-Point Problems" - joint work with Valentin Samokhin and Alexander Gasnikov. Work in progress!

Oct 25, 2020

Mobirise

New paper out

"Zeroth-Order Algorithms for Smooth Saddle-Point Problems" - joint work with Abdurakhmon Sadiev, Pavel Dvurechensky and Alexander Gasnikov.

Sep 21, 2020

Mobirise

New paper out

"Linearly Convergent Gradient-Free Methods for Minimization of Symmetric Parabolic Approximation" - joint work with Aleksandra Bazarova and Alexander Gasnikov.

Sep 10, 2020

Mobirise

Teacher on the Probability Theory and Discrete Analysis courses

In the new semester I begin to teach the Probability Theory and Discrete Analysis courses in MIPT as a seminar teacher.

Sep 1, 2020

Mobirise

Visit to Sirius University

During the month I will give several lectures on optimization and will also take part in several projects.

Aug 2, 2020

Mobirise

Our paper was presented at MOTOR 2020

My joint work "Gradient-Free Methods for Saddle-Point Problem" with Abdurakhmon Sadiev and Alexander Gasnikov was presented at the conference and will be published in Communications in Computer and Information Science (CCIS) series.

Jul 15, 2020

Mobirise

Our paper was presented at IFAC 2020

My joint work "Derivative-Free Method For Decentralized Distributed Non-Smooth Optimization" with Eduard Gorbunov and Alexander Gasnikov was presented at the conference and will be published in IFAC-PapersOnLine.

Jul 12, 2020

Mobirise

New paper out

"Gradient-Free Methods for Saddle-Point Problem" - joint work with Abdurakhmon Sadiev and Alexander Gasnikov.

May 12, 2020

Mobirise

New paper out

"On Biased Compression for Distributed Learning" - joint work with Samuel Horváth, Peter Richtárik and Mher Safaryan.
The work was done while I was on an internship at KAUST in the team of professor Peter Richtárik. Thank you Peter for inviting me!

Feb 27, 2020

Mobirise

Advisor on the Machine Learning course

In the new semester I will be a student advisor on the Machine Learning course at Dorodnicyn Computing Centre of RAS.

Feb 13, 2020

Mobirise

Teacher on the Stochastic Processes course

In the new semester I will teach the Stochastic Processes course at MIPT as a seminar teacher (lecturer: Alexander Gasnikov).

Feb 7, 2020

© 2020-2024 Aleksandr Beznosikov