Rethinking attention with performers K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ...
arXiv preprint arXiv:2009.14794, 2020
1306 2020 Masked language modeling for proteins via linearly scalable long-context transformers K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ...
arXiv preprint arXiv:2006.03555, 2020
85 2020 Polyvit: Co-training vision transformers on images, videos and audio V Likhosherstov, A Arnab, K Choromanski, M Lucic, Y Tay, A Weller, ...
arXiv preprint arXiv:2111.12993, 2021
53 2021 Rethinking attention with performers. arXiv K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ...
preprint, 2020
32 2020 Ode to an ODE KM Choromanski, JQ Davis, V Likhosherstov, X Song, JJ Slotine, J Varley, ...
Advances in Neural Information Processing Systems 33, 3338-3350, 2020
26 2020 Rethinking attention with Performers. arXiv 2020 K Choromanski, V Likhosherstov, D Dohan, X Song, A Gane, T Sarlos, ...
arXiv preprint arXiv:2009.14794, 0
24 On the expressive power of self-attention matrices V Likhosherstov, K Choromanski, A Weller
arXiv preprint arXiv:2106.03764, 2021
22 2021 From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers K Choromanski, H Lin, H Chen, T Zhang, A Sehanobish, V Likhosherstov, ...
International Conference on Machine Learning, 3962-3983, 2022
19 2022 Sub-linear memory: How to make performers slim V Likhosherstov, KM Choromanski, JQ Davis, X Song, A Weller
Advances in Neural Information Processing Systems 34, 6707-6719, 2021
18 2021 Hybrid random features K Choromanski, H Chen, H Lin, Y Ma, A Sehanobish, D Jain, MS Ryoo, ...
arXiv preprint arXiv:2110.04367, 2021
18 2021 Large‐scale log analysis of digital reading P Braslavski, V Likhosherstov, V Petras, M Gäde
Proceedings of the Association for Information Science and Technology 53 (1 …, 2016
14 2016 Chefs' random tables: Non-trigonometric random features V Likhosherstov, KM Choromanski, KA Dubey, F Liu, T Sarlos, A Weller
Advances in Neural Information Processing Systems 35, 34559-34573, 2022
11 2022 Adaptive computation with elastic input sequence F Xue, V Likhosherstov, A Arnab, N Houlsby, M Dehghani, Y You
International Conference on Machine Learning, 38971-38988, 2023
6 2023 Stochastic flows and geometric optimization on the orthogonal group K Choromanski, D Cheikhi, J Davis, V Likhosherstov, A Nazaret, ...
International Conference on Machine Learning, 1918-1928, 2020
6 2020 UFO-BLO: Unbiased first-order bilevel optimization V Likhosherstov, X Song, K Choromanski, J Davis, A Weller
arXiv preprint arXiv:2006.03631, 2020
6 2020 Learning a fourier transform for linear relative positional encodings in transformers K Choromanski, S Li, V Likhosherstov, KA Dubey, S Luo, D He, Y Yang, ...
International Conference on Artificial Intelligence and Statistics, 2278-2286, 2024
5 2024 Simplex random features I Reid, KM Choromanski, V Likhosherstov, A Weller
International Conference on Machine Learning, 28864-28888, 2023
5 2023 Inference and Sampling of -free Ising Models V Likhosherstov, Y Maximov, M Chertkov
International Conference on Machine Learning, 3963-3972, 2019
5 2019 Ten months of digital reading: An exploratory log study P Braslavski, V Petras, V Likhosherstov, M Gäde
Research and Advanced Technology for Digital Libraries: 20th International …, 2016
5 2016 Debiasing a first-order heuristic for approximate bi-level optimization V Likhosherstov, X Song, K Choromanski, JQ Davis, A Weller
International Conference on Machine Learning, 6621-6630, 2021
3 2021