Richard S. Sutton

Cited by

	All	Since 2016
Citations	101053	40958
h-index	91	58
i10-index	273	167

12000

6000

3000

9000

198919901991199219931994199519961997199819992000200120022003200420052006200720082009201020112012201320142015201620172018201920202021291 401 597 910 604 850 782 931 947 1017 1172 1217 1430 1811 1874 2172 2712 2987 3367 3440 3720 3766 4084 4085 4241 4420 4243 4719 5622 8186 10280 11843 249

Co-authors

Andrew BartoUniversity of Massachusetts AmherstVerified email at cs.umass.edu
Satinder SinghComputer Science and Engineering, University of MichiganVerified email at umich.edu
Doina PrecupDeepMind and McGill UniversityVerified email at cs.mcgill.ca
Patrick M. PilarskiDeepMind, Amii, and University of AlbertaVerified email at ualberta.ca
Charles Andersonprofessor of computer science, Colorado State University. Founder Pattern Exploration, LLC.Verified email at colostate.edu
Csaba SzepesvariDeepMind & Department of Computing Science, University of AlbertaVerified email at cs.ualberta.ca
Shalabh BhatnagarProfessor in the Department of Computer Science and Automation, Indian Institute of ScienceVerified email at iisc.ac.in
Adam WhiteUniversity of Alberta, DeepmindVerified email at ualberta.ca
Hamid MaeiCruise AutomationVerified email at getcruise.com
Thomas DegrisDeepMindVerified email at google.com
David SilverGoogle DeepMindVerified email at google.com
A. Rupam MahmoodAmii, University of AlbertaVerified email at ualberta.ca
Joseph ModayilComputing Science, University of AlbertaVerified email at cs.ualberta.ca
Elliot A. LudvigProfessor, Psychology, University of WarwickVerified email at warwick.ac.uk
E James KehoeProfessor of Psychology, University of New South WalesVerified email at unsw.edu.au
Martha WhiteUniversity of AlbertaVerified email at ualberta.ca
David McAllesterProfessor, Toyota Technological Institute at ChicagoVerified email at ttic.edu
Peter StoneProfessor of Computer Science, The University of Texas at AustinVerified email at cs.utexas.edu
Michael LittmanBrown UniversityVerified email at brown.edu
Mohammad GhavamzadehGoogle ResearchVerified email at google.com

Richard S. Sutton

DeepMind, Amii, and University of Alberta

Verified email at richsutton.com - Homepage

artificial intelligence reinforcement learning machine learning cognitive science computer science


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Reinforcement learning: An Introduction, 2nd edition RS Sutton, AG Barto MIT press, 2018	40638	2018
Reinforcement learning: An Introduction, 1st edition RS Sutton, AG Barto MIT press, 1998	7352*	1998
Learning to predict by the methods of temporal differences RS Sutton Machine learning 3 (1), 9-44, 1988	6095	1988
Neuronlike adaptive elements that can solve difficult learning control problems AG Barto, RS Sutton, CW Anderson IEEE transactions on systems, man, and cybernetics 13 (5), 834-846, 1983	4087	1983
Policy gradient methods for reinforcement learning with function approximation RS Sutton, DA McAllester, SP Singh, Y Mansour Advances in neural information processing systems, 1057-1063, 2000	3925	2000
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning RS Sutton, D Precup, S Singh Artificial intelligence 112 (1-2), 181-211, 1999	2705	1999
Guidelines: Guidelines for the diagnosis and management of syncope (version 2009): The Task Force for the Diagnosis and Management of Syncope of the European Society of … A Moya, R Sutton, F Ammirati, JJ Blanc, M Brignole, JB Dahm, JC Deharo, ... European heart journal 30 (21), 2631, 2009	1843	2009
Integrated architectures for learning, planning, and reacting based on approximating dynamic programming RS Sutton Proceedings of the International Conference on Machine Learning, 216-224, 1990	1683	1990
Toward a modern theory of adaptive networks: Expectation and prediction. RS Sutton, AG Barto Psychological review 88 (2), 135, 1981	1622	1981
Generalization in reinforcement learning: Successful examples using sparse coarse coding RS Sutton Advances in neural information processing systems, 1038-1044, 1996	1505	1996
Neural networks for control WT Miller, PJ Werbos, RS Sutton MIT press, 1990	1447	1990
Guidelines on management (diagnosis and treatment) of syncope–update 2004: the Task Force on Syncope, European Society of Cardiology M Brignole, P Alboni, DG Benditt, L Bergfeldt, JJ Blanc, PEB Thomsen, ... European heart journal 25 (22), 2054-2072, 2004	1228	2004
Temporal credit assignment in reinforcement learning RS Sutton University of Massachusetts, Amherst, http://www.incompleteideas.net/papers …, 1984	922	1984
Reinforcement learning with replacing eligibility traces SP Singh, RS Sutton Machine learning 22 (1-3), 123-158, 1996	842	1996
Time-derivative models of Pavlovian reinforcement. RS Sutton, AG Barto Learning and Computational Neuroscience: Foundations of Adaptive Networks …, 1990	729	1990
2018 ESC Guidelines for the diagnosis and management of syncope M Brignole, A Moya, FJ de Lange, JC Deharo, PM Elliott, A Fanciulli, ... European heart journal 39 (21), 1883-1948, 2018	689	2018
A menu of designs for reinforcement learning over time PJ Werbos, WT Miller, RS Sutton Neural networks for control, 67-95, 1990	638	1990
S., Barto A., G.,“ R Sutton Reinforcement Learning, An Introduction, 2000	594*	2000
Predictive representations of state ML Littman, RS Sutton, S Singh Advances in neural information processing systems, 1555-1561, 2002	586	2002
Incremental natural actor-critic algorithms S Bhatnagar, RS Sutton, M Ghavamzadeh, M Lee Advances in neural information processing systems, 2008	585*	2008

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Upload PDF

Follow this author

Cited by

Co-authors