Richard S. Sutton

Cited by

	All	Since 2016
Citations	97588	41746
h-index	92	57
i10-index	279	173

13000

6500

3250

9750

198919901991199219931994199519961997199819992000200120022003200420052006200720082009201020112012201320142015201620172018201920202021274 406 532 881 603 846 780 914 942 998 1143 1156 1353 1665 1832 2095 2542 2786 3156 3168 3349 3458 3673 3655 3824 4050 3838 4296 5230 7748 9860 12001 2577

New!

Public access

View all

47 articles

3 articles

available

not available

Based on funding mandates

Co-authors

Andrew BartoUniversity of Massachusetts AmherstVerified email at cs.umass.edu
Satinder SinghComputer Science and Engineering, University of MichiganVerified email at umich.edu
Doina PrecupDeepMind and McGill UniversityVerified email at cs.mcgill.ca
Patrick M. PilarskiDeepMind, Amii, and University of AlbertaVerified email at ualberta.ca
Charles Andersonprofessor of computer science, Colorado State University. Founder Pattern Exploration, LLC.Verified email at colostate.edu
Csaba SzepesvariDeepMind & Department of Computing Science, University of AlbertaVerified email at cs.ualberta.ca
Shalabh BhatnagarProfessor in the Department of Computer Science and Automation, Indian Institute of ScienceVerified email at iisc.ac.in
Adam WhiteUniversity of Alberta, DeepmindVerified email at ualberta.ca
Hamid MaeiCruise AutomationVerified email at getcruise.com
Thomas DegrisDeepMindVerified email at google.com
A. Rupam MahmoodAmii, University of AlbertaVerified email at ualberta.ca
David SilverGoogle DeepMindVerified email at google.com
Joseph ModayilComputing Science, University of AlbertaVerified email at cs.ualberta.ca
Elliot A. LudvigProfessor, Psychology, University of WarwickVerified email at warwick.ac.uk
Martha WhiteUniversity of AlbertaVerified email at ualberta.ca
E James KehoeProfessor of Psychology, University of New South WalesVerified email at unsw.edu.au
David McAllesterProfessor, Toyota Technological Institute at ChicagoVerified email at ttic.edu
Peter StoneProfessor of Computer Science, The University of Texas at AustinVerified email at cs.utexas.edu
Mohammad GhavamzadehGoogle ResearchVerified email at google.com
Michael LittmanBrown UniversityVerified email at brown.edu

Richard S. Sutton

DeepMind, Amii, and University of Alberta

Verified email at richsutton.com - Homepage

artificial intelligence reinforcement learning machine learning cognitive science computer science


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Reinforcement learning: An Introduction, 2nd edition RS Sutton, AG Barto MIT press, 2018	42282	2018
Learning to predict by the methods of temporal differences RS Sutton Machine learning 3 (1), 9-44, 1988	6158	1988
Neuronlike adaptive elements that can solve difficult learning control problems AG Barto, RS Sutton, CW Anderson IEEE transactions on systems, man, and cybernetics 13 (5), 834-846, 1983	4115	1983
Policy gradient methods for reinforcement learning with function approximation. RS Sutton, DA McAllester, SP Singh, Y Mansour NIPs 99, 1057-1063, 1999	4103	1999
Reinforcement learning: An Introduction, 1st edition RS Sutton, AG Barto MIT press, 1998	3777*	1998
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning RS Sutton, D Precup, S Singh Artificial intelligence 112 (1-2), 181-211, 1999	2784	1999
Integrated architectures for learning, planning, and reacting based on approximating dynamic programming RS Sutton Proceedings of the International Conference on Machine Learning, 216-224, 1990	1701	1990
Toward a modern theory of adaptive networks: Expectation and prediction. RS Sutton, AG Barto Psychological review 88 (2), 135, 1981	1613	1981
Generalization in reinforcement learning: Successful examples using sparse coarse coding RS Sutton Advances in neural information processing systems, 1038-1044, 1996	1530	1996
Neural networks for control WT Miller, PJ Werbos, RS Sutton MIT press, 1990	1444	1990
Guidelines on management (diagnosis and treatment) of syncope–update 2004: the Task Force on Syncope, European Society of Cardiology M Brignole, P Alboni, DG Benditt, L Bergfeldt, JJ Blanc, PEB Thomsen, ... European heart journal 25 (22), 2054-2072, 2004	1227	2004
Temporal credit assignment in reinforcement learning RS Sutton University of Massachusetts, Amherst, http://www.incompleteideas.net/papers …, 1984	924	1984
Reinforcement learning with replacing eligibility traces SP Singh, RS Sutton Machine learning 22 (1), 123-158, 1996	860	1996
Time-derivative models of Pavlovian reinforcement. RS Sutton, AG Barto Learning and Computational Neuroscience: Foundations of Adaptive Networks …, 1990	734	1990
A menu of designs for reinforcement learning over time PJ Werbos, WT Miller, RS Sutton Neural networks for control, 67-95, 1990	643	1990
A bradford book RS Sutton, AG Barto Reinforcement learning: An introduction, 1998	612	1998
Incremental natural actor-critic algorithms S Bhatnagar, RS Sutton, M Ghavamzadeh, M Lee Advances in neural information processing systems, 2008	598*	2008
Predictive representations of state ML Littman, RS Sutton, S Singh Advances in neural information processing systems, 1555-1561, 2002	594	2002
Dyna, an integrated architecture for learning, planning, and reacting RS Sutton ACM Sigart Bulletin 2 (4), 160-163, 1991	592	1991
Learning and sequential decision making AG Barto, RS Sutton, CJCH Watkins Learning and Computational Neuroscience: Foundations of Adaptive Networks, 1990	575	1990

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Upload PDF

Follow this author

Cited by

Co-authors