Case-Based Reasoning, Social Dilemmas, and a New Equilibrium Concept
2004, The Journal of Artificial Societies and Social Simulation
Abstract
In this paper social dilemmas are modelled as n-player games. Orthodox game theorists have been able to provide several concepts that narrow the set of expected outcomes in these models. However, in their search for a reduced set of solutions, they had to pay a very high price: they had to make disturbing assumptions such as instrumental rationality or common knowledge of rationality, which are rarely observed in any real-world situation. We propose a complementary approach, assuming that people adapt their behaviour according to their experience and look for outcomes that have proved to be satisfactory in the past. These ideas are investigated by conducting several experiments with an agent-based simulation model in which agents use a simple form of case-based reasoning. It is shown that cooperation can emerge from the interaction of selfish case-based reasoners. In determining how often cooperation occurs, aspiration thresholds, the agents' representation of the world, and their memory all play an important and interdependent role. It is also argued that case-based reasoners with high enough aspiration thresholds are not systemically exploitable, and that if agents were sophisticated enough to infer that other players are not exploitable either, they would eventually cooperate.
References (54)
- AAMODT A and Plaza E (1994) Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches. AI Communications. IOS Press, Vol. 7, no. 1, pp. 39-59.
- AUMANN R (1976) Agreeing to disagree. Annals of Statistics, no. 4, pp. 1236-1239.
- AXELROD R (1984) The Evolution of Cooperation. Basic Books, USA.
- BENDOR J, Diermeier D and Ting M (2003) The Predictive Power of Learning Models in Social Dilemma Research. Working Paper, Stanford University.
- BRENAN G and Lomasky L (1984) Inefficient Unanimity. Journal of Applied Philosophy, 1, pp. 151-163.
- CAMERER C F (2003) Behavioral Game Theory: Experiments in Strategic Interaction. Princeton University Press.
- CHAVALARIAS D (2003) Human's Meta-cognitive Capacities and Endogenization of Mimetic Rules in Multi-Agents Models. Presented at the First Conference of the European Social Simulation Association, Groningen, The Netherlands, 18-21/9/03. Conference proceedings available online. COLLINS (2000) The Collins English Dictionary. HarperCollins Publishers.
- COLMAN A M (1995) Game Theory and its Applications in the Social and Biological Sciences. 2nd edition. Butterworth-Heinemann, Oxford, UK.
- COLMAN A M (2003) Cooperation, psychological game theory, and limitations of rationality in social interaction. The Behavioral and Brain Sciences, 26, pp. 139-153.
- CONTE R and Paolucci M (2001) Intelligent social learning. JASSS -the Journal of Artificial Societies and Social Simulation, Vol. 4, no. 1. Website publication as at 9th March 2004: http://jasss.soc.surrey.ac.uk/4/1/3.html COPI I M (1986) Introduction to Logic. Seventh Edition. Macmillan, New York.
- DAWES R M (1980) Social Dilemmas. Annual Review of Psychology, pp. 161-193.
- DIEKMANN A (1985) Volunteer's Dilemma. Journal of Conflict Resolution, 29, pp. 605-610.
- DIEKMANN A (1986) Volunteer's Dilemma. A Social Trap without a Dominant Strategy and some Empirical Results. In Diekmann A and Mitter P (Eds.), Paradoxical Effects of Social Behavior - Essays in Honor of Anatol Rapoport, pp. 187-197. Heidelberg: Physica.
- DORAN J (1997) Analogical Problem Solving. In: Bundy A (Ed.) Artificial Intelligence Techniques: A Comprehensive Catalogue. Springer-Verlag, fourth revised edition, p. 4.
- EREV I and Roth A E (1998) Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria. American Economic Review, 88, 4, pp. 848-881.
- FLACHE A and Macy M W (2002) Stochastic Collusion and the Power Law of Learning. Journal of Conflict Resolution, Vol. 46, no. 5, pp. 629-653.
- Luis R. Izquierdo, Nicholas M. Gotts and J. Gary Polhill: Case-Based ... http://jasss.soc.surrey.ac.uk/7/3/1.html 27 of 30 22/07/2014 21:19
- FUDENBERG D and Levine D (1998) The Theory of Learning in Games. MIT Press, Cambridge, MA. GIBBONS R (1992) A Primer in Game Theory. FT Prentice Hall, Harlow (England).
- GILBOA I and Schmeidler D (1995) Case-Based Decision Theory. The Quarterly Journal of Economics, 110, pp. 605-639.
- GILBOA I and Schmeidler D (2001) A Theory of Case-Based Decisions. Cambridge University Press, Cambridge, UK.
- GOTTS N M, Polhill J G and Law A N R (2003) Agent-Based Simulation in the Study of Social Dilemmas. Artificial Intelligence Review, 19, pp. 3-92.
- HARDIN G (1968) The Tragedy of the Commons. Science, 162, pp. 1243-1248.
- IZQUIERDO L R, Gotts N M and Polhill J G (2003) Case-Based Reasoning and Social Dilemmas: an Agent-Based Simulation. Presented at the First Conference of the European Social Simulation Association, Groningen, The Netherlands, 18-21/9/03. Conference proceedings available online.
- KAHNEMANN D, Slovic P and Tversky A (Eds.) (1982) Judgement Under Uncertainty: Heuristics and Biases. Cambridge University Press.
- KLEIN G A and Calderwood R (1988) How Do People Use Analogues to Make Decisions?. In: Kolodner J L, (Ed.) Proceedings of the DARPA Case-Based Reasoning Workshop, Morgan Kaufmann, Calif., US.
- KREPS D, Milgrom P, Roberts J and Wilson R (1982) Rational Cooperation in the Finitely Repeated Prisoners' Dilemma. Journal of Economic Theory, 27, pp. 245-252.
- KUHN S (2001) Prisoner's Dilemma. The Stanford Encyclopedia of Philosophy (Winter 2001
- Edition), Edward N Zalta (Ed.). Website publication as at 9th March 2004: http://plato.stanford.edu /archives/win2001/entries/prisoner-dilemma/
- LEDYARD J O (1995) Public Goods: A Survey of Experimental Research. In Kagel J H, and Roth A E (Eds.), The Handbook of Experimental Economics. Princeton University Press.
- LOUI R (1999) Case-Based Reasoning and Analogy. The MIT Encyclopedia of the Cognitive Sciences, Wilson R A and Keil F C (Eds.), pp. 99-101.
- LUCE D and Raiffa H (1957) Games and Decisions. New York: Wiley.
- MACY M W (1990) Learning Theory and the Logic of Critical Mass. American Sociological Review, Vol. 55, pp. 809-26.
- MACY M W (1991) Learning to Cooperate: Stochastic and Tacit Collusion in Social Exchange. American Journal of Sociology, Vol. 97, pp. 808-43.
- MACY M W (1995) PAVLOV and the Evolution of Cooperation. An Experimental Test. Social Psychology Quarterly, Vol. 58, No 2, pp. 74-87.
- MACY M W (1998) Social Order in Artificial Worlds. JASSS -the Journal of Artificial Societies and Social Simulation vol. 1, no. 1. Website publication as at 9th March 2004: http://jasss.soc.surrey.ac.uk/1/1/4.html MACY M W and Flache A (2002) Learning Dynamics in Social Dilemmas. Proceedings of the National Academy of Sciences, vol. 99, Suppl. 3, pp. 7229-7236
- Luis R. Izquierdo, Nicholas M. Gotts and J. Gary Polhill: Case-Based ... http://jasss.soc.surrey.ac.uk/7/3/1.html
- NASH J (1951) Non-cooperative Games. Annals of Mathematics, 54, pp. 285-295.
- NICOLOV N (1997) Case-based Reasoning. In: Bundy A (Ed.) Artificial Intelligence Techniques: A Comprehensive Catalogue. Springer-Verlag, fourth revised edition, 1997, pp.13-14.
- NOWAK M A and May R M (1992) Evolutionary Chaos and Spatial Games. Nature, 359, pp. 826-829.
- RAUB W (1988) An Analysis of the Finitely Repeated Prisoners' Dilemma. European Journal of Political Economy, 4 (3), pp. 367-380.
- RAUB W and Voss T (1986) Conditions for Cooperation in Problematic Social Situations. In Diekmann A and Mitter P (Eds.), Paradoxical Effects of Social Behavior -Essays in Honor of Anatol Rapoport, pp. 85-103. Heidelberg: Physica.
- REISBERG D (1999) Learning. The MIT Encyclopedia of the Cognitive Sciences, Wilson R A and Keil F C (Eds.), pp. 460-461.
- ROSS B (1989) Some Psychological Results on Case-based Reasoning. In Hammond, K (Ed.), Proceedings of the Case-Based Reasoning Workshop, pp. 144-147 San Mateo. DARPA, Morgan Kaufmann, Inc.
- ROTH A E (1995) Introduction to Experimental Economics. In: Kagel J H and Roth A E (Eds.), The Handbook of Experimental Economics. Princeton University Press.
- ROTH A E and Erev I (1995) Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term. Games and Economic Behavior, Special Issue: Nobel Symposium, vol. 8, pp.164-212.
- SALMON M (1984) Introduction to Logic and Critical Thinking. Harcourt Brace Jovanovich.
- SCHANK R (1982) Dynamic Memory: a Theory of Reminding and Learning in Computers and People. Cambridge University Press, Cambridge, UK.
- SCHANK R and Abelson R P (1977) Scripts, Plans, Goals and Understanding. Lawrence Erlbaum Associates, Hillsdale, New Jersey.
- SIMON H A (1957) Models of Man: Social and Rational; Mathematical Essays on Rational Human Behavior in a Social Setting, John Wiley and Sons, New York.
- VAN DAMME E (1987) Stability and Perfection of Nash Equilibria. Springer Verlag, Berlin (2nd ed. 1991).
- VANDERSCHRAAF P (2002) Common Knowledge. The Stanford Encyclopedia of Philosophy (Summer 2002 Edition), Edward N Zalta (ed.). Website publication as at 9th March 2004: http://plato.stanford.edu/archives/sum2002/entries/common-knowledge/
- WATSON I (1997) Applying Case-Based Reasoning: Techniques for Enterprise Systems. Morgan Kaufman Publishers.
- WEIBULL J W (1995) Evolutionary Game Theory. MIT Press.
- WEIBULL J W (1998) Evolution, Rationality and Equilibrium in Games. European Economic Review, 42, pp. 641-649. Return to Contents of this issue Luis R. Izquierdo, Nicholas M. Gotts and J. Gary Polhill: Case-Based ... http://jasss.soc.surrey.ac.uk/7/3/1.html 29 of 30 22/07/2014 21:19