Academia.eduAcademia.edu

Outline

A quantum information retrieval approach to memory

2012, The 2012 International Joint Conference on Neural Networks (IJCNN)

https://doi.org/10.1109/IJCNN.2012.6252492

Abstract

As computers approach the physical limits of information storable in memory, new methods will be needed to further improve information storage and retrieval. We propose a quantum inspired vector based approach, which offers a contextually dependent mapping from the subsymbolic to the symbolic representations of information. If implemented computationally, this approach would provide exceptionally high density of information storage, without the traditionally required physical increase in storage capacity. The approach is inspired by the structure of human memory and incorporates elements of Gärdenfors' Conceptual Space approach and Humphreys et al.'s matrix model of memory. Kitto, K., Bruza, P., & Gabora, L. (2012). A quantum information retrieval approach to memory. Proc International Joint Conf on Neural Networks, (pp. 932-939). June 10-15, Brisbane, Australia, IEEE Computational Intelligence Soc.

References (48)

  1. C. Van Rijsbergen, The Geometry of Information Retrieval. Cambridge University Press, 2004.
  2. D. Widdows, Geometry and Meaning. CSLI Publications, 2004.
  3. D. Song and P. Bruza, "Towards context sensitive information inference," Journal of the American Society for Information Science and Technology, vol. 54, no. 4, pp. 321 -334, 2003.
  4. P. Bruza, D. Widdows, and J. A. Woods, "Quantum Logic of Down Below." in Handbook of Quantum Logic and Quantum Structures, K. Engesser, D. Gabbay, and D. Lehmann, Eds. Elsevier, 2007, vol. 2.
  5. D. Aerts and L. Gabora, "A theory of concepts and their combinations I: the structure of the sets of contexts and properties," Kybernetes, vol. 34, pp. 151-175, 2005.
  6. --, "A theory of concepts and their combinations II: a Hilbert space representation," Kybernetes, vol. 34, pp. 192-221, 2005.
  7. K. Kitto, B. Ramm, P. D. Bruza, and L. Sitbon, "Testing for the non- separability of bi-ambiguous words," in Proceedings of the AAAI Fall Symposium on Quantum Informatics for Cognitive, Social, and Semantic Processes 2010). AAAI Press, 2010.
  8. K. Kitto, B. Ramm, L. Sitbon, and P. D. Bruza, "Quantum theory beyond the physical: information in context," Axiomathes, vol. 21, no. 2, pp. 331-345, 2011.
  9. P. Gärdenfors, Conceptual Spaces: The Geometry of Thought. MIT Press, 2000.
  10. M. Humphreys, J. Bain, and R. Pike, "Different ways to cue a coherent memory system: A theory for episodic, semantic, and procedural tasks," Psychological Review, vol. 96, no. 2, pp. 208-233, 1989.
  11. L. Gabora, "Revenge of the 'neurds': Characterizing creative thought in terms of the structure and dynamics of human memory," Creativity Research Journal, vol. 22, no. 1, pp. 1-13, 2010.
  12. P. Smolensky, "On the proper treatment of connectionism," Behavioral and Brain Sciences, vol. 11, pp. 1-43, 1988.
  13. P. S. Churchland and T. Sejnowski, The computational brain. MIT Press, 1992.
  14. Mikkulainen, "Neural network perspectives on cognition and adaptive robotics," in Natural language processing with subsymbolic neural networks, A. Brown, Ed. Institute of Physics Press, 1997.
  15. A. Roy, "Discovery of concept cells in the human brain -could it change our science?" Natural Intelligence, vol. 1, no. 1, pp. 23-29, 2011.
  16. D. Hubel and T. N. Wiesel, "Receptive fields and functional architecture in two non-striate visual areas (18 and 19) of the cat," Journal of Neurophysiology, vol. 28, pp. 229-289, 1965.
  17. D. Hebb, The organization of behavior. Wiley, 1949.
  18. G. M. Edelman, Neural Darwinism: the theory of neuronal group selection. Oxford University Press, 1989.
  19. D. A. Marr, "Theory of the cerebellar cortex," Journal of Physiology, vol. 202, pp. 437-470, 1969.
  20. L. Gabora, "Cognitive mechanisms underlying the origin and evolution of culture," Ph.D. dissertation, Center Leo Apostel for Interdiciplinary Studies, Vrije Universiteit Brussel, 2001.
  21. L. Gabora and A. Ranjan, "How insight emerges in distributed, content- addressable memory," in The Neuroscience of Creativity, A. Bristol, O. Vartanian, and J. Kaufman, Eds. Oxford University Press, In Press.
  22. J. L. McClelland and D. E. Rumelhart, "A distributed model of memory," in Parallel distributed processing: Explorations in the microstructure of cognition, D. E. Rumelhart, J. L. McClelland, and the PDP research group, Eds. MIT Press, Cambridge, 1986, vol. II.
  23. J. Feldman and D. Ballard, "Connectionist models and their properties," Cognitive Science, vol. 6, pp. 204-254, 1982.
  24. J. Hopfield, "Neural Networks and Physical Systems with Emergent Collective Computational Abilities," Proceedings of the National Academy of Sciences, vol. 79, pp. 2554-2558, 1982.
  25. J. Hopfield, D. I. Feinstein, and R. D. Palmer, "'unlearning' has a stabilizing effect in collective memories," Nature, vol. 304, pp. 159- 160, 1983.
  26. G. M. Edelman, Bright Air, Brilliant Fire: On the Matter of Mind. Basic Books, 1993.
  27. H. M. Paterson, R. I. Kemp, and J. P. Forgas, "Co-witnesses, confeder- ates, and conformity: The effects of discussion and delay on eyewitness memory," Psychiatry, Psychology and Law, vol. 16, no. 1, pp. S112- S124, 2009.
  28. E. F. Loftus, Memory: Surprising new insights Into how we remember and why we forget. Addison-Wesley Pub. Co., 1980.
  29. D. L. Schacter, The seven sins of memory: How the mind forgets and remembers. Houghton Mifflin Co., 2001.
  30. L. Gabora and A. Saab, "Creative interference and states of potentiality in analogy problem solving," in Proceedings of the Annual Meeting of the Cognitive Science Society. Boston MA.: Cognitive Science Society, 2011, pp. 3506-3511.
  31. G. Salton, A. Wong, and C. Yang, "A vector space model for automatic indexing," Communications of the ACM, vol. 18, no. 11, pp. 613-620, 1975.
  32. H. Schütze, "Automatic word sense discrimination," Computational linguistics, vol. 24, no. 1, pp. 97-123, 1998.
  33. M. N. Jones and D. J. K. Mewhort, "Representing Word Meaning and Order Information in a Composite Holographic Lexicon," Psychological Review, vol. 114, no. 1, pp. 1-37, 2007.
  34. M. Sahlgren, A. Holst, and P. Kanerva, "Permutations as a means to encode order in word space," in Proceedings of the 30th Annual Meeting of the Cognitive Science Society, 2008, pp. 11-18.
  35. T. Landauer and S. Dumais, "A solution to plato's problem: the latent semantic analysis theory of acquisition, induction and representation of knowledge," Psychological review, vol. 104, no. 2, pp. 211-240, 1997.
  36. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-791, 1999.
  37. M. Sahlgren, "An introduction to random indexing," in Proceedings of Methods and Applications of Semantic Indexing Workshop at the 7th International Conference on Terminology and Knowledge Engineering, 2005.
  38. P. Bruza and R. Cole, "Quantum Logic of Semantic Space: An Exploratory Investigation of Context Effects in Practical Reasoning," in We Will Show Them: Essays in Honour of Dov Gabbay, S. Artemov, H. Barringer, A. d'Avila Garcez, L. Lamb, and J. Woods, Eds. College Publications, 2005, vol. 1, pp. 339-361.
  39. M. Melucci, "A basis for information retrieval in context," ACM Trans. Inf. Syst., vol. 26, pp. 14:1-14:41, June 2008.
  40. C. J. Isham, Lectures on Quantum Theory. London: Imperial College Press, 1995.
  41. J. Wiles, G. Halford, J. Stewart, M. Humphreys, J. Bain, and W. Wilson, "Tensor Models: A creative basis for memory and analogical mapping," in Artificial Intelligence and Creativity, T. Dartnall, Ed. Kluwer Academic Publishers, 1994, pp. 145-159.
  42. P. Brézillon, "Context in problem solving: a survey," Knowledge Engineering Review, vol. 14, pp. 47-80, May 1999.
  43. R. Guha and J. McCarthy, "Varieties of contexts," in Modeling and Using Context, ser. Lecture Notes in Computer Science, P. Blackburn, C. Ghidini, R. Turner, and F. Giunchiglia, Eds. Springer Berlin / Heidelberg, 2003, vol. 2680, pp. 164-177.
  44. K. Kitto and P. Bruza, "Tests and models of non-compositional con- cepts," in Proceedings: Cognitive Science 2012, Japan, 2012, in Press.
  45. P. Bruza, K. Kitto, B. Ramm, and L. Sitbon, "The non-decomposability of concept combinations," under review.
  46. D. Aerts, J. Broekaert, and L. Gabora, "A case for applying an abstracted quantum formalism to cognition," New Ideas in Psychology, vol. 29, no. 1, pp. 136-146, 2011.
  47. S. Aerts, K. Kitto, and L. Sitbon, "Similarity metrics within a point of view," in Quantum Interaction 5th International Symposium, QI 2011, Aberdeen, UK, June 26-29, 2011, Revised Selected Papers, ser. LNCS, D. Song, M. Melucci, and et al., Eds., vol. 7052. Springer, 2011, pp. 13-24.
  48. A. Tversky and I. Gati, "Similarity, separability, and the triangle in- equality." Psychological Review, vol. 89, no. 2, pp. 123-54, 1982.