Academia.eduAcademia.edu

Outline

Multi-entity bayesian networks without multi-tears

2005, Draft Version

Abstract

An introduction is provided to Multi-Entity Bayesian Networks (MEBN), a logic system that integrates First Order Logic (FOL) with Bayesian probability theory. MEBN extends ordinary Bayesian networks to allow representation of graphical models with repeated sub-structures. Knowledge is encoded as a collection of Bayesian network fragments (MFrags) that can be instantiated and combined to form highly complex situation-specific Bayesian networks. A MEBN theory (MTheory) implicitly represents a joint probability distribution over possibly unbounded numbers of hypotheses, and uses Bayesian learning to refine a knowledge base as observations accrue. MEBN provides a logical foundation for the emerging collection of highly expressive probability-based languages. A running example illustrates the representation and reasoning power of the MEBN formalism.

References (42)

  1. Bangsø, O., & Wuillemin, P.-H. (2000). Object Oriented Bayesian Networks: A Framework for Topdown Specification of Large Bayesian Networks and Repetitive Structures (No. CIT-87.2-00-obphw1): Department of Computer Science, Aalborg University.
  2. Baum, L. E., & Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. Annals of Mathematical Statistics, 37, 1554-1563.
  3. Binford, T., Levitt, T. S., & Mann, W. B. (1987). Bayesian Inference in Model-Based Machine Vision. In a. P. C. C. T. S. Levitt (Ed.), Uncertainty in Artificial Intelligence: Proceedings of the Third Workshop. Seattle, WA.
  4. Buntine, W. L. (1994a). Learning with Graphical Models (Technical Report No. FIA-94-03): NASA Ames Research Center, Artificial Intelligence Research Branch.
  5. Buntine, W. L. (1994b). Operations for Learning with Graphical Models. Journal of Artificial Intelligence Research, 2, 159-225.
  6. Charniak, E. (1991). Bayesian Networks Without Tears. AI Magazine, 12, 50-63.
  7. Charniak, E., & Goldman, R. P. (1989a). Plan recognition in stories and in life. Paper presented at the Fifth Workshop on Uncertainty in Artificial Intelligence, Mountain View, California.
  8. Charniak, E., & Goldman, R. P. (1989b, August 1989). A semantics for probabilistic quantifier-free first-order languages with particular application to story understanding. Paper presented at the Eleventh International Joint Conference on Artificial Intelligence, Detroit, Michigan.
  9. Codd, E. F. (1970). A relational model for large shared data banks. Communications of the ACM, 13(6), 377- 387.
  10. Cooper, G. F., & Herskovits, E. (1992). A Bayesian Method for the Induction of Probabilistic Networks from Data. Machine Learning, 9, 309-347.
  11. Druzdzel, M. J., & Simon, H., A. (1993). Causality in Bayesian belief networks. Paper presented at the Ninth Annual Conference on Uncertainty in Artificial Intelligence (UAI-93), San Francisco, CA.
  12. Elliott, R. J., Aggoun, L., & Moore, J. B. (1995). Hidden Markov Models: Estimation and Control. New York, New York: Springer-Verlag.
  13. Friedman, N., & Koller, D. (2000). Being Bayesian about network structure. Paper presented at the Sixteenth Conference on Uncertainty in Artificial Intelligence, San Mateo, California.
  14. Fung, F., Laskey, K. B., Pool, M., Takikawa, M., & Wright, E. J. (2004). PLASMA: combining predicate logic and probability for information fusion and decision support. Paper presented at the AAAI Spring Symposium, Stanford, CA.
  15. Getoor, L., Friedman, N., Koller, D., & Pfeffer, A. (2001). Learning Probabilistic Relational Models. New York, New York: Springer-Verlag.
  16. Getoor, L., Koller, D., Taskar, B., & Friedman, N. (2000). Learning probabilistic relational models with structural uncertainty. Paper presented at the ICML-2000 Workshop on Attribute-Value and Relational Learning:Crossing the Boundaries, Standford, California.
  17. Gilks, W., Thomas, A., & Spiegelhalter, D. J. (1994). A language and program for complex Bayesian modeling. The Statistician, 43, 169-178.
  18. Hansson, O., & Mayer, A. (1989, August, 1989). Heuristic search as evidential reasoning. Paper presented at the Fifth Workshop on Uncertainty in Artificial Intelligence, Windsor, Ontario.
  19. Heckerman, D. (1990). Probabilistic Similarity Networks. Unpublished Ph.D. Thesis, Stanford University, Stanford, CA.
  20. Heckerman, D., Geiger, D., & Chickering, D. M. (1995a). Learning Bayesian Networks: The Combination of Knowledge and Statistical Data. Machine Learning(20), 197-243.
  21. Heckerman, D., Mamdani, A., & Wellman, M. P. (1995b). Real-world application of Bayesian networks. Communications of the ACM, 38(3), 24-68.
  22. Heckerman, D., Meek, C., & Koller, D. (2004). Probabilistic models for relational data. Redmond, WA: Microsoft Corporation.
  23. Jensen, F. V. (1996). An Introduction to Bayesian Networks. New York: Springer-Verlag.
  24. Jensen, F. V. (2001). Bayesian Networks and Decision Graphs (2001 ed.). New York: Springer-Verlag.
  25. Jordan, M. I., (Ed.). (1999). Learning in Graphical Models. Cambridge, MA: MIT Press.
  26. Koller, D., & Pfeffer, A. (1997). Object-Oriented Bayesian Networks. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Thirteenth Conference, San Francisco, CA.
  27. Langseth, H., & Nielsen, T. (2003). Fusion of Domain Knowledge with Data for Structured Learning in Object- Oriented Domains. Journal of Machine Learning Research.
  28. Laskey, K. B. (2005, March 15, 2005). First-order Bayesian logic. Retrieved Mar 3, 2005, from http://ite.gmu.edu/~klaskey/publications.html
  29. Lauritzen, S., & Spiegelhalter, D. J. (1988). Local computation and probabilities on graphical structures and their applications to expert systems. Journal of Royal Statistical Society, 50(2), 157-224.
  30. Mahoney, S. M., & Laskey, K. B. (1998). Constructing situation specific networks. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Fourteenth Conference, San Mateo, CA.
  31. Murphy, K. (1998). Dynamic Bayesian networks: representation, inference and learning. Unpublished Doctoral Dissertation, University of California, Berkeley.
  32. Neapolitan, R. E. (1990). Probabilistic Reasoning in Expert Systems: Theory and Algorithms. New York: John Wiley and Sons, Inc.
  33. Oliver, R. M., & Smith, J. Q. (1990). Influence Diagrams, Belief Nets and Decision Analisys (1st ed.). New York, NY: John Willey & Sons Inc.
  34. Pearl, J. (1988). Probabilistic reasoning in intelligent systems: networks of plausible inference. San Mateo, CA: Morgan Kaufmann Publishers.
  35. Pearl, J. (2000). Causality: models, reasoning, and inference. Cambridge, U.K.: Cambridge University Press.
  36. Pfeffer, A. (2001). IBAL: A Probabilistic Rational Programming Language International. Paper presented at the Joint Conference on Artificial Intelligence (IJCAI).
  37. Pfeffer, A., Koller, D., Milch, B., & Takusagawa, K. T. (1999). SPOOK: A system for probabilistic object- oriented knowledge representation. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Fifteenth Conference, San Mateo, CA.
  38. Rabiner, L. R. (1989, February 1989). A tutorial on hidden Markov models and selected applications in speech recognition. Paper presented at the IEEE.
  39. Sowa, J. F. (2000). Knowledge representation: logical, philosophical, and computational foundations. Pacific Grove: Brooks/Cole.
  40. Spiegelhalter, D. J., Thomas, A., & Best, N. (1996). Computation on Graphical Models. Bayesian Statistics, 5, 407-425.
  41. Stone, L. D., Barlow, C. A., & Corwin, T. L. (1999). Bayesian multiple target tracking. Boston, MA: Artech House.
  42. Takikawa, M., d'Ambrosio, B., & Wright, E. (2002). Real- time inference with large-scale temporal Bayes nets. Paper presented at the Uncertainty in Artificial Intelligence.