Multi-entity bayesian networks without multi-tears
2005, Draft Version
Abstract
An introduction is provided to Multi-Entity Bayesian Networks (MEBN), a logic system that integrates First Order Logic (FOL) with Bayesian probability theory. MEBN extends ordinary Bayesian networks to allow representation of graphical models with repeated sub-structures. Knowledge is encoded as a collection of Bayesian network fragments (MFrags) that can be instantiated and combined to form highly complex situation-specific Bayesian networks. A MEBN theory (MTheory) implicitly represents a joint probability distribution over possibly unbounded numbers of hypotheses, and uses Bayesian learning to refine a knowledge base as observations accrue. MEBN provides a logical foundation for the emerging collection of highly expressive probability-based languages. A running example illustrates the representation and reasoning power of the MEBN formalism.
References (42)
- Bangsø, O., & Wuillemin, P.-H. (2000). Object Oriented Bayesian Networks: A Framework for Topdown Specification of Large Bayesian Networks and Repetitive Structures (No. CIT-87.2-00-obphw1): Department of Computer Science, Aalborg University.
- Baum, L. E., & Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. Annals of Mathematical Statistics, 37, 1554-1563.
- Binford, T., Levitt, T. S., & Mann, W. B. (1987). Bayesian Inference in Model-Based Machine Vision. In a. P. C. C. T. S. Levitt (Ed.), Uncertainty in Artificial Intelligence: Proceedings of the Third Workshop. Seattle, WA.
- Buntine, W. L. (1994a). Learning with Graphical Models (Technical Report No. FIA-94-03): NASA Ames Research Center, Artificial Intelligence Research Branch.
- Buntine, W. L. (1994b). Operations for Learning with Graphical Models. Journal of Artificial Intelligence Research, 2, 159-225.
- Charniak, E. (1991). Bayesian Networks Without Tears. AI Magazine, 12, 50-63.
- Charniak, E., & Goldman, R. P. (1989a). Plan recognition in stories and in life. Paper presented at the Fifth Workshop on Uncertainty in Artificial Intelligence, Mountain View, California.
- Charniak, E., & Goldman, R. P. (1989b, August 1989). A semantics for probabilistic quantifier-free first-order languages with particular application to story understanding. Paper presented at the Eleventh International Joint Conference on Artificial Intelligence, Detroit, Michigan.
- Codd, E. F. (1970). A relational model for large shared data banks. Communications of the ACM, 13(6), 377- 387.
- Cooper, G. F., & Herskovits, E. (1992). A Bayesian Method for the Induction of Probabilistic Networks from Data. Machine Learning, 9, 309-347.
- Druzdzel, M. J., & Simon, H., A. (1993). Causality in Bayesian belief networks. Paper presented at the Ninth Annual Conference on Uncertainty in Artificial Intelligence (UAI-93), San Francisco, CA.
- Elliott, R. J., Aggoun, L., & Moore, J. B. (1995). Hidden Markov Models: Estimation and Control. New York, New York: Springer-Verlag.
- Friedman, N., & Koller, D. (2000). Being Bayesian about network structure. Paper presented at the Sixteenth Conference on Uncertainty in Artificial Intelligence, San Mateo, California.
- Fung, F., Laskey, K. B., Pool, M., Takikawa, M., & Wright, E. J. (2004). PLASMA: combining predicate logic and probability for information fusion and decision support. Paper presented at the AAAI Spring Symposium, Stanford, CA.
- Getoor, L., Friedman, N., Koller, D., & Pfeffer, A. (2001). Learning Probabilistic Relational Models. New York, New York: Springer-Verlag.
- Getoor, L., Koller, D., Taskar, B., & Friedman, N. (2000). Learning probabilistic relational models with structural uncertainty. Paper presented at the ICML-2000 Workshop on Attribute-Value and Relational Learning:Crossing the Boundaries, Standford, California.
- Gilks, W., Thomas, A., & Spiegelhalter, D. J. (1994). A language and program for complex Bayesian modeling. The Statistician, 43, 169-178.
- Hansson, O., & Mayer, A. (1989, August, 1989). Heuristic search as evidential reasoning. Paper presented at the Fifth Workshop on Uncertainty in Artificial Intelligence, Windsor, Ontario.
- Heckerman, D. (1990). Probabilistic Similarity Networks. Unpublished Ph.D. Thesis, Stanford University, Stanford, CA.
- Heckerman, D., Geiger, D., & Chickering, D. M. (1995a). Learning Bayesian Networks: The Combination of Knowledge and Statistical Data. Machine Learning(20), 197-243.
- Heckerman, D., Mamdani, A., & Wellman, M. P. (1995b). Real-world application of Bayesian networks. Communications of the ACM, 38(3), 24-68.
- Heckerman, D., Meek, C., & Koller, D. (2004). Probabilistic models for relational data. Redmond, WA: Microsoft Corporation.
- Jensen, F. V. (1996). An Introduction to Bayesian Networks. New York: Springer-Verlag.
- Jensen, F. V. (2001). Bayesian Networks and Decision Graphs (2001 ed.). New York: Springer-Verlag.
- Jordan, M. I., (Ed.). (1999). Learning in Graphical Models. Cambridge, MA: MIT Press.
- Koller, D., & Pfeffer, A. (1997). Object-Oriented Bayesian Networks. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Thirteenth Conference, San Francisco, CA.
- Langseth, H., & Nielsen, T. (2003). Fusion of Domain Knowledge with Data for Structured Learning in Object- Oriented Domains. Journal of Machine Learning Research.
- Laskey, K. B. (2005, March 15, 2005). First-order Bayesian logic. Retrieved Mar 3, 2005, from http://ite.gmu.edu/~klaskey/publications.html
- Lauritzen, S., & Spiegelhalter, D. J. (1988). Local computation and probabilities on graphical structures and their applications to expert systems. Journal of Royal Statistical Society, 50(2), 157-224.
- Mahoney, S. M., & Laskey, K. B. (1998). Constructing situation specific networks. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Fourteenth Conference, San Mateo, CA.
- Murphy, K. (1998). Dynamic Bayesian networks: representation, inference and learning. Unpublished Doctoral Dissertation, University of California, Berkeley.
- Neapolitan, R. E. (1990). Probabilistic Reasoning in Expert Systems: Theory and Algorithms. New York: John Wiley and Sons, Inc.
- Oliver, R. M., & Smith, J. Q. (1990). Influence Diagrams, Belief Nets and Decision Analisys (1st ed.). New York, NY: John Willey & Sons Inc.
- Pearl, J. (1988). Probabilistic reasoning in intelligent systems: networks of plausible inference. San Mateo, CA: Morgan Kaufmann Publishers.
- Pearl, J. (2000). Causality: models, reasoning, and inference. Cambridge, U.K.: Cambridge University Press.
- Pfeffer, A. (2001). IBAL: A Probabilistic Rational Programming Language International. Paper presented at the Joint Conference on Artificial Intelligence (IJCAI).
- Pfeffer, A., Koller, D., Milch, B., & Takusagawa, K. T. (1999). SPOOK: A system for probabilistic object- oriented knowledge representation. Paper presented at the Uncertainty in Artificial Intelligence: Proceedings of the Fifteenth Conference, San Mateo, CA.
- Rabiner, L. R. (1989, February 1989). A tutorial on hidden Markov models and selected applications in speech recognition. Paper presented at the IEEE.
- Sowa, J. F. (2000). Knowledge representation: logical, philosophical, and computational foundations. Pacific Grove: Brooks/Cole.
- Spiegelhalter, D. J., Thomas, A., & Best, N. (1996). Computation on Graphical Models. Bayesian Statistics, 5, 407-425.
- Stone, L. D., Barlow, C. A., & Corwin, T. L. (1999). Bayesian multiple target tracking. Boston, MA: Artech House.
- Takikawa, M., d'Ambrosio, B., & Wright, E. (2002). Real- time inference with large-scale temporal Bayes nets. Paper presented at the Uncertainty in Artificial Intelligence.