Academia.eduAcademia.edu

Outline

Double Deep Machine Learning

2017, arXiv (Cornell University)

Abstract

Very important breakthroughs in data-centric deep-learning algorithms led to impressive performance in 'transactional' point applications of Artificial Intelligence (AI) such as Face Recognition, or EKG classification. With all due appreciation, however, 'knowledge-blind' data-only machine learning algorithms have severe limitations for nontransactional AI applications, such as medical diagnosis beyond the EKG results. Such applications require deeper and broader knowledge in their problem-solving capabilities, e.g. integrating anatomy and physiology knowledge with EKG results and other patient's findings. Following a review and illustrations of such limitations for several real-life AI applications, we point at ways to overcome them. The proposed Wikipedia for Smart Machines initiative aims at building repositories of software structures that represent humanity's science & technology knowledge in various parts of life; knowledge that we all learn in schools, universities and during our professional life. Target readers for these repositories are smart machines; not human. AI software developers will have these Reusable Knowledge structures readily available, hence, the proposed name ReKopedia. Big Data is by now a mature technology, it is time to focus on 'Big Knowledge'. Some will be derived from data, some will be obtained from mankind's gigantic repository of knowledge. Wikipedia for smart machines along with the new Double Deep Learning approach offer a paradigm for integrating data-centric deep learning algorithms with algorithms that leverage deep knowledge, e.g. evidential reasoning and causality reasoning. The resulting synergies establish broader and deeper foundations that will enable us to scale faster the AI field. For illustration, a project is described to produce ReKopedia knowledge modules for medical diagnosis of about 1,000 disorders. We are now in the second AI 'spring' after a long AI 'winter'. To avoid sliding again into an AI winter, it is essential that we rebalance the roles of data and knowledge. Data is important, but knowledge-deep, basic, and commonsense-is equally important.

FAQs

sparkles

AI

What are the limitations of Deep Learning for non-transactional applications?add

The paper reveals that Deep Learning struggles with broader reasoning for tasks like medical diagnosis, requiring deeper knowledge integration. Its algorithms, termed 'knowledge-blind', are limited to correlation rather than causation, hindering effective problem-solving.

How does the Double Deep Learning approach enhance AI performance?add

The proposed approach integrates data-centric techniques with machine-teaching, enabling algorithms to utilize extensive human knowledge. This dual approach aims to enrich reasoning capacities, addressing knowledge gaps that traditional DL methods face.

What potential impact could the ReKopedia initiative have on AI development?add

ReKopedia proposes a shared knowledge repository for smart machines, significantly aiding the development of AI applications. Its framework aims to combine prior knowledge with real-time data, potentially elevating AI capabilities in diverse fields.

How do glaring mistakes in AI systems affect their credibility?add

The study indicates that glaring mistakes, even with high overall accuracy, erode user trust in AI, particularly in critical areas like military defense. Implementing sanity checks is suggested to minimize such errors and enhance system reliability.

What role does cause and effect reasoning play in machine learning?add

The paper emphasizes the challenge of teaching algorithms cause and effect relationships solely through data, noting inherent limitations. Building explicit knowledge modules can facilitate understanding beyond mere correlation, essential for domains requiring deeper analytical skills.

References (19)

  1. Bareinboim E., Pearl J., Transportability from multiple environments with limited experiments: Completeness results, Advances in Neural Information Processing Systems 27 (NIPS 2014), eds Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger K, https://papers.nips.cc/book/advances-in-neural-information-processing-systems-27-2014.
  2. Ben-Bassat M., Carlson R.W., Puri V.K., Davenport M. D., Schriver J. A, Latif M., Smith R., Portigal L. D., Lipnick E. and WeiI M. H., Pattern-Based Interactive Diagnosis of Multiple Disorders: The MEDAS System. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-2, No.2:148-160, March 1980
  3. Ben-Bassat, M., Expert Systems for Clinical Diagnosis, In Approximate Reasoning in Expert Systems. M.M. Gupta, A. Kandel, W. Bandler, Y.s. Kiszka (eds.), North Holland, 1985, pp.671-687.
  4. Ben-Bassat, M., Campbell D., Weil, M. H., Evaluating Multimembership Classifiers: A Methodology and Application to The MEDAS Diagnostic System, IEEE Transactions Pattern Analysis and Machine Intelligence, Vol. PAMI-5, No.2, 225-229, 1983
  5. Ben-Bassat M. Use of Diagnostic Expert Systems in Aircarft Maintenance (9 real life examples), Proceedings of Aircraft Maintenance and Engineering Conference, 1996, Singapore
  6. Ben-Bassat M., I Beniaminy, I., Joseph, D. Combining model-based and case-based expert systems, Research Perspectives and Case Studies in System Test and Diagnosis, 179-205, 1998
  7. Ben-Bassat M., Klove K.L. and Weil M.H., Sensitivity Analysis in Bayesian Classification Models: Multiplicative Deviations, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-2. No.3 261-266 1980
  8. Ben-Bassat M., Freedy A. Knowledge Requirements and Management in Expert Decision Support Systems for (Military) Situation Assessment, IEEE Transactions on Systems, Man, and Cybernetics, Vol. SMC-12, No.4: 479-490,1982
  9. Brynjolfsson E. and Mcafee A. The Business of Artificial Intelligence, Harvard Business Review, July 2017
  10. Dietterich and Horvitz, E. J. Rise of Concerns about AI: Reflections and Directions, Communications of the ACM, Volume 58, Oct 2015, 38-40
  11. Gunning, D. Explainable Artificial Intelligence (XAI), http://www.cc.gatech.edu/~alanwags/DLAI2016/(Gunning)%20IJCAI- 16%20DLAI%20WS.pdf
  12. Georgakis, D. C. Trace, D.A. Naeymi-Rad, F. and Evans. A Statistical Evaluation of the Diagnostic Performance of MEDAS- The Medical Emergency Decision Assistance System Proc Annu Symp Comput Appl Med Care. 1990 Nov 7: 815-819.
  13. Knight, W. The Dark Secret at the Heart of AI, MIT Technology Review, April 11, 2017
  14. LeCun Y., Bengio Y, & Hinton G. Deep Learning. Nature 521, 436-444, May 2015
  15. Lenat, D.B. CYC: a large-scale investment in knowledge infrastructure, Comm. ACM, Volume 38, Nov. 1995, 33-38
  16. Pearl, J. Theoretical Impediments to Machine Learning With Seven Sparks from the Causal Revolution, https://arxiv.org/abs/1801.04016, Jan 2018
  17. Pearl J. and Mackenzie D., The Book Of Why: The New Science of Cause And Effect, New York: Basic Books, Forthcoming May 2018
  18. Rajpurkar, P. Hannun, A. Y. Haghpanahi, M. Bourn, . Ng, A. Y. Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks, https://arxiv.org/abs/1707.01836, July 2017
  19. Shoham, Y. Why Knowledge Representation Matters, Comm. ACM, 47-49, Jan 2016.