Context Representation and Fusion: Advancements and Opportunities
2014, Sensors
https://doi.org/10.3390/S140609628Abstract
The acceptance and usability of context-aware systems have given them the edge of wide use in various domains and has also attracted the attention of researchers in the area of context-aware computing. Making user context information available to such systems is the center of attention. However, there is very little emphasis given to the process of context representation and context fusion which are integral parts of context-aware systems. Context representation and fusion facilitate in recognizing the dependency/relationship of one data source on another to extract a better understanding of user context. The problem is more critical when data is emerging from heterogeneous sources of diverse nature like sensors, user profiles, and social interactions and also at different timestamps. Both the processes of context representation and fusion are followed in one way or another; however, they are not discussed explicitly for the realization of context-aware systems. In other words most of the context-aware systems underestimate the importance context representation and fusion. This research has explicitly focused on the importance of both the processes of context representation and fusion and has streamlined their existence in the overall architecture of context-aware systems' design and development. Various applications of context representation and fusion in context-aware systems are also highlighted in this OPEN ACCESS Sensors 2014, 14 9629
References (101)
- National IT Industry Promotion Agency) (NIPA-2014-(H0301-14-1003)) and this research was supported by the MSIP, Korea, under IT/SW Creative research program supervised by the NIPA (NIPA-2013-(H0503-13-1010)).
- Weiser, M. The computer for the 21st century. ACM Sigmobile Mob. Comput. Commun. Rev.1999, 3, 3-11.
- Baldauf, M.; Dustdar, S.; Rosenberg, F. A Survey on context-aware systems. Int. J. Ad Hoc Ubiquitous Comput. 2007, 2, 263-277.
- Schilit, B.N.; Theimer, M.M. Disseminating active map information to mobile hosts. IEEE Net. 1994, 8, 22-32.
- Dey, A.K. Understanding and using context. Pers. Ubiquitous Comput. 2001, 5, 4-7.
- Perttunen, M.; Riekki, J.; Lassila, O. Context representation and reasoning in pervasive computing: A review. Int. J. Multimed. Ubiquitous Eng. 2009, 4, 1-28.
- Khattak, A.M.; Truc, P.T.H.; Hung, L.X.; Vinh, L.T.; Dang, V.H.; Guan, D.; Pervez, Z.; Han, M.H.; Lee, S.Y.; Lee, Y.K. Towards smart homes using low level sensory data. Sensors 2011, 11, 11581-11604.
- Chen, L.; Nugent, C.; Wang, H. A knowledge-driven approach to activity recognition in smart homes. IEEE Trans. Knowl. Data Eng. 2012, 24, 961-974.
- Jenkins, M.P.; Gross, G.; Bisantz, A.M.; Nagi, R. Towards context-aware hard/soft information fusion: Incorporating situationally qualified human observations into a fusion process for intelligence analysis. In Proceedings of the 2011 IEEE First International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), Miami Beach, FL, USA, 22-24 February 2011; pp. 74-81.
- Want, R.; Hopper, A.; FalcĂŁ o, V.; Gibbons, J. The active badge location system. ACM Trans. Inf. Syst. 1992, 10, 91-102.
- Hess, C.K.; Campbell, R.H. An application of a context-aware file system. Pers. Ubiquitous Comput. 2003, 7, 339-352.
- Covington, M.J.; Fogla, P.; Zhiyuan, Z.; Ahamad, M. A context-aware security architecture for emerging applications. In Proceedings of the 18th Annual Computer Security Applications Conference, Las Vegas, NV, USA, 9-13 December 2002; pp. 249-258.
- Ding, L.; Finin, T.; Joshi, A.; Pan, R.; Scott Cost, R.; Peng, Y.; Reddivari, P.; Doshi, V.; Sachs, J. Swoogle: A search and metadata engine for the semantic web. In Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, Washington, DC, USA, 8-13 December 2004.
- Khattak, A.M.; Ahmad, N.; Mustafa, J.; Pervez, Z.; Latif, K.; Lee, S.Y. Context-aware Search in Dynamic Repositories of Digital Documents. In Proceedings of the 16th IEEE International Conference on Computational Science and Engineering (CSE 2013), Sydney, Australia, 3-5 December 2013.
- Khattak, A.M.; Pervez, Z.; Lee, S.Y.; Lee, Y.K. Intelligent healthcare service provisioning using ontology with low-level sensory data. KSII Trans. Int. Inf. Syst. 2011, 5, 2016-2034.
- Hussain, M.; Khattak, A.M.; Khan, W.A.; Fatima, I.; Amin, M.B.; Pervez, Z.; Batool, R.; Saleem, M.A.; Afzal, M.; Faheem, M.; et al. Cloud-based Smart CDSS for chronic diseases. Health Technol. 2013, 3, 153-175.
- Khattak, A.M.; Pervez, Z.; Han, M.; Lee, S.Y.; Nugent, C. DDSS: Dynamic decision support system for elderly. In Proceedings of the 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2012), Rome, Italy, 20-22 June 2012.
- Han, M.; Vinh, L.T.; Lee, Y.K.; Lee, S.Y. Comprehensive context recognizer based on multimodal sensors in a smartphone. Sensors 2012, 12, 12588-12605.
- Hofer, T.; Schwinger, W.; Pichler, M.; Leonhartsberger, G.; Altmann, J. Context-awareness on mobile devices-The hydrogen approach. In Proceedings of the 36th Annual Hawaii International Conference on System Sciences, Big Island, HI, USA, 6-9 January 2013.
- Wang, F.; Turner, K.J. An ontology-based actuator discovery and invocation framework in home care systems. In Ambient Assistive Health and Wellness Management in the Heart of the City; Springer: Berlin, Germany, 2009; pp. 66-73.
- Young, N.; Bashar, M.; Rhee, P. Adaptive context-aware filter fusion for face recognition on bad illumination. Knowl. Based Intell. Inf. Eng. Syst. 2006, 4251, 532-541.
- Sathyanarayana, A.; Boyraz, P.; Hansen, J.H.L. Information fusion for robust ‗context and driver aware' active vehicle safety systems. Inf. Fusion 2011, 12, 293-303.
- Geng, X.; Smith-Miles, K.; Wang, L.; Li, M.; Wu, Q. Context-aware fusion: A case study on fusion of gait and face for human identification in video. Pattern Recognit. 2010, 43, 3660-3673.
- Levandoski, J.J.; Mokbel, M.F.; Khalefa, M.E. Caredb: A context and preference-aware location-based database system. Proc. VLDB Endowment 2010, 3, 1529-1532.
- Estrin, D.; Culler, D.; Pister, K.; Sukjatme, G. Connecting the physical world with pervasive networks. IEEE Pervasive Comput. 2002, 1, 59-69.
- Fatima, I.; Fahim, M.; Guan, D.; Lee, Y.K.; Lee, S.Y. Socially interactive CDSS for u-Life care. In Proceedings of the 5th ACM International Conference on Ubiquitous Information Management and Communication (ACM ICUIMC 2011), Seoul, Korea, 21-23 February 2011.
- Batool, R.; Khattak, A.M.; Maqbool, J.; Lee, S.Y. Precise tweet classification and sentiment analysis. In the Proceedings of the 12th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2013), Toki Messe, Niigata, Japan, 16-20 June 2013.
- Khan, A.M.; Lee, Y.K.; Lee, S.Y.; Kim, T.S. A triaxial accelerometer-based physical activity recognition via augmented features and a hierarchical recognizer. IEEE Trans. Inf. Technol. Biomed. 2010, 14, 1166-1172.
- Nicole, A. Context-aware web search using dynamically weighted information fusion. Concurr. Comput. Pract. Exp. 2013, 25, 672-685.
- Silva, F.; Analide, C.; Novais, P. Information fusion for context awareness in intelligent environments. Hybrid Artif. Intell. Syst. 2013, 8073, 252-261.
- Tapia, D.I.; Fraile, J.A.; de Luis, A.; Bajo, J. Healthcare information fusion using context-aware agents. Hybrid Artif. Intell. Syst. 2010, 6076, 96-103.
- Sohn, T.; Li, K.; Lee, G.; Smith, I.; Scott, J.; Griswold, W. Place-Its: A Study of Location-Based Reminders on Mobile Phones; Springer: Berlin. Germany, 2005; pp.: 232-250.
- Liu, Y.H.; Wang, S.-Z.; Du, X.-M. A multi-agent information fusion model for ship collision avoidance. In Proceedings of the 2008 International Conference on Machine Learning and Cybernetics, Kunming, China, 12-15 July 2008; pp. 6-11.
- Wu, H.; Siegel, M.; Ablay, S. Sensor fusion for context understanding. In Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference, Anchorage, AK, USA, 21-23 May 2002; pp. 13-17.
- Wu, H.; Siegel, M.; Stiefelhagen, R.; Yang, L. Sensor fusion using Dempster-Shafer theory [for context-aware HCI]. In Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference, Anchorage, AK, USA, 21-23 May 2002; pp. 7-12.
- Khattak, A.M.; Batool, R.; Pervez, Z.; Khan, A.M.; Lee, S.Y. Ontology evolution and challenges. J. Inf. Sci. Eng. 2013, 29, 851-871.
- Carneiro, D.; Castillo, J.C.; Novais, P.; Ferná ndez-Caballero, A.; Neves, J. Multimodal behavioural analysis for non-invasive stress detection, expert systems with applications. Expert Syst. Appl. 2012, 39, 13376-13389.
- Novais, P.; Carneiro, D.; Gomes, M.; Neves, J. The Relationship between Stress and Conflict Handling Style in an ODR Environment. In New Frontiers in Artificial Intelligence; Springer: Berlin, Germany, 2013; pp. 125-140.
- Serral, E.; Valderas, P.; Pelechano, V. Context-adaptive coordination of pervasive services by interpreting models during runtime. Comput. J. 2012, 56, 87-114.
- Vara, J.D.L.; Ali, R.; Dalpiaz, F.; Sá nchez, J.; Giorgini, P. COMPRO: A methodological approach for business process contextualisation. In On the Move to Meaningful Internet Systems; Springer: Berlin, Germany, 2010; pp. 132-149.
- Asier, A.; Augusto, J.C. Context-aware discovery of human frequent behaviours through sensor information interpretation. In Human Behavior Recognition Technologies: Intelligent Applications for Monitoring and Security; Guesgen, H.W., Marsland, S., Eds.; IGI Global: Hershey, PA, USA, 2013; pp. 14-32.
- Augusto, J.C.; Callaghan, V.; Kameas, A.; Cook, D.; Satoh, I. Intelligent environments: A manifesto. Hum. Centric Comput. Inf. Sci. 2013, 3, 1-18.
- Brachman, R.J.; Levesque, H.J. Knowledge Representation and Reasoning; Morgan Kaufmann: San Francisco, CA, USA, 2004.
- Fahim, M.; Fatima, I.; Lee, S.; Lee, Y.K. EEM: Evolutionary ensembles model for activity recognition in smart homes. Int. J. Appl. Intell. 2012, 38, 88-98.
- Das, B.; Seelye, A.M.; Thomas, B.L.; Cook, D.J.; Holder, L.B.; Edgecombe, M.S. Using smart phones for context-aware prompting in smart environments. In Proceedings of the IEEE Consumer Communications and Networking Conference, Las Vegas, NV, USA, 14-17 January 2012.
- Samwald, M.; de Fehre, K.; Bruin, J.; Adlassnig, K.P. The Arden Syntax standard for clinical decision support: Experiences and directions. J. Biomed. Inform. 2012, 45, 711-718.
- Munõz, M.A.; Gonzalez, V.M.; Rodriguez, M.; Vela, J.F. Supporting context-aware collaboration in a hospital: An ethnographic informed design. In Proceedings of the Workshop on Artificial Intelligence, Information Access, and Mobile Computing 9th International Workshop on Groupware, CRIWG 2003, Grenoble, France, 28 September-2 October 2003; pp. 330-334.
- Henricksen, K.; Indulska, J. Modelling and using imperfect context information. In Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications Workshops, Washington, DC, USA, 14-17 March 2004.
- Du, K.; Zhang, D.; Zhou, X.; Mokhtari, M.; Hariz, M.; Qin, W. HYCARE: A Hybrid Context-Aware Reminding Framework for Elders with Mild Dementia. In Smart Homes and Health Telematics; Springer: Berlin, Germany, 2008; pp. 9-17.
- Choi, J.; Lee, G.; Moon, J. Web context classification based on information quality factors. J. Univers. Comput. Sci. 2010, 16, 2232-2251.
- Classification and Modeling of the Quality of Contextual Information. Available online: http://www.simondobson.org/softcopy/tcaas-qoc-06.pdf (accessed on 27 May 2014).
- Jiang, L.; Yu, M.; Zhou, M.; Liu, X.; Zhao, T. Target-dependent Twitter Sentiment Classification. In the Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA, 19-24 June 2011.
- Schilit, W.N.; Adams, N.I.; Want, R. Context-aware computing applications. In Proceedings of the 1st International Workshop on Mobile Computing Systems and Applications, Santa Cruz, CA, USA, 8-9 December 1994; pp. 85-90.
- Brown, P.J.; Bovey, J.D.; Chen, X. Context-Aware Applications: From the Laboratory to the Marketplace. IEEE Pers. Commun. 1997, 4, 58-64.
- Sawhney, N.; Schmandt, C. Speaking and listening on the run: Design for wearable audio computing. In Proceedings of the International Symposium on Wearable Computing, Pittsburgh, PA, USA, 19-20 October 1998.
- Schmidt, A.; Gellersen, H.W.; Beigl, M. A wearable context-awareness component-Finally a good reason to wear a tie. In Proceedings of the Third International Symposium on Wearable Computers, San Francisco, CA, USA, 18-19 October 1999; pp. 176-177.
- Schilit, W.N. A System for Context-Aware Mobile Computing. Ph.D. Thesis, Columbia University, New York, NY, USA, 1995.
- Hong, J.Y.; Suh, E.H.; Kim, S.J. Context-aware systems: A literature review and classification. Expert Syst. Appl. 2009, 36, 8509-8522.
- Miraoui, M.; Tadj, C.; Amar, C.B. Architectural survey of context-aware systems in pervasive computing environment. Ubiquitous Comput. Commun. J. 2008, 3, 1-9.
- Strang, T.; Linnhoff-Popien, C. A context modeling survey. In Proceedings of the First International Workshop on Advanced Context Modelling, Reasoning and Management at UbiComp 2004, Nottingham, UK, 7 September 2004.
- Clarke, S.; Linehan, E. Supporting Context-Awareness: A Taxonomic Review. Available online: http://www.tara.tcd.ie/handle/2262/39204 (accessed on 27 May 2014).
- Henricksen, K.; Indulska, J.; Rakotonirainy, A. Modeling Context Information in Pervasive Computing Systems. In Pervasive Computing; Springer: Berlin, Germany, 2002; pp. 167-180.
- Henricksen, K.; Indulska, J. A software engineering framework for context-aware pervasive computing. In Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, Orlando, FL, USA, 14-17 March 2004; pp. 77-86.
- Kowalski, R. Predicate logic as programming language. IFIP Congr. 1974, 74, 544-569.
- Gray, P.; Salber, D. Modelling and Using Sensed Context Information in the Design of Interactive Applications. In Engineering for Human-Computer Interaction; Springer: Berlin, Germany, 2001; pp. 317-335.
- Ertel, W. First-Order Predicate Logic. In Introduction to Artificial Intelligence; Springer: Berlin, Germany, 2011; pp. 31-55.
- Chen, H.; Perich, F.; Finin, T.; Joshi, A. SOUPA: Standard ontology for ubiquitous and pervasive applications. In Proceedings of the First Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services, Boston, MA, USA, 22 August 2004; pp. 258-267.
- Petersen, A.K.; Mikalsen, M. Context: Representation and Reasoning. Available Online: http://www.idi.ntnu.no/~anderpe/publications/RIA-05-AKP-MM-paper.pdf (accessed on 27 May 2014).
- Gu, T.; Pung, H.K. A middleware for building context-aware mobile services. In Proceedings of the 2004 IEEE 59th Vehicular Technology Conference, Milan, Italy, 17-19 May 2004; pp. 2656-2660.
- OWL Web Ontology Language Overview. Available online: http://www.w3.org/TR/owl-features/ (accessed on 27 May 2014).
- Horrocks, I.; Patel-Schneider, P.F.; Harmelen, F.V. From SHIQ and RDF to OWL: The making of a web ontology language. Web Semant. Sci. Serv. Agents World Wide Web 2003, 1, 7-26.
- Nardi, D.; Ronald, J.B. An introduction to description logics. In Description Logic Handbook; Cambridge University Press: New York, NY, USA, 2003.
- Donini, F.M.; Nardi, D.; Rosati, R. Description logics of minimal knowledge and negation as failure. ACM Trans. Comput. Log. (TOCL) 2002, 3, 177-225.
- Chen, H.; Finin, T.; Joshi, A. Semantic Web in the Context Broker Architecture. In Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, Washington, DC, USA, 14-17 March 2004.
- Lee, T.B.; Hendler, J.; Lassila, O. The semantic web. Sci. Am. 2001, 284, 28-37.
- Zhao, W.; Huifang, M.; Qing, H. Parallel K-means Clustering Based on Mapreduce. In Cloud Computing; Springer: Berlin, Germany, 2009; pp. 674-679.
- Amiri, K.; Park, S., Tewari, R.; Padmanabhan, S. Scalable template-based query containment checking for web semantic caches. In Proceedings of the 19th International Conference on Data Engineering, Bangalore, India, 8 March 2003.
- Khungar, S.; Riekki, J. A context based storage system for mobile computing applications. ACM J. Mob. Comput. Commun. Rev. 2005, 9, 64-68.
- Yamabe,T.; Takagi, A.; Nakajima, T. Citron: A context information acquisition framework for personal devices. In Proceedings of the 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, Hong Kong, China, 17-19 August 2005; pp. 489-495.
- Bettini, C.; Brdiczka, O.; Henricksen, K.; Indulska, J.; Nicklas, D.; Ranganathan, A.; Riboni, D. A survey of context modeling and reasoning techniques. Pervasive Mob. Comput. 2010, 6, 161-180.
- Brickley, D.; Ramanathan, V.G. Resource Description Framework (RDF) Schema Specification 1.0. Available online: http://www.w3.org/TR/2000/CR-rdf-schema-20000327/ (accessed on 27 May 2014).
- Bracha, G.; Ungar, D. Mirrors: Design principles for meta-level facilities of object-oriented programming languages. In Proceedings of the 19th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, Vancouver, Canada, 24-28 October 2004; pp. 331-344.
- Bardram, J.E. The Java Context Awareness Framework (JCAF)-A Service Infrastructure and Programming Framework for Context-Aware Applications. In Pervasive Computing; Springer: Berlin, Germany, 2005; pp. 98-115.
- Mikalsen, M.; Floch, J.; Paspallis, N.; Papadopoulos, G.A.; Ruiz, P.A. Putting context in context: The role and design of context management in a mobility and adaptation enabling middleware. In Proceedings of the 7th International Conference on Mobile Data Management, (MDM 2006), Nara, Japan, 10-12 May 2006; pp. 76-83.
- Dey, A.K.; Abowd, G.D.; Salber, D. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum. Comput. Interact. 2001, 16, 97-166.
- Castelli, G.; Rosi, A.; Mamei, M.; Zambonelli, F. A simple model and infrastructure for context-aware browsing of the world. In Proceedings of the Fifth Annual IEEE International Conference on Pervasive Computing and Communications, White Plains, NY, USA, 19-23 March 2007; pp. 229-238.
- Frank, A.U. Tiers of ontology and consistency constraints in geographical information systems. Int. J. Geogr. Inf. Sci. 2001, 15, 667-678.
- Henricksen, K.; Livingstone, S.; Indulska, J. Towards a hybrid approach to context modeling, reasoning and interoperation. In Proceedings of the First International Workshop on Advanced Context Modelling, Reasoning and Management, Nottingham, UK, 7 September 2004.
- Stillera, C.; LeĂłnb, F.P.; Kruseb, M. Information fusion for automotive applications-An overview. Inf. Fusion 2011, 12, 224-252.
- Sá enz, F.T.; Vela, M.V.; Campuzano, F.; Botia, J.A.; Gómez, A.F.S. A complex event processing approach to perceive the vehicular context. Inf. Fusion 2012, in press, doi:10.1016/j.inffus.2012.08.008.
- Siddiqi, M.H.; Lee, S.Y.; Lee, Y.K.; Khan, A.M. Truc, P.T.H. Hierarchical recognition scheme for human facial expression recognition systems. Sensors 2013, 13, 16682-16713.
- Silva, F.; Analide, C.; Rosa, L.; Felgueiras, G.; Pimenta, C. Ambient sensorization for the furtherance of sustainability. Ambient Intell. Softw. Appl. 2013, 219, 179-186.
- Westeyn, T.; Brashear, H.; Atrash, A.; Starner, T. Georgia Tech gesture toolkit: Supporting experiments in gesture recognition. In Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver, BC, Canada, 5-7 November 2003.
- SNOMEDCT Ontology. Available online: http://bioportal.bioontology.org/ontologies/SNOMEDCT (accessed on 1 April 2014).
- ICD-10 Ontology. Available online: https://dkm.fbk.eu/index.php/ICD-10_Ontology (accessed on 1 April 2014).
- Hall, D.L.; James, L. An introduction to multisensor data fusion. Proc. IEEE 1997, 85, 6-23.
- Lillis, D.; Toolan, F.; Collier, R.; Dunnion, J. ProbFuse: A probabilistic approach to data fusion. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, USA, 6-10 August 2006.
- Varshney Pramod, K. Multisensor data fusion. Electron. Commun. Eng. J. 1997, 9, 245-253.
- Poslad, S. Context-Aware Systems. In Ubiquitous Computing: Smart Devices Environments and Interaction; Wiley: Hoboken, NJ, USA, 2009; pp. 213-244.
- Ganta, S.R.; Acharya, R. Adaptive data anonymization against information fusion based privacy attacks on enterprise data. In Proceedings of the 2008 ACM Symposium on Applied Computing, Fortaleza, Ceara, Brazil, 16-20 March 2008; pp. 1075-1076.
- Tabatabaei, H.; Amir, S.; Gluhak, A.; Tafazolli, R. A survey on smartphone-based systems for opportunistic user context recognition. ACM Comput. Surv. 2013, 45, doi:10.1145/2480741.2480744.