End-user Customisation of Intelligent Environments
https://doi.org/10.1007/978-0-387-93808-0_14Abstract
One of the striking aspects of world-wide-web is how it has empowered ordinary non-technical people to participate in a digital revolution by transforming the way services such as shopping, education and entertainment are offered and consumed. The proliferation of networked appliances, sensors and actuators, such as those found in digital homes heralds a similar ‘sea change’ in the capabilities of ordinary people to customise and utilise the electronic spaces they inhabit. By coordinating the actions of networked devices or services, it is possible for the environment to behave in a holistic and reactive manner to satisfy the occupants needs; creating an intelligent environment. Further, by deconstructing traditional home appliances into sets of more elemental network accessible services, it is possible to reconstruct either the original appliance or to create new user defined appliances by combining basic network services in novel ways; creating a so called virtual appliance. This principle can be extended to decompose and recompose software applications allowing users to create their own bespoke applications. Collectively, such user created entities are referred to as Meta – appliances or –applications, more generally abbreviated to MAps. Deconstruction and user customized MAps raise exciting possibilities for occupants of future intelligent environments, and sets significant research challenges [Chin 09]. For example, how can MAps be constructed and managed by ordinary non-expert home occupants? At one extreme it is possible to use artificial intelligence (AI) techniques and equipment, such as autonomous intelligent agents. These monitor an occupants habitual behaviour, modelling their behaviours, and creating rule-based profiles (self programming) so they can preemptively set the environment to what they anticipate the user would like [Augusto 06]. However, some people have privacy concerns about what is being recorded, when it is being recorded and to whom (or what) any information is communicated. These concerns are particularly acute with autonomous agents, in which people have little direct control. Such matters are especially sensitive when the technology is used in the private space of someone’s home. Frequently, endusers are given very little choice in setting-up digital home technology and are obliged to accept whatever is offered [Callaghan et-al 08]. Apart from the issues of privacy and trust, we argue that creativity is an essential and distinctive human quality, and that many people would enjoy the process of creating their own novel networked appliances and personalising their ’electronic spaces’, providing they can be shielded from unnecessary technical complexity. This has parallels to the common practice of people decorating their own homes with paintings, walls hangings, pictures, colour schemes and furniture. This rationale has led many researchers to investigate what is termed ‘end-user programming’, a methodology aimed at allowing non-technical people to personalise their own digital spaces with network enabled embedded-computer based devices. Historically, programming has only been accessible to well-qualified professionals, such as computer scientists, or the outcome of self-programming (learning) using autonomous intelligent agents. The challenge for achieving an end-user programming vision is to devise programming methodologies that are usable by non-technical people. In this chapter we begin by reviewing current research into end-user programming systems, especially those for the home. We describe approaches that range from transposing conventional programming constructs into graphical or physical iconic objects, to those that adopt radically new programming metaphors. By way of an example of these new approaches, we describe a novel end-user programming approach developed at the University of Essex called Pervasiveinteractive- Programming (PiP) (UK patent No. GB0523246.7) and a service coordination model known as Meta-Appliances/Applications (MAps). We report on an evaluation of user experiences using PiP in a digital home, the University of Essex iSpace. We conclude this chapter by reflecting on the main findings of our work.
References (39)
- References: [Augusto 06] Augusto, Juan Carlos; Nugent, Chris D. (Eds.) "Designing Smart Homes: The Role of Artificial Intelligence", Lecture Notes in Computer Science , Vol. 4008, 2006, ISBN: 978-3-540-35994-4
- O. Babaoglu et al., "Anthill: A Framework for the Development of Agent-based Peer-to-Peer Systems", 22 nd International Conference on Distributed Computing Systems, 2003.
- Mathias Bauer, Dietmar Dengler, Gabriele Paul, Markus Meyer, "Programming by example: programming by demonstration for information agents", Communications of the ACM, Volume 43, Issue 3 (March 2000), pp.98 -103
- Berners-Lee 01] Berners-Lee T, Hendler J, Lassila O. "The Semantic Web", Scientific American, May 2001 [Barkhuus 03] Barkhuus, L., Vallgårda, A: "Smart Home in Your Pocket", Adjunct Proceedings of UbiComp 2003 (2003) 165-166
- Alan F. Blackwell, Rob Hague, "Designing a Program Language for Home Automation", in G.Kadoda (Ed). Proc PP1G 2001 pp85-103.
- Barry Brumitt, Brian Meyers, John Krumm, Amanda Kern and Steven A.Shafer, "EasyLiving: Technologies for Intelligent Environments", Proc of the 2 nd international symposium on Handheld and Ubiquitous Computing, 2000, 12 -29
- Callaghan V, Clark G, Colley M, Hagras H Chin JSY, Doctor F "Intelligent Inhabited Environments", BT Technology Journal , Vol.22, No.3 . Klywer Academic Publishers, Dordrecht, Netherlands, July 2004
- Callaghan,V., Chin, J.S.Y., Shahi, A., Zamudio, V., Clarke,G.S., Gardner,M., 'Domestic Pervasive Information Systems: End-user programming of digital homes', Journal of Management Information Systems, Special Edition onPervasive Information Systems (volume editors Panos Kourouthanassis; George Giaglis), 24:01 (December 2007) pp.129-149 (inc), ME Sharp (New York), ISBN: 978-0-7656- 1689-0
- Callaghan V, Clarke G, Chin J "Some Socio-Technical Aspects Of Intelligent Buildings and Pervasive Computing Research", Intelligent Buildings International Journal, Vol 1 No 1, Published Autumn 2008, ISSN: 1750-8975, E-ISSN: 1756-6932
- Chen H,;
- Finin T,; Joshil A. "SOUPA: Standard Ontology for Ubiquitous and Pervasive Applications", Int'l Conference on Mobile & Ubiquitous Systems: Networking & Services (MobiQuitous 2004 ), Boston, Massachusetts, USA, August 22-26, 2004
- G. Chen and D. Kotz. "A survey of context-aware mobile computing research", Paper TR2000-381, Department of Computer Science, Darthmouth College, November 2000.
- Chin J, Callaghan V, Clarke G, "A Programming-By-Example Approach To Customising Digital Homes" IET International Conference on Intelligent Environments 2008, Seattle, 21-22 July 2008 [Chin 09] Chin J, Callaghan V, Clarke G, "Soft-appliances: A vision for user created networked appliances in digital homes", Journal of Ambient Intelligence and Smart Environments 1 (2009) 65-71, DOI 10.3233/AIS-2009-0010, IOS Press, 2009 [Chung 03] Kook Hyun Chung, Kyoung Soon Oh, Cheong Hyun Lee, Jae Hyun Park, Sunae Kim, Soon Hee Kim, Beth Loring, Chris Hass, "A User- Centric Approach to Designing Home Network Devices", CHI '03 extended abstracts on Human factors in computing systems, 2003, 648 -649
- D.J. Cook, M. Huber, K. Gopalratnam and M. Youngblood, "Learning to Control a Smart Home Environment", Innovative Applications of Artificial Intelligence, 2003 [Cook 06] Diane J. Cook, Michael Youngblood and Sajal K. Das "A Multi- agent Approach to Controlling a Smart Environment", pp 165-182, in Designing Smart Homes: The Role of Artificial Intelligence, ISBN 978-3-540-35994-4, July 2006
- Coolican H. "Research Methods and Statistics in Psychology" (2 nd Edition) Hodder and Stoughton, 1994 [Cypher 93] Cypher A, Halbert DC, Kurlander D, Lieberman H, Maulsby D, Myers BA, and Turransky A, "Watch What I Do: Programming by Demonstration" The MIT Press, Cambridge, Massachusetts, London, England 1993 [DiDuca 05] DiDuca D and Van Helvert J. "User Experience of Intelligent Buildings; A User-Centered Research Framework", Intelligent Environments 2005, Essex, 28-29 th June 2005
- N. Dulay, S. Heeps, E. Lupu, R. Mathur, O. Sharma, M. Sloman and and J. Sventek, "AMUSE: Autonomic Management of Ubiquitous e- Health Systems", Proc. UK e-Science All Hands Meeting, Nottingham, Sept. 2005
- Duman H, Callaghan V, Hagras H, "Intelligent Association Selection of Embedded Agents in Intelligent Inhabited Environments", Journal of Pervasive and Mobile Computing, vol. 3, issue 2, 2007, 117-157 In the handbook of Ambient Intelligence and Smart Environments, Editors: H. Nakashima, J. Augusto, H. Aghajan, Springer, Spring 2010, pp 371-407, ISBN 978-0-387-93807-3 [Gajos 02] Gajos K., Fox H., Shrobe H., "End User Empowerment in Human Centred Pervasive Computing", Pervasive 2002, Zurich, Switzerland, 2002 [Halbert 93] Halbert D.C. "SmallStar: Programming by Demonstration in the Desktop Metaphor", Watch What I DO, MIT Press. 1993
- V.Haarslev and R. Moller, "Description of the RACER system and its application", In proceedings International Workshop on Description Logics (DL-2001), 2001
- Hague, R., et al: "Towards Pervasive End-user Programming". In: Adjunct Proceedings of UbiComp 2003 (2003) 169-170 [Humble 03] Humble, J. et al "Playing with the Bits", User-Configuration of Ubiquitous Domestic Environments, Proceedings of UbiComp 2003, Springer-Verlag, Berlin Heidelberg New York (2003), pp 256-263 [Johnson 08] Johnson B, Callaghan V, Gardner G "Bespoke Appliances for the Digital Home" IET International Conference on Intelligent Environments 2008, Seattle, 21-22 July 2008 [Kainulainen 06] Kainulainen L "Reasoning in The Smart Home", AIOME, 2006 [Kidd 99]
- C. Kidd, R. Gregory, A. Christopher, T. Starner. "The Aware Home: A Living Laboratory for Ubiquitous Computing Research", In Proceedings of the Second International Workshop on Cooperative Buildings (CoBuild'99), October 1999
- Lieberman H., Bonnie A. Nardi and David J. Wright, "Training Agents to Recognize Text by Example", Proceedings of the third annual conference on Autonomous Agents, Seattle, Washington, United States, 1999, pp 116 -122
- Lieberman H, "Your wish is my command", Program by Example", Morgan Kaufmann press, 2001.
- Masuoka R,; Parsia B,; Labrou Y. "Task Computing -the Semantic Web meets Pervasive Computing", 2nd Int'l Semantic Web Conf (ISWC2003), 20-23 Oct 2003, Florida, USA [Luck 03]
- M. Luck et al., "Agent Technology: Enabling Next Generation Computing", AgentLink II, 2003 [Mäyrä 06] Mäyrä F, Soronen A, Vanhala J, Mikkonen J, Zakrzewski M, Koskinen I, Kuusela K, "Probing a Proactive Home: Challenges in Researching and Designing Everyday Smart Environments", Human Technology Journal, Volume 2 (2), October 2006, 158-186
- J. McCann, P. Kristoffersson and E. Alonso, "Building Ambient Intelligence into a Ubiquitous Computing Management System", Proc. International Symposium of Santa Caterina on Challenges in the Internet and Interdisciplinary Research (SSCCII-2004), Amalfi, Italy, Jan. 2004
- McDaniel R., "Demonstrating the hidden features that make an application work", in "Your wish is my command: programming by example", Morgan Kaufmann Publishers Inc. San Francisco, CA, USA , 2001, pp 163 -174
- N. Minar, M. Gray, P. Maes. "Hive: Distributed Agents for Networking Things", In Proceedings of ASA/MA'99, the First International Symposium on Agents Systems and Applications and Third International Symposium on Mobile Agents, 1999 [Mozer 98] Mozer, M. C. "The neural network house: An environment that adapts to its inhabitants" In M. Coen (Ed.), Proceedings of the American Association for Artificial Intelligence Spring Symposium on Intelligent Environments (pp. 110-114). Menlo, Park, CA: AAAI Press, 1998
- In the handbook of Ambient Intelligence and Smart Environments, Editors: H. Nakashima, J. Augusto, H. Aghajan, Springer, Spring 2010, pp 371-407, ISBN 978-0-387-93807-3 [Myers 90] Myers B.A., "Creating user interfaces using programming by example, visual programming, and constraints", ACM Transactions on Programming Languages and Systems (TOPLAS), Volume 12 , Issue 2 (April 1990), pp 143 -177
- O'Neill 04]
- O'Neill, E. and Johnson, P. (2004) "Participatory Task Modelling: users and developers modelling users' tasks and domains", 3rd International Workshop on task models and diagrams for user interface design (TAMODIA 04). Prague, Czech Republic, 15-16 th November 2004
- Oppenheim, A N. "Questionnaire Design, Interviewing and Attitude Measurement" Pinter Publishers Ltd, 1992 [Zamudio 08] Zamudio V, Callaghan V, "Facilitating the Ambient Intelligent Vision: A Theorem, Representation and Solution for Instability in Rule-Based Multi-Agent Systems, Special Issue Section" International Transactions on Systems Science and Applications (special issue on "Agent based System Challenges for Ubiquitous and Pervasive Computing"), Vol 4, No. 1, 2008 [Röcker 04] Carsten Röcker, Maddy D. Janse, Nathalie Portolan and Norbert Streitz, "User Requirements for Intelligent Home Environments: A Scenario-Driven Approach and Empirical Cross-Cultural Study", Joint sOc-EUSAI conference, 2004, 111-116
- B. Schilit, N. Adams, and R. Want. "Context-aware computing applications", In Proceedings of the 1st International Workshop on Mobile Computing Systems and Applications, 1994 [Smith 77] Smith, D. C., "Pygmalion: A Computer Program to Model and Stimulate Creative Thought", (1975 Stanford PhD thesis), Birkhauser Verlag. 1977.
- Sugiura A,Koseki Y. "Internet scrapbook: automating Web browsing tasks by demonstration" Proceedings of the 11th annual ACM symposium on User interface software and technology, San Francisco, California, United States, 1998, pp.9-18
- Truong, KN.et al " CAMP: A Magnetic Poetry Interface for End-User Programming of Capture Applications for the Home", Proceedings of Ubicomp 2004, pp 143-160.
- Vastenburg 04] Vastenburg M, "SitMod: a tool for modelling and communicating situations", Second International Conference, PERVASIVE 2004, Vienna Austria, April 21-23, 2004, ISBN: 3-540-21835-1
- Wang Z, Garlan D. "Task-Driven Computing", Technical Report, CMU-CS-00-154, Computer Science, Carnegie Mellon University, May 2000 [Zamudio 08] Zamudio V and Callaghan V, "Facilitating the Ambient Intelligent Vision: A Theorem, Representation and Solution for Instability in Rule-Based Multi-Agent Systems", International Transactions on Systems Science and Applications, Volume 4 Number 2 July 2008 [Zou 04] Young Zou, Harry Chen, and Tim Finin, "F-OWL: an Inference Engine for Semantic Web", Proceedings of the Third NASA- Goddard/IEEE Workshop on Formal Approaches to Agent-Based Systems, 26 April 2004
- Web Listings:
- http://agentsheets.com/products/index.html [HP Jena] http://jena.sourceforge.net/ [Network Inference] http://www.networkinference.com/Products/Construct.html In the handbook of Ambient Intelligence and Smart Environments, Editors: H. Nakashima, J. Augusto, H. Aghajan, Springer, Spring 2010, pp 371-407, ISBN 978-0-387-93807-3 [PBDCAD] http://www.lisi.ensma.fr/ihm/index-en.html
- http://iieg.essex.ac.uk/dcomp/ont/dev/2004/05/ [OWL-S] http://www.w3.org/Submission/2004/07/ In the handbook of Ambient Intelligence and Smart Environments, Editors: H. Nakashima, J. Augusto, H. Aghajan, Springer, Spring 2010, pp 371-407, ISBN 978-0-387-93807-3