Gesture based IoT Light Control for Smart Clothing

Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020), 110-117, 2020 , 2020

Wrist-worn gesture sensing systems can be used as a seamless interface for AR/VR interactions and control of various devices. In this paper, we present a low-cost gesture sensing system that utilizes near Infrared Emitters (600-1100 nm) and Photo-Receivers encompassing the wrist to infer hand gestures. The proposed system consists of a wristband comprising Infrared emitters and receivers, data acquisition hardware, data post-processing software, and gesture classification algorithms. During the data acquisition process, 24 near Infrared Emitters are sequentially switched on around the wrist, and twelve Photo-diodes measure the light reflected, refracted, and scattered by the tissues inside the wrist. The acquired data corresponding to different gestures are labeled and input into a machine learning algorithm for gesture classification. To demonstrated the accuracy and speed of the proposed system, real-time gesture sensing user studies were conducted. As a result of this comparison, we obtained an average accuracy of 98.06% with standard deviation of 1.82%. In addition, we evaluated that the system can perform six-eight gestures per second in real time using a desktop computer operating with Core i7-7800X CPU at 3.5GHz and 32 GB RAM.

2020 South American Colloquium on Visible Light Communications (SACVC), 2020

The concept of interactive visible light communications (iVLC) is introduced and discussed in this paper. iVLC exploits a matrix of solid-state light luminaries in multiple ways, namely providing lighting and wireless communications as well as supporting visual signaling and interaction. Every individual element of the light matrix can be exploited in multiple domains, i.e., space, time, color, intensity and data. As a result, the lighting infrastructure works a flexible platform that can be exploited in wide range of applications and use cases. The paper discusses attractive applications of iVLC, particularly in the school of the future, health-care and office spaces. Multiple classroom tasks can be supported by iVLC, including orchestration of activities, feedback between students and teachers, dynamic grouping, etc.

Proceedings of the Conference on Design and Semantics of Form and Movement - Sense and Sensitivity, DeSForM 2017, 2017

published version of record. interested in the research are advised to contact the author for the final version of the publication DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or oth and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with th • Users may download and print one copy of any publication from the public portal for the purpose of private study • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the "Taverne" licen follow below link for the End User Agreement:

IOP conference series, 2017

This paper addresses an ongoing research, aiming at the development of smart textiles that transform the incident light that passes through them-light transmittance-to design dynamic light without acting upon the light source. A colour and shape change prototype was developed with the objective of studying textile changes in time; to explore temperature as a dynamic variable through electrical activation of the smart materials and conductive threads integrated in the textile substrate; and to analyse the relation between textile chromic and morphologic behaviour in interaction with light. Based on the experiments conducted, results have highlighted some considerations of the dynamic parameters involved in the behaviour of thermo-responsive textiles and demonstrated design possibilities to create interactive lighting scenarios.

Personal and Ubiquitous Computing, 2015

Most interactions with today's interfaces require a person's full and focused attention. To alleviate the potential clutter of focal information, we investigated how interactions could be designed to take place in the background or periphery of attention. This paper explores whether gestural, multimodal interaction styles of an interactive light system allow for this. A study compared the performance of interactions with the light system in two conditions: the central condition in which participants interacted only with the light system, and the peripheral condition in which they interacted with the system while performing a high-attentional task simultaneously. Our study furthermore compared different feedback styles (visual, auditory, haptic, and a combination). Results indicated that especially for the combination feedback style, the interaction could take place without participants' full visual attention, and performance did not significantly decrease in the peripheral condition. This seems to indicate that these interactions at least partly took place in their periphery of attention and that the multimodal feedback style aided this process.

ArXiv, 2020

This paper proposes an idea of building an interface to merge the existing technologies like Image processing, Internet of Things, Sixth sense, etc. at one place to reduce the hardware restrictions imposed on a user and improve the responsiveness of the system. The wearable device comprises of a camera, a projector, and its own gesture-controlled environment having smart tools based on trending techniques like gesture recognition, color marker detection, and speech recognition. The interface is trained using machine learning. It is also interfaced with an IoT based lab to access the lab controls remotely, enhance the security, and to connect devices present in the lab.

What if lighting were not fixed to our architecture but becomes part of our body? Light would be only where it is needed. Buildings would light up brightly when busy, and dim down when people leave. Lighting would become more energy efficient, more personal, and colorful, tailored to individual needs. What applications beyond illumination would be possible in such a scenario? Halo is a wearable lighting device that aims to investigate this question. More specifically Halo explores the potential of body-centered lighting technology to alter appearance and create a personal space for its wearer. A ring of colored LEDs frames the wearer's face, putting her into the light she desires. Borrowing from both theatrical and photographic lighting design, Halo has several different lighting compositions that make the wearer appear happy, sad, energetic, mysterious, etc. Using a smart phone application, the wearer can switch between these modes. She can also let the application adjust autom...

2019

The paper explores a gestural and visual language to interact with an Artificial Intelligent agent controlling connected lighting systems. Six interaction modalities (four gestural and two visual) were designed and tested with users in order to collect feedback on their intuitiveness, comfort and engagement level. A comparison between traditional voice-based interaction modalities with AI and the proposed gesture-based language was performed. Preliminary results are discussed, including the importance of cognitive metaphors in gesture-based interaction, the relation between intuitiveness, innovation, and engagement, and the advantages provided by gesture-based interactions in terms of privacy, subtleness, and pleasantness, versus the limited options and the need to learn a codified language. Insights will help designers in the development of seamless interactions with AI agents for ambient intelligent systems.

Proceedings of the 2022 Workshop on Body-centric Computing Systems

Advances in Visible Light Communication are enabling novel Internet of Things applications. Going forward, we expect that LEDto-Camera links will enable a wide range of body-centric computing applications. Up until now, most LED-to-Camera studies have been following a deploy-and-test approach instead of a principled methodology. This ad-hoc design raises up two problems. First, we cannot compare fairly the various methods proposed in the literature because they use different types of LEDs and cameras. Second, and perhaps more importantly, we cannot identify the fundamental opportunities and limits of these novel links. To overcome these challenges, we propose a simple analytical model that estimates the range and data rate of LED-to-camera links prior to deployment. The model is built from first principles and requires only a limited set of parameters. To validate the accuracy of our model, we consider the two main transmission modes used in the literature: binary transmission and communication based on the rolling shutter effect. Our experimental evaluation confirms the predictions of the analytical model. CCS Concepts • Computing methodologies → Modeling and simulation; • Human-centered computing → Human computer interaction (HCI).

2014

The keyboard and mouse are currently the main interfaces between man and computer. In other areas where 3D information is required, such as computer games, robotics and design, other mechanical devices such as roller-balls, joysticks and data-gloves are used. Humans communicate mainly by vision and sound, therefore, a man-machine interface would be more intuitive if it made greater use of vision and audio recognition This paper describes a gesture-based user interface device, gloves to interact with computer and its integration into application software. Initially there is information about the existing technologies for gesture recognition. Afterwards paper is describing the new robust technology for multi-point gesture recognition and the advantages of this new approach over existing approaches. This system can be used in number of applications ranging from desktop applications to the control of a mobile robot.