Academia.eduAcademia.edu

Human Activity Recognition

description891 papers
group1,697 followers
lightbulbAbout this topic
Human Activity Recognition (HAR) is a field of study within computer science and artificial intelligence that focuses on identifying and classifying human actions and behaviors through sensor data, video analysis, or wearable devices, utilizing machine learning and pattern recognition techniques to interpret and understand human movements in various contexts.
lightbulbAbout this topic
Human Activity Recognition (HAR) is a field of study within computer science and artificial intelligence that focuses on identifying and classifying human actions and behaviors through sensor data, video analysis, or wearable devices, utilizing machine learning and pattern recognition techniques to interpret and understand human movements in various contexts.

Key research themes

1. How can multimodal sensor fusion improve the robustness and accuracy of human activity recognition in real-world and assisted living environments?

This theme investigates leveraging and integrating heterogeneous data sources—such as vision, inertial measurement units (IMUs), and ambient sensors—to enhance human activity recognition (HAR) performance, especially in complex real-world scenarios like Ambient Assisted Living (AAL). By combining modalities, systems can overcome limitations of individual sensors, address occlusions, and provide more reliable recognition critical for healthcare, elderly monitoring, and smart home applications.

Key finding: Challenging the conventional single-modality HAR methods, this work introduced the HWU-USP dataset comprising simultaneous video, wearable IMU, and ambient sensor data in robotic assisted living labs. Experiments demonstrated... Read more
Key finding: This study developed a hybrid HAR system combining inertial signals with vision-based skeleton features extracted from RGB-D (Kinect) cameras, utilizing geometric feature descriptors and logistic regression. The fusion... Read more
Key finding: The review categorized HAR applications into smart homes, healthcare, surveillance, and tele-immersion, emphasizing the use of multimodal sensor technologies (video-based, non-video, and multimodal). The authors highlighted... Read more

2. What machine learning techniques and feature engineering strategies enhance activity classification from wearable and motion data under real-world conditions?

This theme explores supervised learning algorithms, active learning, feature selection, and signal preprocessing techniques tailored to wearable sensor data (IMU, accelerometers, gyroscopes) for efficient and accurate HAR. The focus includes improving sample efficiency to handle noisy, high-dimensional data with limited labeled trials, personalization for users, and real-time classification essential for mobile and pervasive computing environments.

Key finding: Presented an active learning framework to reduce required labeled samples by querying uncertain data points, alongside an intelligent motif-based feature selection that transformed raw IMU time series into symbolic... Read more
Key finding: Using smartphone accelerometer and gyroscope data from 30 participants, this study applied supervised machine learning (SVM, Random Forest) with statistical and frequency domain features extracted over sliding windows. The... Read more
Key finding: Combined logistic model trees with One R feature selection, identifying 33 relevant features leading to a high recall and precision (~95%) in classifying activities of daily living for elderly subjects affected by... Read more
Key finding: Collected and analyzed real-world longitudinal accelerometer data from wrist-worn devices highlighting the discrepancy between lab-based HAR model performance and real-world conditions. The study explored personalization... Read more

3. How can vision-based HAR systems address challenges such as occlusion, viewpoint variation, and temporal complexity using hierarchical and layered probabilistic models?

This theme focuses on the use of computer vision data and advanced probabilistic frameworks like Hidden Markov Models (HMMs), Dynamic Bayesian Networks (DBNs), and layered hierarchical models for robust activity recognition despite challenges like occlusion and viewpoint changes. It also covers real-time multimodal fusion for complex temporal sequence modeling suited for smart office and domestic environments.

Key finding: Proposed Layered Hidden Markov Models (LHMMs) to model human activities at multiple temporal granularities, enabling real-time inference from multimodal inputs including video and audio. The hierarchical approach alleviated... Read more
Key finding: Utilized 3D skeleton features extracted from low-cost depth cameras (e.g., Kinect) combined with Dynamic Bayesian Networks (DBN) weighted by joint informativeness. By learning importance weights for joints per activity, this... Read more
Key finding: Investigated the impact of partial occlusion on vision-based HAR and proposed simulating occlusion by discarding subsets of joints in skeleton data. Highlighted the performance degradation caused by occlusion and stressed the... Read more

All papers in Human Activity Recognition

Human activity recognition (HAR) is essential for healthcare, surveillance, smart homes, and human-computer interaction, but traditional approaches relying on handcrafted features and shallow machine learning models often fail to capture... more
Members of my family who understood my busy days. In particular, my wife and my parents. The Professors Ricardo Rabelo, Antonio Loureiro, Bruce Thomas and Mark Billinghurst for having patience with me and give me directions to conclude... more
Video surveillance is an extensively used tool due to the high rate of atypical behavior and many cameras that enable video capture and storage. Unfortunately, most of these cameras are operator dependent for stored content analysis. This... more
Cette communication présente une méthode de recherche approximative des plus proches voisins (APPV) modérément sûre mais très efficace. Nous partons d'une méthode de recherche APPV se basant sur des distances entre données quantifiées... more
Group abnormal behaviors often occur abruptly under video surveillance, thus bringing serious consequences. How to recognize these behaviors correctly has always been the difficulty in research on intelligence video surveillance. This... more
Gait analysis has been recognized as an efficient method to help realize human activity recognition; however, there is currently no existing review study focused on wearable activity recognition methods that employ gait analysis in the... more
Je tiens à remercier sincèrement mes directeurs de recherche, le professeur Shengrui Wang, et la professeure Hélène Pigot, pour la pertinence de leur encadrement, leurs valeureux conseils et encouragements, et surtout pour leurs qualités... more
This review paper examines the integration of Explainable AI (XAI) techniques into abnormal human activity detection from surveillance videos, emphasizing their significance in enhancing transparency, accountability, and trustworthiness... more
ien que de nos jours, il existe de nombreux outils logiciels conviviaux pour les calculs scientifiques et la simulation de réseaux électriques, on ne disposait pas encore d'outils satisfaisants aux besoins spécifiques de la modélisation... more
Hidden Markov Models (HMMs) are learning methods for pattern recognition. The probabilistic HMMs have been one of the most used techniques based on the Bayesian model. First-order probabilistic HMMs were adapted to the theory of belief... more
Human Activity Recognition (HAR) from sensors has real-world applications such as fall detection of elderly or improvement in human-robot interactions, but privacy is of concern in videos of such applications. We investigated the... more
New mobile applications need to estimate user activities by using sensor data provided by smart wearable devices and deliver context-aware solutions to users living in smart environments. We propose a novel hybrid data fusion method to... more
Automatically recognizing the e-learning activities is an important task for improving the online learning process. Probabilistic graphical models such as Hidden Markov Models and Conditional Random Fields have been successfully used in... more
by Stella Ansah and 
1 more
Gait analysis has been recognized as an efficient method to help realize human activity recognition; however, there is currently no existing review study focused on wearable activity recognition methods that employ gait analysis in the... more
The healthcare industry is facing a number of challenges including skyrocketing costs, medical error incidence, inadequate staffing in hospitals and lack of coverage in rural and underserved urban areas. Healthcare workers are under... more
Parkinson disease affect bodily functions and there is a growing need for advanced solutions to offer therapeutic advice to patients. A framework using arti-facial intelligence and machine learning techniques has been proposed to address... more
Human-human interaction recognition is crucial in computer vision fields like surveillance, human-computer interaction, and social robotics. It enhances systems' ability to interpret and respond to human behavior precisely. This research... more
In the fields of body-worn sensors and computer vision, current research is being done to track and detect falls and activities of daily living using the automatic recognition of human actions. In the area of human-machine communication,... more
Recognition of human locomotor activities is crucial for monitoring the motion patterns. Current studies for human locomotor activities recognition focused on detecting basic motion patterns. In this study, we proposed a... more
The sensory acquisition of the environment is the most important task of mobile robotics, as it is the foundation for any ability that the robot shall have, later on. Sophisticated tasks require an environment model for path planning,... more
Human activity encompasses a series of complex spatiotemporal processes that are difficult to model, but represents an essential component of human exposure assessment. A significant empirical data source like the American Time Use Survey... more
Parkinson's disease is a common neurological disease, entailing a multitude of motor deficiency symptoms. In this project, we developed a device with an uploaded edge machine learning algorithm that can detect the onset of freezing of... more
Los sensores RGB-D han permitido atacar de forma novedosa muchos de los problemas clásicos en visión por computador, tales como la segmentación, la representación de escenas, la interacción humano-computador, entre otros. Con respecto a... more
Unintentional falls are a major public health concern for many communities, especially with aging populations. There are various approaches used to classify human activities for fall detection. Related studies have employed wearable,... more
Automatic hand gesture recognition plays a fundamental role in current research with the aim of empowering a natural communication between users and virtual reality systems. Starting from an existing work, based on the extraction of two... more
Human activity recognition (HAR) plays an important role in every spheres of life as it assists in fitness tracking, health monitoring, elderly care, user authentication and management of smart homes. The assistive applications can be... more
In this paper we address the task of recognizing assembly actions as a structure (e.g. a piece of furniture or a toy block tower) is built up from a set of primitive objects. Recognizing the full range of assembly actions requires... more
In this paper we address the task of recognizing assembly actions as a structure (e.g. a piece of furniture or a toy block tower) is built up from a set of primitive objects. Recognizing the full range of assembly actions requires... more
Hearing about the violent conditioning that do on a diurnal base around the world is relatively inviting. particular safety and social stability are seriously hovered by the violent conditioning. A variety of styles have been tried to... more
Hearing about the violent conditioning that do on a diurnal base around the world is relatively inviting. particular safety and social stability are seriously hovered by the violent conditioning. A variety of styles have been tried to... more
Hearing about the violent conditioning that do on a diurnal base around the world is relatively inviting. particular safety and social stability are seriously hovered by the violent conditioning. A variety of styles have been tried to... more
The fast-paced growth of Human Resource Management requires intelligent and sustainable shortlisting models to maximize recruitment efficiency, fairness, and transparency in decision-making. This work proposes a Temporal Convolutional... more
6.4 Accuracy (%) when averaging the test-link predictions of models trained on all links from the training room . . . . . . . . . 134 6.5 Accuracy (%) when models are trained with the best or all the links from the other rooms, and tested... more
6.4 Accuracy (%) when averaging the test-link predictions of models trained on all links from the training room . . . . . . . . . 134 6.5 Accuracy (%) when models are trained with the best or all the links from the other rooms, and tested... more
In this paper we present the implementation of an activity recognition system based on a data acquisition system with sensors for acceleration and physiological parameters. In order to recognize more complex activities we need data... more
In this paper we present the implementation of an activity recognition system based on a data acquisition system with sensors for acceleration and physiological parameters. In order to recognize more complex activities we need data... more
This paper presents low cost Inertial Navigation Module, using MEMS sensor and an simple onboard microcontroller data processing (Kalman filters, basic interpretation for data). GPS navigation solutions are investigated, but they... more
This paper presents a study of using telepresence and assistance robots in caring for elderly people. We have presented the requirements for these types of robots and possible application fields. Few models of robots will be presented,... more
The digital data knowledge discovery and data mining due to their immense growth have engrossed a great deal of deliberation in recent years. Numerous applications, such as market investigation and business society, can be promoted by use... more
One of the imperative mining used in data mining is the association rule mining which mines many eventual information and association from outsized databases. The Association rule mining has many research challenges. The generation of... more
Ubiquitous Life Care (u-Life care) nowadays becomes more attractive to computer science researchers due to a demand on a high quality and low cost of care services at anytime and anywhere. Many works exploit sensor networks to monitor... more
Using the UCI-HAR dataset, this paper examines human activity recognition (HAR) from the perspectives of data science and artificial intelligence. The primary objective is to present and evaluate the effectiveness of a multi-layer... more
Les chiffres désaisonnalisés sont la source d'information la plus utilisée par les utilisateurs de statistiques officielles, plus particulièrement par les analystes et les chercheurs. Eurostat fournit des séries économiques... more
This paper introduces a new 3D skeleton-based gait recognition method for motion captured by a low-cost consumer level camera, namely the Kinect. We propose a new representation of human gait signature based on the spatio-temporal changes... more
Dans ce travail de thèse, nous nous intéressons à la qualité des informations récoltées par des capteurs sur le web. Ces données forment des séries de données temporelles qui sont incomplètes et imprécises, et sont sur des échelles... more
Robots for the elderly are a particular category of home assistive robots, helping people in the execution of daily life tasks to extend their independent life. Such robots should be able to determine the level of independence of the user... more
Using the UCI-HAR dataset, this paper examines human activity recognition (HAR) from the perspectives of data science and artificial intelligence. The primary objective is to present and evaluate the effectiveness of a multi-layer... more
This paper presents a human action recognition method using dynamic time warping and voting algorithms on 3D human skeletal models. In this method human actions, which are the combinations of multiple body part movements, are described by... more
Download research papers for free!