United States

The analysis of large data sets for several purposes is a growing requirement for many professions. Tactile charts are suitable to enable people with visual impairment and blindness performing data analysis tasks. However, few approaches focus on the development of tactile charts for data analysis purposes. Concepts are needed to enable the representation of a sufficient amount of data with tactile charts and to address arising challenges, such as information overload. In this paper, we first discuss and analyse the scalability of data represented by tactile charts, using the example of tactile scatterplots. We further address the data size limitations and propose a workflow for identifying critical, tactile representation with limited readability respecting the analysis task. Moreover, we propose concepts to increase the represented amount of data in tactile scatterplots. Based on our analysis results, we introduce tactile heatmaps as an innovative and new concept to represent data
for the haptic sense. Therefore, we developed a design for tactile heatmaps by utilising different elevation levels. We evaluated the concept as well as the feasibility of different elevation levels with 11 blind and visually impaired people. Four design conditions for embossed tactile heatmaps were compared. We further evaluated
the suitability of 3D-printed heatmaps. The results show that tactile heatmaps are suitable for representing more data than previously known tactile representation methods. They support obtaining an overview of a high amount of data and can be applied for data analysis purposes.

PETRA 2021

Tactile Heatmaps: A Novel Visualisation Technique for Data Analysis with Tactile Charts

haptification

tactile information visualisation

heatmap

tactile charts

tactile data analysis

accessible charts

 **RTSS 2021** has successfully concluded. Hope you have enjoyed it, and look forward to seeing you next year in person.
    Announcement for the Awards:
 * Best Paper Award goes to: Monte Carlo Response-Time Analysis, Sergey Bozhko, Georg von der Brüggen, and Björn Brandenburg
 * Best Student Paper Award goes to: Automatic Energy-Hotspot Detection and Elimination in Real-Time Deeply Embedded Systems, Mohsen Shekarisaz, Lothar Thiele, and Mehdi Kargahi.
 * Best Solution Award for Industry Session goes to: Toward Real-Time Guaranteed Scheduling for Autonomous Driving Systems. Jinghao Sun, Tianyi Wang, Kailu Duan, Bin Lu, Jiankang Ren, Zhishan Guo, and Guozhen Tan.



IEEE RTSS 2021

The IEEE Real-Time Systems Symposium (RTSS) is the premier conference in the field of real-time systems, and is a venue for researchers and practitioners to showcase innovations covering all aspects of real-time systems, including theory, design, analysis, implementation, evaluation, and experience. 

technical paper

**About**
 The PErvasive Technologies Related to Assistive Environments (PETRA) conference is a highly interdisciplinary conference that focuses on computational and engineering approaches to improve the quality of life and enhance human performance in a wide range of settings, in the workplace, at home, in public spaces, urban environments, and other. Outcomes of this conference have a broad impact in application areas that include, manufacturing, transportation, healthcare, energy systems, security and safety, robotics, biomedicine, environment and conservation, and many others. PETRA brings together very different types of technologies to also address important social and healthcare issues for sensitive populations, such as the elderly, persons suffering from chronic conditions such as Alzheimer’s, Parkinson’s, Cerebral Palsy, and other disabilities or traumas.

 PETRA (which means “stone” in Greek) addresses important human living needs. From a technological perspective, PETRA motivates and inspires new scientific thrusts, innovations and discoveries to improve living environments, a particularly important issue, in an increasingly crowded and complex world where the need for inclusiveness and connectivity with the rest of the world is key. For the elderly in particular, PETRA addresses the fact that, as people grow older; they will increasingly rely on technology to be able to prolong staying in their homes and enjoy an independent life.

 The PETRA 2021 proceedings will be published in the ACM Digital Library as part of the ACM ICPS program. The ISBN number assigned to PETRA '21 is 978-1-4503-8792-7

The PErvasive Technologies Related to Assistive Environments (PETRA) conference is a highly interdisciplinary conference that focuses on computational and engineering approaches to improve the quality of life and enhance human performance in a wide range of settings, in the workplace, at home, in public spaces, urban environments, and other. Outcomes of this conference have a broad impact in application areas that include, manufacturing, transportation, healthcare, energy systems, security and safety, robotics, biomedicine, environment and conservation, and many others. PETRA brings together very different types of technologies to also address important social and healthcare issues for sensitive populations, such as the elderly, persons suffering from chronic conditions such as Alzheimer’s, Parkinson’s, Cerebral Palsy, and other disabilities or traumas.

Man overboard incidents in a maritime vessel are serious accidents where, the efficient and rapid detection is crucial in the recovery of the victim. The severity of such accidents, urge the use of intelligent systems that are able to automatically detect a fall and provide relevant alerts. To this end the use of novel deep learning and computer vision algorithms have been tested and proved efficient in problems with similar structure. This paper presents the use of a deep learning framework for automatic detection of man overboard incidents. We investigate the use of simple RGB video streams for extracting specific properties of the scene, such as movement and saliency, and use convolutional spatiotemporal autoencoders to model the normal conditions and identify anomalies. Moreover, in this work we present a dataset that was created to train and test the efficacy of our approach.

Man Overboard: Fall detection using spatiotemporal convolutional autoencoders in maritime environments

Bioinformatics systems for monitoring and mitigating epidemics: The STAMINA Paradigm

Emotion recognition is a field of psychology that involves the process of identifying emotions and treating mental conditions like autism. The advancements in the field of machine learning and deep learning have paved the way for scientists to develop models for evaluating emotions by analyzing facial expressions, speech and text. However, the task of evaluating emotions could be best done by processing the bio-signals and neural imaging of the brain. In that sense, bio-signals such as Electroencephalogram (EEG) are less expensive to use and non-invasive, giving them an edge over traditional methods like Magnetic Resonant Imaging (MRI). However,
not many datasets are publicly available due to privacy issues and their availability is highly limited by the classification task. These constraints, along with the problem of data scarcity, motivates this work as an attempt to enhance the accuracy scores by generating synthetic features that are close to actual data distribution. In this research, we propose a Wasserstein Generative Adversarial Network with gradient penalty (WGAN-GP) based model that can help tackle this problem. The dataset that is investigated is DEAP, one of the benchmark datasets for evaluating emotion recognition algorithms. In the method proposed, nine descriptive features are extracted from the original data and baseline models are evaluated. 
Subsequently, a WGAN-GP is trained on these extracted features and is used to generate a new set of synthetic data features. The synthetic features are then analysed for quality and appended to the original data to expand this dataset. Experiments with different augmentation factors (x2, x3, x4) are investigated to evaluate the impact of the data augmentation procedure. The experimental results
demonstrate that the proposed method gives a considerable enhancement of the classification task’s performance.

GAN-Based Data Augmentation For Improving The Classification Of EEG Signals

A novel deep learning methodology for the assessment of ergonomic risks in any given work-related task with high accuracy and in real-time is presented. The proposed method takes as input a video sequence, extracts 3D skeletal features using VIBE algorithm and then processes these features to predict REBA risk scores for the entire body and individual body parts. Results on two well-known datasets and against other state-of-the-art methods verify the ability of the proposed method in predicting REBA ergonomic risk scores with high accuracy.

Towards Real-time Generalized Ergonomic Risk Assessment for the Prevention of Musculoskeletal Disorders

Physiological data are nowadays frequently used to recognize the
affective state of subjects while performing different tasks. Automatic
recognition of a stressful state as a consequence of a high level
of cognitive load is significant to prevent illnesses like depression,
anxiety and sleep disorders that are often due to excessive workload.
The spread of wearable sensors that are increasingly reliable and
comfortable makes them easy to use in day-life activities. However,
due to the nature of experiments that involve subjects, the cardinality
of the acquired data is often low, making difficult to train
deep learning methods from the scratch. In this paper we consider
the photopletismography (PPG) that measures the blood volume
registered just under the skin, which can be used to obtain the heart
rate of the subject. It is well known that PPG data are particularly
relevant to detect high level of arousal that is activated by stress.
We show that, converting monodimensional photopletismography
(PPG) data into bidimensional signals it is possible to apply a pretrained
CNN, obtaining deep features that outperform handcrafted
ones in classification tasks, especially introducing feature selections
strategies to avoid curse of dimensionality.

A Deep Learning Approach to Recognize Cognitive Load using PPG Signalshttps://dl.acm.org/doi/10.1145/3453892.3461625

As access to new technologies becomes increasingly less expensive and complex, technologies such as virtual reality (VR) are also becoming interesting and relevant for applications outside consumer entertainment. Especially with VR for blind and visually impaired people, VR can overcome the limitations of real-world environments (e.g., hazardous locations and reliance on sighted companionship for training) by virtually exploring its digital model using consumer hardware. In this context, we conducted two within-subject user study with 11 and 5 participants that were asked to learn and re-walk an audio-landmark enriched path in a virtual environment. Our results showed, that the ability to learn and re-walk an audio landmark-enriched environment using an auditive only locomotion interface is possible, but yet difficult. To be able to re-walk even a simple corridor entails a relatively big training effort, but distinctive structures are recognizable again. The results also indicated that the intuitive use of controller based locomotion brings advantages over a keyboard and mouse based approach. Furthermore, we discovered different characteristics of auditive navigation (e.g., walking zigzag, in circles or collision-oriented with regard to the rooms' walls), encountered acoustic rendering problems in acute corners and were able to show a training effect when having trained a path within a virtual environment with respect to re-walking, both inside a virtual environment and outside to a physically re-walked path. This work underlines the feasibility, problems, but also chances of different locomotion implementations in VR and is intended to foster future work towards both technical and methodological optimization in this area.

Preliminary Analysis on Interaction Characteristics with Auditive Navigation in Virtual Environments

Virtual and Augmented Reality technologies are nowadays increasingly adopted as core elements of modern applications for creating unique user experiences. 
Following the capabilities of hardware and its constantly reducing cost, their use is moving from scientific and research projects to everyday life applications such as social media, architectural design and of course games.
In this work, we present a state-of-the-art exergame implementation paradigm, which can facilitate the development of exergames exploiting advanced user interactivity, augmented reality and modern gamification techniques.
The platform has been used for the development of a set of prototype games for Android phones based on the popular AR Core framework. 
The overall approach has been evaluated in real-world scenarios with exceptional usability and performance results.

On the development of augmented reality based exergames for assessing human activity and cognition on mobile devices

Increasing digitization in healthcare promises easier exchange and more efficient use of medical information for patients, institutions and research. 
The number of sharing options for medical data increases, e.g., through personal health records, as well as the volume of data.
To use this data in medical research patients' consent is important.
As more and more data access is regulated by consent forms and their complexity also increases.
For the patient, it becomes less comprehensible which information could be gained from his or her disclosed data. 
This becomes more important when presumably anonymized data has the risk of potential re-identification of an individual.
In this paper we introduce a consent-privacy-impact-quantification (CPIQ) as a risk model of consent forms for the release of personal medical data for use within research projects.
CPIQ evaluates how reasonable a consent decision is for the patient. 
It takes relevant factors such as the patient’s preferences into account, the circumstances and benefits of the research project, and the potential risk to the patient.
The model can be parameterized so that different aspects such as the benefit of the research project, the risk of a data leak or the risk of a patient’s confidential data becoming known can be represented.
We present the feasibility of this model by including it in an existing consent management system.

CPIQ - A Privacy Impact Quantification for Digital Medical Consent

In a pandemic crisis such as the one that the world has been experiencing since January 2020, utilizing remote mobile health monitoring can help monitor the cardiac health of healthy individuals as well as chronically ill patients. Apple Watch is a fitness tracker that measures heart rate and can facilitate this need due to its availability worldwide and relative affordability. Hence, it has the potential of being useful in assessing and monitoring one’s cardiac health. This paper reports the preliminary results from an ongoing study aimed at assessing the accuracy of the Apple Watch in measuring heart rate variability. To achieve the goal of the study, concurrent measurements of electrocardiogram (ECG), as a gold standard, and instantaneous Apple Watch heartrate values were made in six (4 male) age 26.4±3.2 years old volunteer healthy subjects. Both time and frequency domain measures of heartrate variability (HRV) were obtained from the recorded ECG and estimated from the Apple Watch instantaneous heartrate values. The results indicate that it may be possible to obtain a reasonable estimate of HRV time-domain and frequency-domain metrics using Apple Watch in healthy subjects.

Estimation of Heart Rate Variability Measures Using Apple Watch and Evaluating Their Accuracy

Corporate health management is an important tool for preventing work-related absenteeism, increasing overall employee satisfaction and reducing the costs of absenteeism or presenteeism in the long term. Today, corporate health management is even more important because many employees work from home. Often, there is a lack of workspace or even a workplace that meets minimum occupational health and safety guidelines. Overwork, noise pollution, incorrect sitting posture and unstructured work breaks contribute negatively to the daily work routine, as does the general problem of separating work and leisure. Under these conditions, daily work is made even more difficult, which can lead to increased mental and physical stress. A concept for unobtrusive monitoring to increase long-term health, improve working conditions or at least to show the necessary adjustments to the new work situation can help to solve these problems. This paper presents a concept that shows how a simple webcam can be used to record essential vital signs during working hours, evaluate them using machine learning, and offer intervention recommendations based on these data to reduce psychological and physical stress. Work on continuous stress measurement and the challenges associated with it will be presented. This work serves as a starting point for the development of a camera-based tool for mental and physical stress measurement in the workplace. Our approach demonstrates that the required parameters can be captured using a simple webcam and that interventions can be used to achieve long-term reductions in work-related mental and physical stress, provided that the proposed interventions are followed. The prototypical implementation shows that such a solution can work well in the workplace, but that data protection and technical limitations must be considered in the future in order to establish camera-based methods in the toolbox of workplace health management.

Downloads

Next from PETRA 2021

Man Overboard: Fall detection using spatiotemporal convolutional autoencoders in maritime environments

Similar lecture

A Multi-Level DPM Approach for Real-Time DAG Tasks in Heterogeneous Processors

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from PETRA 2021

Man Overboard: Fall detection using spatiotemporal convolutional autoencoders in maritime environments

Similar lecture

A Multi-Level DPM Approach for Real-Time DAG Tasks in Heterogeneous Processors

Downloads