Automatic recognition of pain, anxiety, engagement and tiredness for virtual rehabilitation from stroke: A marginalization approach

Virtual rehabilitation taps affective computing to personalize therapy. States of anxiety, pain and engagement (affective) and tiredness (physical or psychological) were studied to be inferable from metrics of 3D hand location-proxy of hand movement- and fingers' pressure relevant for upper limb motor recovery. Features from the data streams characterized the motor dynamics of 2 stroke patients attending 10 sessions of motor virtual rehabilitation. Experts tagged states manifestations from videos. We aid classification contributing with a marginalization mechanism whereby absent input is reconstructed. With the hand movement information absent, marginalization statistically outperformed a base model where such input is ignored. Marginalized classification performance was (Area below ROC curve: μ ± σ) 0.880 ± 0.173 and 0.738 ± 0.177 for each patient. Marginalization aid classification sustaining performance under input failure or permitting different sensing settings.