Activity analysis in crowded environments using social cues for group discovery and human interaction modeling

K. N. Tran, A. Gala, I. A. Kakadiaris, S. K. Shah

Research output: Contribution to journalArticlepeer-review

41 Scopus citations

Abstract

This paper presents a novel and efficient framework for group activity analysis. People in a scene can be intuitively represented by an undirected graph where vertices are people and the edges between two people are weighted by how much they are interacting. Social signaling cues are used to describe the degree of interaction between people. We propose a graph-based clustering algorithm to discover interacting groups in crowded scenes. Two social signaling cues are presented and compared for group discovery. The grouping of people in the scene serves to isolate the groups engaged in the dominant activity, effectively eliminating dataset contamination. Using discovered interacting groups, we create a descriptor capturing the motion and interaction of people within it. A bag-of-words approach is used to represent group activity and a SVM classifier is used for activity recognition. The proposed framework is evaluated in its ability to discover interacting groups and perform group activity recognition using two public datasets. The overall recognition system is compared to a baseline top-down model to understand the impact of social cues for activity recognition. The results of both the steps show that our method outperforms state-of-the-art methods for group discovery and achieves recognition rates comparable to state-of-the-art methods for group activity recognition.

Original languageEnglish (US)
Pages (from-to)49-57
Number of pages9
JournalPattern Recognition Letters
Volume44
DOIs
StatePublished - Jul 15 2014

Keywords

  • Crowd analysis
  • Graph clustering
  • Group activity recognition
  • Local group activity descriptor
  • Social signaling

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Activity analysis in crowded environments using social cues for group discovery and human interaction modeling'. Together they form a unique fingerprint.

Cite this