This book analyzes the multimodal verbal and nonverbal behavior of
humans in both an artificial game, based on the well-known Mafia and
Resistance games, as well as selected other settings. This book develops
statistical results linking different types of facial expressions (e.g.
smile, pursed lips, raised eyebrows), vocal features (e.g., pitch,
loudness) and linguistic features (e.g., dominant language, turn length)
with both unary behaviors (e.g. is person X lying?) to binary behaviors
(Is person X dominant compared to person Y? Does X trust Y? Does X like
Y?). In addition, this book describes machine learning and computer
vision-based algorithms that can be used to predict deception, as well
as the visual focus of attention of people during discussions that can
be linked to many binary behaviors. It is written by a multidisciplinary
team of both social scientists and computer scientists.
Meetings are at the very heart of human activity. Whether you are
involved in a business meeting or in a diplomatic negotiation, such an
event has multiple actors, some cooperative and some adversarial. Some
actors may be deceptive, others may have complex relationships with
others in the group. This book consists of a set of 11 chapters that
describe the factors that link human behavior in group settings and
attitudes to facial and voice characteristics.
Researchers working in social sciences (communication, psychology,
cognitive science) with an interest in studying the link between human
interpersonal behavior and facial/speech/linguistic characteristics will
be interested in this book. Computer scientists, who are interested in
developing machine learning and deep learning based models of human
behavior in group settings will also be interested in purchasing this
book.