Datasets
Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset
A large-scale collection of over 4,000 hours of face-to-face interaction footage
from over participants (n = 4000) in diverse contexts for social AI research.
Primary Article/Citation: Agrawal et al. (2025)
Website: https://ai.meta.com/research/seamless-interaction/
Open Access: https://github.com/facebookresearch/seamless_interactionDynAMoS: Dynamic Affective Movie Clip Database for Subjectivity Analysis
A curated collection of affective movie clips (n = 22), metadata about those clips, and
ratings of the emotional content of those movie clips from research participants (n = 83)
Primary Article/Citation: Girard, Tie, & Liebenthal (2023)
Website/Request Access: https://dynamos.mgb.orgGFT: Group Formation Task Spontaneous Facial Expression Database
A 2D video database of spontaneous behavior during unscripted social interactions
Complete with frame-level FACS annotations of facial behavior (n = 96)
Primary Article/Citation: Girard et al. (2017)
Website/Request Access: http://osf.io/7wcyzMMSE/BP4D+: Multimodal Spontaneous Emotion Database
An extension of BP4D that includes thermal and physiological data
Complete with frame-level FACS annotations of facial behavior (n = 140)
Primary Article/Citation: Zhang et al. (2016)
Website/Request Access: http://bit.ly/2yg39CnBP4D: Binghamton-Pittsburgh 4D Spontaneous Emotion Database
A 3D video database of spontaneous behavior during emotion elicitation
Complete with frame-level FACS annotations of facial behavior (n = 41)
Primary Article/Citation: Zhang et al. (2014)
Website/Request Access: http://bit.ly/2yg39Cn
Software
Statistics Software:
- circumplex - A stable R package for analyzing and visualizing circular data.
- mReliability - A stable (but approaching end-of-life) set of MATLAB functions for estimating inter-rater reliability.
- wcc - An experimental R package for conducting windowed cross-correlation analyses.
- varde - An experimental R package for decomposing the variance in mixed effects models.
- agreement - An experimental R package for estimating inter-rater reliability.
Research Software:
- CARMA - A stable (but approaching end-of-life) software for collecting continuous media annotations.
- DARMA - A stable (but approaching end-of-life) software for collecting continuous two-dimensional media annotations.
- tidymedia - An experimental R package for working with audio, video, and image files.
- openac - An experimental R package for automating common affective computing (and social signal processing) tasks.
- facs - An experimental R package for working with Facial Action Coding System (FACS) data.
- hitop - An experimental R package for working with Hierarchical Taxonomy of Psychopathology (HiTOP) data.
Quarto Extensions
- lordicon - A stable Quarto extension for embedding animated Lordicon icons in HTML.
- honeypot - An experimental Quarto extension for detecting LLM cheating on HTML assignments.
- details - A stable Quarto extension for embedding interactive details blocks in HTML documents.
- embedpdf - A stable (but questioning) Quarto extension for embedding PDF files in HTML.
Docker Images:
- rstudio2u - A multiarchitecture (amd64/arm64) image combining rstudio and r2u
- rocker-bayes - A multiarchitecture (amd64/arm64) image for Bayesian analysis in R
- wsl-whisper - A WSL (amd64) image for AI transcription from R with CUDA-support