Learning gene co-regulation across cells with Multicellular Transformer
Learning gene co-regulation across cells with Multicellular Transformer
Wiatrak, M.; Andersson, A.; Hoi, K. H.; Biancalani, T.; BenTaieb, A.
AbstractUnderstanding how genes coordinate across cells is central to explaining tissue function and disease, yet most existing models still take a single cell as input and therefore emphasize cell-intrinsic regulation. We present the Multicellular Transformer (MCT), a foundation model built around a different assumption: cells function together within tissues, so the appropriate unit of input is not one cell in isolation but a set of cells from the same sample. By jointly modeling multiple cells, MCT learns context-aware gene embeddings that capture gene-gene interactions across the tissue environment. Trained on a large set of tissue samples (>4200) across more than 30 tissue types, MCT recovers ligand-receptor interactions, infers cross-cell signaling programs, and reveals spatial co-localization patterns directly from scRNA-seq data. Its contextual embeddings identify disease-specific rewiring of gene neighborhoods in systemic lupus erythematosus and COVID-19 and predict population-level perturbation effects in cancer without additional training. By linking gene-level regulation to tissue-scale organization, MCT provides a scalable framework for modeling multicellular biology and enables in silico discovery of therapeutic targets and tissue-specific dependencies.