Stanford University · Islam Lab · Foundation models for single-cell biology

A vision foundation model for single-cell biology via spatial gene cartography

scVision renders each cell as a continuous image and learns one frozen representation by masked-image modelling — the most accurate zero-shot annotator on every held-out human atlas we tested.

Ridvan Yesiloglu1, Sakib Mostafa2, James Zou1,3,4, Ash Alizadeh5, Jiajun Wu4, Lei Xing1,2,6, Ehsan Adeli3,4,7,✉, Md Tauhidul Islam2,✉

1Electrical Engineering · 2Radiation Oncology · 3Biomedical Data Science · 4Computer Science · 5Medicine (Oncology) · 6Institute for Computational & Mathematical Engineering · 7Psychiatry & Behavioral Sciences — Stanford University ✉ Correspondence: tauhid@stanford.edu · eadeli@stanford.edu

6 / 6
Most accurate zero-shot annotator on every held-out atlas
72M
Human cells for masked-image pretraining
>50×
Fewer labels than classical baselines
37–300×
Faster than token foundation models
scVI-tied
On integration, with no batch labels
Overview of scVision: cells become continuous images via optimal transport, a vision transformer is pretrained by masked image modelling, and the frozen encoder supports zero-shot annotation, integration, gene-program inference, perturbation and disease axes.
How scVision works. a, Optimal transport places informative genes at fixed positions on one shared lattice; painting a cell's expression onto it renders the transcriptome as a continuous image (an scImage). b, A ViT-base encoder is trained as a masked autoencoder, reconstructing hidden image patches with no labels. c, The single frozen encoder supports cell-type annotation, multi-study integration, gene-program inference, perturbation response and a disease axis.
The idea

A better representation, not a bigger model.

Most single-cell foundation models borrow the design of language models, treating a cell as a sequence of gene tokens. That discards the relationships among genes and often the magnitude of their expression — and no amount of extra scale can put that structure back.

scVision changes the representation itself. Using optimal transport, it lays roughly eleven thousand informative genes at fixed positions on a single, shared, pan-tissue map, arranged so that genes which tend to act together become spatial neighbours. Projecting any cell's measured expression onto this common map turns its transcriptome into an image, where coordinated gene programs appear as local texture and overall cellular identity as global pattern. Because the layout is shared across every cell and tissue, a cell is always the same fixed-size image — no matter how many genes were measured. This recasts single-cell representation learning as a computer-vision problem, so that mature image models can be brought to biology through a change in how a cell is represented.

Method

Three steps, one frozen encoder.

1

Spatial gene cartography

Optimal transport places the 10,816 most informative genes at fixed coordinates on a single 104×104 lattice, shared across all cells. Painting a cell's expression onto it renders the transcriptome as a continuous scImage.

2

Masked-image pretraining

A ViT-base encoder (~86M parameters) is trained as a masked autoencoder on 72 million of ~94 million human cells — reconstructing 75% hidden image patches, with no cell-type labels.

3

Frozen, zero-shot transfer

The encoder is used exactly as trained — frozen, no fine-tuning — to annotate cell types, integrate studies, read gene programs from attention, probe perturbations and trace disease axes on held-out data.

Explore · interactive

See a cell become an image.

Choose a cell type to render its transcriptome onto the shared gene lattice as an scImage, hide most of the patches, and watch a masked-autoencoder‑style reconstruction fill it back in — the three steps scVision's pretraining is built on, running live in your browser.

Expression Gene cartography scImage Mask Reconstruct
Cell type illustrative
Masking ratio 75%

A schematic scImage is generated in your browser from a fixed gene layout: co-regulated “programs” form local blobs, so different cell types look different. Illustrative — not real model output.

scImage 104×104
Masked input 75% hidden
Reconstruction illustrative
Key findings

What the frozen representation delivers.

Zero-shot annotation Accuracy

The frozen embedding is the most accurate zero-shot annotator on all six held-out human atlases — kidney, ovary, retina, focal cortical dysplasia, Crohn's-disease ileum and a 53-type multi-organ reference — ahead of scGPT, scFoundation, Geneformer and strong classical baselines.

Label efficiency Few-shot

A single labelled cell per type reaches an accuracy that the best classical method needs roughly fifty labels to match — more than a fifty-fold reduction in the annotation effort that adopting a new dataset usually demands.

Cross-study integration Integration

Without ever being shown a batch label, scVision matches scVI and scGPT on the combined scIB score while conserving more biological structure than any method tested.

Robust to missing data Robustness

The spatial layout degrades gracefully. With 70% of input genes randomly removed, scVision retains most of its balanced accuracy, while the classical HVG-kNN baseline collapses toward chance.

Interpretable & controllable Biology

Attention maps read directly as gene programs that recur across organs with no pathway supervision, and spatial masking perturbs a whole neighbourhood of co-regulated genes as a single unit.

The decisive control Why it works

Permuting the gene-to-position layout — holding the network and data fixed — lowers accuracy several times more than removing the vision transformer entirely. The biologically meaningful arrangement of genes, not the network, carries the signal.

Benchmarks · interactive

Explore the numbers.

Every value here is read straight from the paper's evaluation files. Switch views to compare scVision with token foundation models and classical baselines.

 

Abstract

Single-cell transcriptomics has made it possible to measure gene expression in tens of millions of individual cells, revealing cellular diversity that bulk profiling cannot resolve. Foundation models aim to learn general representations from these large datasets that can be reused across many biological tasks. However, most current single-cell foundation models are adapted from language models and represent each cell as a set or sequence of gene tokens. This design has two limitations. It treats genes as largely unordered inputs, even though genes act together in coordinated programs, and it often requires expression values to be discretized or ranked, losing quantitative information about expression magnitude.

Here we present scVision, a vision foundation model for single-cell biology. Instead of converting genes into tokens, scVision represents each cell as a continuous gene-expression image. It assigns genes to fixed spatial positions using optimal transport, so that genes with related expression patterns are placed near one another and coordinated gene programs form local image regions. The resulting image preserves both the quantitative expression level of each gene and the biological relationships among genes. We pretrain a vision transformer with masked image modelling on 72 million human cells, creating one of the largest pretrained models for single-cell analysis.

In zero-shot evaluations across six independent, held-out studies, frozen scVision representations outperform existing foundation models and classical baselines in cell-type annotation and gene-program discovery, without task-specific retraining. On multi-study integration, scVision matches the strongest token-based foundation model on the combined benchmark score and conserves more biological structure than any method tested. The spatial organization of scVision also improves interpretability: image regions correspond to groups of co-expressed genes, and attention maps can be read as gene-program activity. This structure also enables spatial masking experiments, in which a neighborhood of related genes is perturbed as a single unit, an operation with no direct counterpart in token-based foundation models. By preserving continuous gene-expression values and giving genes biologically meaningful positions, scVision reframes single-cell representation learning as a vision problem. This approach retains more of the original transcriptomic signal while opening a direct path for applying modern computer vision methods to single-cell biology.

Cite this work

BibTeX

@article{yesiloglu2026scvision,
  title   = {A vision foundation model for single-cell biology via spatial gene cartography},
  author  = {Yesiloglu, Ridvan and Mostafa, Sakib and Zou, James and
             Alizadeh, Ash and Wu, Jiajun and Xing, Lei and
             Adeli, Ehsan and Islam, Md Tauhidul},
  year    = {2026},
  note    = {Preprint},
  url     = {https://islamlab.org/scvision}
}

This citation will be updated with the arXiv identifier or journal reference once available.

Authors

Team

Ridvan YesilogluElectrical Engineering · lead author
Sakib MostafaRadiation Oncology
James ZouBiomedical Data Science · CS
Ash AlizadehMedicine, Oncology
Jiajun WuComputer Science
Lei XingRadiation Oncology · EE · ICME
Ehsan Adeli Psychiatry & Behavioral Sciences · CS — corresponding
Md Tauhidul Islam Radiation Oncology · corresponding · Islam Lab