Stanford University · Islam Lab · Foundation models for single-cell biology

A vision foundation model for single-cell biology via spatial gene cartography

scVision renders each cell as a continuous image and learns one frozen representation by masked-image modelling — the most accurate zero-shot annotator on every held-out human atlas we tested.

Ridvan Yesiloglu1, Sakib Mostafa2, James Zou1,3,4, Ash Alizadeh5, Jiajun Wu4, Lei Xing1,2,6, Ehsan Adeli3,4,7,✉, Md Tauhidul Islam2,✉

1Electrical Engineering · 2Radiation Oncology · 3Biomedical Data Science · 4Computer Science · 5Medicine (Oncology) · 6Institute for Computational & Mathematical Engineering · 7Psychiatry & Behavioral Sciences — Stanford University ✉ Correspondence: tauhid@stanford.edu · eadeli@stanford.edu

6 / 6
Most accurate zero-shot annotator on every held-out atlas
72M
Human cells for masked-image pretraining
>50×
Fewer labels than classical baselines
37–300×
Faster than token foundation models
scVI-tied
On integration, with no batch labels
Video 1 scVision in 60 seconds. A cell's raw counts, the optimal-transport map that gives every gene a fixed home, the frozen encoder reading the resulting scImage, and a real held-out cell annotated live. Every frame is driven by real data — real rendered genomaps, the real gene‑to‑lattice layout, and real model output from the live service. Nothing is simulated. 60 s · no sound.
Video 2 Run it on your own cells. The actual interface, shown on an example PBMC dataset (Broad SCP424): start a project, drop your raw‑count matrix (.h5ad, a 10x triplet, or CSV/TSV), and scVision renders every cell as an scImage, reads it with the frozen encoder on the lab GPU, and annotates it zero‑shot against a 355‑type atlas — then click any cell for its scImage and attention, or open the marker and pathway tables. Try it at app.islamlab.org/scvision. ~23 s · no sound.
Overview of scVision: cells become continuous images via optimal transport, a vision transformer is pretrained by masked image modelling, and the frozen encoder supports zero-shot annotation, integration, gene-program inference, perturbation and disease axes.
Figure 1 How scVision works. a, Optimal transport places informative genes at fixed positions on one shared lattice; painting a cell's expression onto it renders the transcriptome as a continuous image (an scImage). b, A ViT-base encoder is trained as a masked autoencoder, reconstructing hidden image patches with no labels. c, The single frozen encoder supports cell-type annotation, multi-study integration, gene-program inference, perturbation response and a disease axis.
The idea

A better representation, not a bigger model.

Most single-cell foundation models borrow the design of language models, treating a cell as a sequence of gene tokens. That discards the relationships among genes and often the magnitude of their expression — and no amount of extra scale can put that structure back.

scVision changes the representation itself. Using optimal transport, it lays roughly eleven thousand informative genes at fixed positions on a single, shared, pan-tissue map, arranged so that genes which tend to act together become spatial neighbours. Projecting any cell's measured expression onto this common map turns its transcriptome into an image, where coordinated gene programs appear as local texture and overall cellular identity as global pattern. Because the layout is shared across every cell and tissue, a cell is always the same fixed-size image — no matter how many genes were measured. This recasts single-cell representation learning as a computer-vision problem, so that mature image models can be brought to biology through a change in how a cell is represented.

Method

Three steps, one frozen encoder.

1

Spatial gene cartography

Optimal transport places the 10,816 most informative genes at fixed coordinates on a single 104×104 lattice, shared across all cells. Painting a cell's expression onto it renders the transcriptome as a continuous scImage.

2

Masked-image pretraining

A ViT-base encoder (~86M parameters) is trained as a masked autoencoder on 72 million of ~94 million human cells — reconstructing 75% hidden image patches, with no cell-type labels.

3

Frozen, zero-shot transfer

The encoder is used exactly as trained — frozen, no fine-tuning — to annotate cell types, integrate studies, read gene programs from attention, probe perturbations and trace disease axes on held-out data.

Explore · interactive

See a real cell become an image.

Pick a real held-out cell to see its transcriptome rendered onto the shared gene lattice as an scImage, then hide patches of it and watch what the frozen encoder still reads from what is left — the real model, running live on the cell in front of you.

Expression Gene cartography scImage Mask scVision reads it
Cell type real held-out cells
Loading real cells…
Masking ratio 25%

Real scImages, rendered from held-out cells by the same optimal-transport gene cartography used in pretraining — every cell painted onto one shared lattice. Masking hides patches of the real input; the frozen encoder then re-reads the cell.

scImage real · 104×104
Masked input 25% hidden
Key findings

What the frozen representation delivers.

Zero-shot annotation Accuracy

The frozen embedding is the most accurate zero-shot annotator on all six held-out human atlases — kidney, ovary, retina, focal cortical dysplasia, Crohn's-disease ileum and a 53-type multi-organ reference — ahead of scGPT, scFoundation, Geneformer and strong classical baselines.

Label efficiency Few-shot

A single labelled cell per type reaches an accuracy that the best classical method needs roughly fifty labels to match — more than a fifty-fold reduction in the annotation effort that adopting a new dataset usually demands.

Cross-study integration Integration

Without ever being shown a batch label, scVision matches scVI and scGPT on the combined scIB score while conserving more biological structure than any method tested.

Robust to missing data Robustness

The spatial layout degrades gracefully. With 70% of input genes randomly removed, scVision retains most of its balanced accuracy, while the classical HVG-kNN baseline collapses toward chance.

Interpretable & controllable Biology

Attention maps read directly as gene programs that recur across organs with no pathway supervision, and spatial masking perturbs a whole neighbourhood of co-regulated genes as a single unit.

The decisive control Why it works

Permuting the gene-to-position layout — holding the network and data fixed — lowers accuracy several times more than removing the vision transformer entirely. The biologically meaningful arrangement of genes, not the network, carries the signal.

Benchmarks · interactive

Explore the numbers.

Every value here is read straight from the paper's evaluation files. Switch views to compare scVision with token foundation models and classical baselines.

 

Integration

One space, many studies.

Without ever seeing a batch label, scVision embeds cells from dozens of independent studies into a single space where cell types cluster and studies intermingle. Colour by cell type to see the biology; colour by study to watch the batches mix.

2D PCA of scVision's frozen embedding — venous blood, 82 independent studies, 8 major immune cell types. The full scIB integration scores are in the Benchmarks tab.

Disease axis

A frozen embedding that tracks disease.

From scVision's frozen embedding of dilated-cardiomyopathy hearts, a single linear disease axis separates diseased from healthy cells — and it transfers to a different disease it never saw, hypertrophic cardiomyopathy, scoring diseased cells higher than healthy ones better than raw expression does. No disease labels were used to train the encoder.

Axis score — diseased vs. healthy hypertrophic cardiomyopathy · cross-assay
0.60
scVision AUROC
(cross-assay)
0.48
raw expression
(cross-assay)
0.95
in-domain
(dilated CM)
What drives the axis integrated gradients on the scImage
Integrated-gradients attribution over the gene lattice: which regions of the scImage push a cell along the cardiomyopathy axis.
coral pushes toward disease · blue away
Top axis genes:

The axis is a single linear direction in the frozen 768-dimensional space. In-domain (dilated cardiomyopathy) detection reaches AUROC 0.95; transferred to a different cardiomyopathy it stays above chance (0.60) and ahead of raw expression (0.48).

Abstract

Single-cell transcriptomics has made it possible to measure gene expression in tens of millions of individual cells, revealing cellular diversity that bulk profiling cannot resolve. Foundation models aim to learn general representations from these large datasets that can be reused across many biological tasks. However, most current single-cell foundation models are adapted from language models and represent each cell as a set or sequence of gene tokens. This design has two limitations. It treats genes as largely unordered inputs, even though genes act together in coordinated programs, and it often requires expression values to be discretized or ranked, losing quantitative information about expression magnitude.

Here we present scVision, a vision foundation model for single-cell biology. Instead of converting genes into tokens, scVision represents each cell as a continuous gene-expression image. It assigns genes to fixed spatial positions using optimal transport, so that genes with related expression patterns are placed near one another and coordinated gene programs form local image regions. The resulting image preserves both the quantitative expression level of each gene and the biological relationships among genes. We pretrain a vision transformer with masked image modelling on 72 million human cells, creating one of the largest pretrained models for single-cell analysis.

In zero-shot evaluations across six independent, held-out studies, frozen scVision representations outperform existing foundation models and classical baselines in cell-type annotation and gene-program discovery, without task-specific retraining. On multi-study integration, scVision matches the strongest token-based foundation model on the combined benchmark score and conserves more biological structure than any method tested. The spatial organization of scVision also improves interpretability: image regions correspond to groups of co-expressed genes, and attention maps can be read as gene-program activity. This structure also enables spatial masking experiments, in which a neighborhood of related genes is perturbed as a single unit, an operation with no direct counterpart in token-based foundation models. By preserving continuous gene-expression values and giving genes biologically meaningful positions, scVision reframes single-cell representation learning as a vision problem. This approach retains more of the original transcriptomic signal while opening a direct path for applying modern computer vision methods to single-cell biology.

Cite this work

BibTeX

@article{yesiloglu2026scvision,
  title         = {A vision foundation model for single-cell biology via spatial gene cartography},
  author        = {Yesiloglu, Ridvan and Mostafa, Sakib and Zou, James and
                   Alizadeh, Ash and Wu, Jiajun and Xing, Lei and
                   Adeli, Ehsan and Islam, Md Tauhidul},
  year          = {2026},
  eprint        = {2607.14163},
  archivePrefix = {arXiv},
  primaryClass  = {q-bio.QM},
  url           = {https://arxiv.org/abs/2607.14163}
}

Preprint on arXiv: arXiv:2607.14163 [q-bio.QM] · submitted 15 July 2026. This citation will be updated with the journal reference once available.

Authors

Team

Ridvan YesilogluElectrical Engineering · lead author
Sakib MostafaRadiation Oncology
James ZouBiomedical Data Science · CS
Ash AlizadehMedicine, Oncology
Jiajun WuComputer Science
Lei XingRadiation Oncology · EE · ICME
Ehsan Adeli Psychiatry & Behavioral Sciences · CS — corresponding
Md Tauhidul Islam Radiation Oncology · corresponding · Islam Lab