Curriculum Vitae

Ruihan Zhang

Roboticist, Google DeepMind · PhD, MIT

Education

2021 – 2024

Massachusetts Institute of Technology Cambridge, MA

PhD in Media Arts and Sciences (Bioengineering) · GPA 5.0/5.0

Advised by Ed Boyden and Joseph Jacobson. Selected courses: Advances in Computer Vision, Advanced Natural Language Processing, Dynamic Programming and Reinforcement Learning, Tissue vs Silicon in Machine Learning, Brain Algorithms.

2019 – 2021

Massachusetts Institute of Technology Cambridge, MA

MS in Media Arts and Sciences (Bioengineering) · GPA 4.85/5.0

Selected courses: Machine Learning, Information and Inference, Computational Biology: Genomes, Networks, Evolution, Fields, Forces, and Flows in Biological Systems, Nucleic Acids.

2015 – 2019

Shanghai Jiao Tong University Shanghai, China

BS in Life Science, Zhiyuan Honor Program · GPA 93/100, rank 1 of 7

The Zhiyuan Honor Program selects the top 10% of students across majors for interdisciplinary training in small classes. Selected courses: Mathematical Analysis, Linear Algebra, Physics, Chemical Principles, Biochemistry, Neurobiology, Genetics, Digital Signal Processing, Biostatistics, Cell Biology, and their laboratories.

Jan – Mar 2018

St John's College, University of Cambridge Cambridge, UK

Lent-term exchange student, sponsored by St John's College

Experience

Nov 2026 – present

Google DeepMind Robotics Mountain View, CA

Roboticist

Moved to the robotics team in November 2026.

Dec 2024 – Oct 2026

Google XR, Semantic Perception team Mountain View, CA

Software Engineer

  • Raised the text readability of an AI conversational agent on Google Glass to match human visual acuity, so low-vision users can access text more easily. Featured in the Astra Aira Visual Interpreter demo at Google I/O 2025.
  • Led the cross-team effort on dynamic camera control for Gemini on Android XR glasses: the camera activates only when the conversation needs vision, which preserves battery life and protects user privacy. The work produced two USPTO patent applications.
May – Aug 2023

Google XR, AR Perception team Mountain View, CA

Software Engineer Intern

  • Built a system for 3D object generation conditioned on text prompts and user sketches, using a diffusion architecture with multimodal inputs. Trained an encoder for 3D object representations and rendered high-resolution outputs with neural radiance fields, for AR/VR content creation and digital asset generation.

Research

2020 – 2024

Mapping the spatial transcriptome of an entire vertebrate brain

PhD thesis · MIT · with Ed Boyden and Joseph Jacobson

  • Produced and analyzed 30 TB of in situ RNA-sequencing imaging data, with image registration, stitching, custom puncta extraction, and point-cloud registration in Python.
  • Bioinformatic analysis of a zebrafish single-nucleus RNA-seq dataset, identifying cell-type markers for about 50 neuronal clusters and correlating them with spatial transcript localization.
2022

Instance segmentation of unlabeled modalities via cyclic segmentation GAN

With Donglai Wei and Ed Boyden

  • Provided data for benchmarking CySGAN, a cyclic segmentation generative adversarial network that does image translation and instance segmentation jointly. The model segments 3D neuronal nuclei in unlabeled expansion-microscopy data using annotated electron-microscopy images.
2018 – 2022

AlphaTracker: a multi-animal tracking and behavioral analysis tool

Undergraduate thesis · MIT Brain and Cognitive Sciences · with Kay Tye, Cewu Lu, and Nancy Padilla

  • Led the application of the human pose-estimation algorithm AlphaPose to tracking multiple mice.
  • Automated analysis of their social interactions and individual behavioral motifs with unsupervised clustering.
  • Supervised development of a web UI for inspecting tracking and clustering results.
2018 – 2019

Cortical ensembles orchestrate social competition through hypothalamic outputs

With Nancy Padilla and Kay Tye · MIT Brain and Cognitive Sciences

  • Contributed to the discovery that a prefrontal–hypothalamic circuit regulates social dominance, using optogenetics and stereotaxic surgery. Published in Nature.
  • Built a MATLAB GUI with video playback for scoring animal behavior.
Jan – Mar 2018

Electrophysiology of maturing hippocampal neurons

With Ole Paulsen · University of Cambridge, Physiology, Development and Neuroscience

  • Whole-cell patch clamping of hippocampal neurons across cell types, developmental stages, and hemispheres, with a MATLAB pipeline for analyzing the recordings.
Summer 2017

Large-scale calcium and voltage imaging of the zebrafish brain

With Yiyang Gong · Duke University, Biomedical Engineering

  • Adapted principal and independent component analysis and constrained non-negative matrix factorization to process calcium and voltage imaging of the larval zebrafish brain.
2016 – 2018

miR-7 and miR-17-92 in the arcuate nucleus and the obesity phenotype

With Tao Sun · Shanghai Jiao Tong University, Life Sciences and Biotechnology

  • Ran qPCR on predicted microRNA targets and validated them with immunohistology; wrote MATLAB scripts to automate cell counting in confocal images.

Publications

  1. Zhang, R. and Deng, D. Neuro Inspired Robotics: What Robot Learning Can Borrow from the Sensorimotor Brain. Manuscript in preparation, 2026.
  2. Stanton, A. E., Kang, J., Blanchard, J. W., Boix, C. A., Schroeder, M. E., Lee, Y., Su, H., Wang, S., Yu, E., Emenari, A., Peng, Z., Agbas, E., Cerit, O., Park, D., Zhang, R., Bennett, D. A., Yin, P., Kellis, M., Langer, R., Boyden, E. S., and Tsai, L.-H. Expansion revealing of pathology resolves nanostructures associated with inflammatory phenotypes in COVID-19 decedent human brain tissue. bioRxiv, 2026. doi
  3. Zhang, R., Yu, B., Min, J., Xin, Y., Wei, Z., Shi, J. N., et al. Generative AI for film creation: a survey of recent advances. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 6267–6279, 2025. doi · arXiv
  4. Zhang, R. Mapping the spatial transcriptome across whole organisms. Doctoral dissertation, Massachusetts Institute of Technology, 2025.
  5. Besier, E., Zhang, R., Bando, Y., Alawi, M., et al. RnR-ExM: robust non-rigid registration challenge for expansion microscopy volumes. IEEE Transactions on Medical Imaging, 2024. preprint
  6. Chen, Z., Zhang, R., Fang, H.-S., Zhang, Y. E., et al. AlphaTracker: a multi-animal tracking and behavioral analysis tool. Frontiers in Behavioral Neuroscience, 17, 1111908, 2023. doi
  7. Lauenburg, L., Lin, Z., Zhang, R., dos Santos, M., Huang, S., Arganda-Carreras, I., Boyden, E. S., Pfister, H., and Wei, D. 3D domain adaptive instance segmentation via cyclic segmentation GANs. IEEE Journal of Biomedical and Health Informatics, 2023. doi · arXiv
  8. Linghu, C., An, B., Shpokayte, M., Celiker, O. T., Shmoel, N., Zhang, R., Zhang, C., Park, D., Park, W. M., Ramirez, S., and Boyden, E. S. Recording of cellular physiological histories along optically readable self-assembling protein chains. Nature Biotechnology, 2023. doi
  9. Zhang, Y., Chen, W., Zhang, R., and Zhang, X. Representing affect information in word embeddings. Experiments in Linguistic Meaning, 2, pp. 310–321, 2023. doi
  10. Padilla-Coreano, N., Batra, K., Patarino, M., Chen, Z., Rock, R. R., Zhang, R., et al. Cortical ensembles orchestrate social competition through hypothalamic outputs. Nature, 603(7902), pp. 667–671, 2022. doi
  11. Goodwin, D. R., Vaughan, A., Leibel, D., Alon, S., Henry, G. L., Cheng, A., Chen, X., Zhang, R., et al. Expansion sequencing of RNA-barcoded neurons in the mammalian brain: progress and implications for molecularly annotated connectomics. bioRxiv, 2022. doi
  12. Zhang, R. Towards mapping the spatial transcriptome of an entire vertebrate brain. Master's thesis, MIT, DSpace@MIT, 2021.
  13. Gao, Y., Li, J., Zhang, Z., Zhang, R., et al. MicroRNA miR-7 and miR-17-92 in the arcuate nucleus of mouse hypothalamus regulate sex-specific diet-induced obesity. Molecular Neurobiology, 56(11), pp. 7508–7521, 2019. doi · preprint

Course projects

Fall 2022

Multi-view 6D object pose refinement with differentiable rendering

6.S980 Machine Learning for Inverse Graphics · MIT EECS

Designed a loss for refining object-pose predictions by gradient descent that widens the basin of convergence 1.5-fold, combining single-view photometric, structural-similarity, and perceptual losses with object-level pose differences for bundle adjustment.

Spring 2022

Towards photo-realistic face-swapped videos

6.869 Computer Vision · MIT EECS

A face-swapping pipeline to protect the identities of Asian women interviewees: synthetic faces from StyleGAN, swapping with SimSwap, and video super-resolution to produce photo-realistic results.

Spring 2022

Solving put option prices with dynamic programming

6.231 Dynamic Programming and Reinforcement Learning · MIT EECS

Approximate value- and policy-iteration algorithms for the optimal stopping policy of an American put option, outperforming the vanilla algorithm; compared basis functions and multilayer perceptrons for value and Q-function approximation and generalized to multi-stock indexes.

Fall 2021

Affect encoding in word embeddings

6.864 Natural Language Processing · MIT EECS

How NLP models such as contextualized BERT encode affect-related meaning and relate to human judgment, using PCA, Spearman correlation, and logistic regression. A BERT model fine-tuned on affect-value regression outperformed vanilla models in transfer and few-shot settings.

Activities

2026

Film judge, HKUST AI Film Festival

Second edition, hosted by the Division of Arts and Machine Creativity at the Hong Kong University of Science and Technology, May 2026.

2025

Invited speaker, Cinequest Film Festival

2024, 2025

Organizer, Generative AI for Visual Arts workshop at CVPR

CVPR 2024 and CVPR 2025, with Anyi Rao.

2023 – 2025

Founder and organizer, MIT AI Film Hack

Chief organizer of the first (2023) and second (2024) editions, organizer of the third (2025).

2022

Founder and president, MIT Film Makers Association

2022

Director, Decode MIT

A documentary about MIT student life with more than 176,000 views on Bilibili.

2019

Director, My Poetic AlphaFriend

A sci-fi short with more than 40,000 views.

Awards and scholarships

2016 – 2019

Tanglixin Scholarship

A competitive scholarship from entrepreneur Lixin Tang that, once awarded, renews annually until graduation.

2016, 2017

National Scholarship

Awarded to the top 10% of Zhiyuan College by GPA, roughly 2 in 1,000 nationwide.

2016, 2017

Zhiyuan Honor Scholarship

2014

Chinese Chemistry Olympiad, bronze medal, National Final

The first student from my high school in ten years to reach the final.

2014

Chinese Mathematical Olympiad, first prize, Jiangsu Province

2014

China High School Biology Olympiad, first prize, Jiangsu Province

2013

National Olympiad in Informatics in Province, first prize, Jiangsu Province