About Me

Update: I am joining the Computer Science department at Cornell as an Assistant Professor starting August 2024. If you are interested in collaborating or joining my group, feel free to reach out! Before joining Cornell, I am a research scientist at Google.

Contact:  jjs533@cornell.edu

Accelerating scientific progress is crucial for understanding and solving challenges in our ever-changing world. My research focuses on developing computer vision & machine learning methods in workflows that require expert-in-the-loop interactions, such as for studying behavioral or medical data. I aim to optimize expert attention in real-world workflows in order to accelerate scientific discovery, addressing bottlenecks including data annotation efficiency, model interpretability, generalization (across experiments, labs, and domains), and semantic structure discovery.

Currently, I am a research scientist at Google. I recently graduated from Caltech in Computing and Mathematical Sciences, and I was co-advised by Professor Pietro Perona and Professor Yisong Yue. I am grateful to be supported by the Kortschak Scholars Program at Caltech and the NSERC Postgraduate Scholarship from the Natural Sciences and Engineering Research Council of Canada. I have been awarded Amazon AI4Science Fellowship and the Ben P.C. Chou Doctoral Prize.

Mentorship and Advising

Former:

  • Pablo Backer Peral, current Caltech student
  • Joshua Flashner, current Caltech student
  • Patrick Rim, current Caltech student
  • Victor Chen, Caltech BS 2020
  • Amil Dravid, Northwestern BS 2023 (joined PhD program at Berkeley)
  • Shir Goldfinger, Caltech BS 2023
  • Arushi Gupta, current Caltech student
  • Eric Han, Caltech BS 2021
  • Eric Ma, current Caltech student
  • Hongsen Qin, Caltech BS 2021
  • Megan Tjandrasuwita, Caltech BS 2022 (joined PhD program at MIT)
  • Albert Tseng, Caltech BS 2021 (joined PhD program at Cornell)
  • Isabella Zhang, Caltech BS 2021

Select Projects

See the full list of my publications here. See our computational behavior efforts here.

  • Neurosymbolic Programming for Science, AI4Science Workshop at NeurIPS
    Jennifer J. Sun*, Megan Tjandrasuwita*, Atharva Sehgal*, Armando Solar-Lezama, Swarat Chaudhuri, Yisong Yue, Omar Costilla-Reyes
    [paper]
  • Self-Supervised Keypoint Discovery in Behavioral Videos, CVPR 2022
    Jennifer J. Sun*, Serim Ryou*, Roni Goldshmid, Brandon Weissbourd, John Dabiri, David J. Anderson, Ann Kennedy, Yisong Yue, Pietro Perona
    [paper][project website][code]
  • Task Programming: Learning Data Efficient Behavior Representations, CVPR 2021 (Oral)
    Awarded Best Student Paper at CVPR 2021
    Jennifer J. Sun, Ann Kennedy, Eric Zhan, David J. Anderson, Yisong Yue, Pietro Perona
    [paper][project website][code][video]
  • Learning Differentiable Programs with Admissible Neural Heuristics, NeurIPS 2020
    Ameesh Shah*, Eric Zhan*, Jennifer J. Sun, Abhinav Verma, Yisong Yue, Swarat Chaudhuri
    [paper][code]
  • View-Invariant Probabilistic Embedding for Human Pose, ECCV 2020 (Spotlight)
    Jennifer J. Sun, Jiaping Zhao, Liang-Chieh Chen, Florian Schroff, Hartwig Adam, Ting Liu
    [paper][code][video][project website][Google AI blog post]
    [IJCV paper]
  • Workshops & Tutorials: