Avatar

Nicole Mitchell

AI Resident

Google Research

About

I am currently an AI Resident at Google Research, working with Johannes Ballé, Jakub Konečný and Zachary Charles on compression for federated learning. Our work applies rate–distortion theory to reduce client communication costs without sacrificing model performance.

Prior to the residency, I completed my Master of Science in Computer Science from Rice University, where I was advised by Dr. Lydia Kavraki. My master’s research in chemoinformatics applied graph theory, network science and machine learning techniques to model drugs and predict their metabolism, helping inform the safety and efficacy of medicines.

As my residency is coming to a close, I am now seeking opportunities for full-time research positions. Broadly, I am excited about research that uses both theory and empirical tools to design informed and efficient machine learning systems. I care about applications to health and the environment, and how my work fits in the socio-technical landscape.

Outside of research, I enjoy running along trails in the Marin Headlands and trying out new recipes in the kitchen.

Interests

  • Federated Learning
  • Compression
  • Sparsity
  • Robustness
  • Biomedical Applications

Education

  • MS in Computer Science, May 2020

    Rice University

  • BS in Computer Science, December 2018

    Rice University

Publications

Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory

A significant bottleneck in federated learning is the network communication cost of sending model updates from client devices to the …

Machine Learning-Based Prediction of Sites of Metabolism in Drugs: Exploring Feature Extraction Methods on Molecular Graphs

Drug metabolism studies are a critical component of the drug design process. Metabolism of some drugs can lead to diminished …

Using parallelized incremental meta-docking can solve the conformational sampling issue when docking large ligands to proteins

Background: Docking large ligands, and especially peptides, to protein receptors is still considered a challenge in computational …

Experience

 
 
 
 
 

AI Residency

Google Research

Feb 2021 – Present San Francisco, CA
Compression for Federated Learning

  • Designed a custom compression method for client updates in federated learning to reduce the communication cost from 32 bits per model parameter to 0.1 bits without degrading accuracy on several benchmarks.
  • Implemented compression-based aggregation methods for federated learning in TensorFlow Federated. This involved: custom TF ops hosted in TensorFlow Compression, TensorFlow Federated logic, and robust integration tests for system compatibility.
  • Presented this work to internal and external audiences. Selected to give an oral presentation at the Google Research Conference. Submitted a paper to ICML 2022, currently under review.
  • Integrated custom compression method into Google’s federated learning production system (in flight)
 
 
 
 
 

Science Policy

Baker Institute for Public Policy, Rice Univeristy

Jan 2020 – Aug 2020 Houston, TX
Developing Civic Scientist Leaders Program

  • One of ten graduate students selected to participate in a weekly seminar to learn about the federal policymaking process and develop critical leadership skills to advance science as a public good
  • Published an op-ed on a public policy issue; created one-pagers advocating for funding basic scientific research to use in our upcoming congressional visits in Washington, D.C.
 
 
 
 
 

Graduate Research

Kavraki Computational Robotics, AI and Biomedicine Lab, Rice Univeristy

Jan 2019 – May 2020 Houston, TX
Drug Metabolism Prediction Using Graph-based Learning

  • Built a deep graph convolutional network (GCN) using Pytorch to predict drug metabolism
  • Proposed the use molecular representations learned through GCNs to identify metabolically labile atoms. Compared to traditional feature extraction methods.
  • Presented poster at the Rice Data Science Conference, Oct 2019, and the 29th Annual Keck Research Conference, Oct 2019
  • Completed written thesis and oral defense in April 2020
 
 
 
 
 

Software Engineering Intern

iCloud Storage Analytics, Apple

May 2018 – Aug 2018 Cupertino, CA
Anomaly Detection on Time-Series Metrics

  • Built a data pipeline to query server logs and gather time-series metrics on our services
  • Wrote a Spark job in Scala to process and aggregate raw data, storing the results in blob storage
  • Developed and implemented an anomaly detection system in Python using Pandas, SciPy and Matplotlib to automatically detect regressions in quality of service among subsets of our network and generate reports to alert iCloud engineers. Deployed system surfaces one to two critical issues each day that otherwise went unnoticed.
  • Presented work to ~30 engineers at iCloud and individually to the Vice President of iCloud
 
 
 
 
 

Undergraduate Research

Kavraki Computational Robotics, AI and Biomedicine Lab, Rice Univeristy

Jan 2018 – Dec 2018 Houston, TX
Benchmarking an Incremental Docking Protocol

  • Improved an incremental docking protocol (DINC) which computationally predicts how peptides bind to protein receptors. Experimented to identify unexpected behavior; strengthened the robustness of DINC by handling these edge cases.
  • Evaluated the latest version of DINC by designing re-docking experiments and writing scripts to automate these tests on the XSEDE Comet Supercomputer. Results published in Devaurs et al, 2019.
  • Presented poster at the Rice Undergraduate Research Symposium, April 2018
 
 
 
 
 

Software Engineering Intern

Appointments iOS, Square

May 2017 – Aug 2017 San Francisco, CA

Improving Square’s Appointment Scheduling Calendar

  • Optimized the calendar in Square Appointments iOS app by identifying performance bottlenecks and improving the search algorithm. Made a 16-fold improvement in CPU time spent rendering events and UI features that restored calendar to 60 fps scrolling.
  • Added a feature to notify users when their time zone differs from that of the business they are viewing

Using Word2Vec to Power a Recommendation Engine

  • Developed a customized market insights tool for merchants to compare their prices to those of nearby sellers
  • Grouped similar transactions using the “word2vec” ML model
  • Built a Python Flask app with D3 Visualization to display interactive reports
 
 
 
 
 

Software Engineering Intern

FBU, Facebook

Jun 2016 – Aug 2016 Cupertino, CA
Building an iOS Mobile Application

  • Developed an iOS mobile app in Swift that helps users remember the people they’ve met by using location tracking to auto-log events

Accomplishments

Adobe Research Women in Technology Scholarship

The Adobe Research Women in Technology Scholarship is a $10,000 international scholarship recognizing outstanding undergraduate and masters female computer scientists. It is awared to ten recipients annually, who are selected by members of Adobe Research.

Rice Computer Science Graduate Research Fellowship

The Rice Computer Science Graduate Research Fellowship provides a graduate stipend and full-tuition waiver for a year of study and research towards a thesis-based MS in Computer Science. Three to four recipients are chosen annually by a faculty committee, including the department chair and head of the graduate program.

NCAA Division I Varisty Athlete

Dedicate 20 hours per week training and competing for Rice University. Awarded the Conference USA Comissioner’s Academic Medal and named a Rice University Honor Athlete for academic excellence.