Research Intern - Neural Architecture Search

Last updated 13 days ago
Location:Redmond, Washington
Job Type:Full Time

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers. Our researchers and engineers pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

We are looking for research interns to work with us to invent the next generation of neural architecture search (NAS) algorithms. While deep learning has had tremendous impact in recent years, coming up with new architectures for new tasks/datasets is still a game of trial and error especially under constraints of latency/memory/flops. Increasingly state-of-the-art is being held by NAS-based methods. Help us discover the next cornerstone architecture for language modeling and vision via NAS! We are building a highly performant open-source scalable platform (Archai) which allows new NAS algorithms to be written with a few lines of python code. Archai also acts as delivery vehicle for our research. For example Archai has a highly performant implementation ofPetridishwhich grows models from small to big and produces a gallery of models on the trade-off curve of flops/latency/memory vs. accuracy.

Responsibilities

Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, interns learn, collaborate, and network for life. Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, students are paired with mentors and expected to collaborate with other interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Qualifications

In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

Required Qualifications

  • Must be currently enrolled in a PhD program in Computer Science, Machine Learning or a related STEM field.
  • At least one NAS/AutoML related publication in top tier venues like NeurIPS, ICLR, ICML, CVPR, ECCV, ICCV, NAACL, ACL etc.
  • At least one year of experience in PyTorch and distributed training of deep learning models.

Preferred Qualifications

  • Comfortable with recent advances in language modeling.
  • Demonstrated ability to develop original research agendas.
  • Must be able to collaborate effectively with other researchers and product development teams.
  • Excellent interpersonal skills, cross-group, and cross-culture collaboration.
  • Ability to think unconventionally to derive creative and innovative solutions.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.