|Job Type:||Full Time|
The Bing platform team works on the Bing web search backend system providing a search platform for Microsoft internal partners. We are managing one of the world’s largest distribute systems and have been very successful in building efficient large scale distributed system for search. With the advancment in hardware machines are becoming more powerful. How to fully utilize machine resources is becoming a bigger challenge. The agility of engineering and deployment is also a big challenge when handling such a complex system. As Bing becomes more intelligent, the need for a platform to build up AI intelligence is becoming bigger.
The MagneTar team is a new team in platform team, trying to tackle these challenges. We are trying to fully utilize our backend system’s resources by harvesting the spare resource in our backend system and build an OSS big data processing layer to fulfill Bing’s offline compute requirements. Our team operates a Hadoop cluster with tens of thousands of Windows nodes, on top of which we run a full-spectrum Hadoop open-source software stack, including HDFS, Yarn, Spark, Flink, ZooKeeper, Kafka, and TensorFlow, etc. Our Hadoop cluster hosts a full suite of critical large-scale machine-learning/deep-learning computational tasks across Bing, from DL model training/serving, ANN building/serving and offline big data processing by DL models, to support fusing of AI into our search and other areas.
The team culture values engineering quality, technical excellence, and grass roots innovation. We foster a supportive and productive work environment to provide growth avenues for each team member. #BingEng
As a senior software engineer in the MT team, you will work by yourself or with other engineers to design and implement features to enrich and improve the MT platform for more capability, higher performance and convenience for OSS big data and DL processing. You will also need to work closely with relevance team to build a streamline and integrated E2E DL experience. We have opportunities to build domain expertise across the broad distributed systems and open source projects in areas such as cluster management and resource scheduling, performance isolation, container, Hadoop/HDFS/Spark/Kafka, etc. You also work closely with OSS community to contribute back our work.
- A good foundation in computer science
- Strong skills in software design, problem solving and communication.
- BS in computer science or related field
- 8+ years of software development experience with high quality coding and debugging ability in any of the following languages: C, C++, C#, Java, Python
- Systems development experience is a plus, as is experience in one or more of Distributed Systems, open source Hadoop, Spark, Docker etc.
- Contributed to Hadoop OSS code before is preferred.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.