Senior Data Engineer

Last updated 26 days ago
Location:Bellevue, Washington
Job Type:Full Time

The Modern Life & Learningorganization is looking for a strong Senior Data Engineerto join our Education Portfolio Analytics & Data team to enable us todrive data-driven, high impact business decisions acrossour org as well as the company-wide Education space.

The team is responsible for end-to-end analytics, and the platform that enables them, for the Education business, which serves millions of students and teachers across the globe. Our insights span products and services across all ofMicrosoft andare consumed by cross-functional stakeholders from our engineers building products to sellers in the field working with customers to executive leadership.

In this role, you will be joining a team eager to learn, leverage and value your expertise to build our Data & Analytics capabilities and nourish our data-informed culture. You will have the opportunity to apply your skills in big data processing, automationand integration, data modeling and business intelligence todefine and build a new generation data service, which will push the boundaries of how much value we can create for our customers, business, and engineers.

The successful candidate will have experience working with a wide range of data datasets across a breadth of data and cloud technology platforms to model and build data solutions and infrastructure that address our challenges. We are looking for people who see challenges as opportunities: who can look at complex data problems, design, and model scalable solutions, and build effective and efficient data systems that enable our analysts and data scientists to deliver innovative insights and our business to make data-anchored decisions.

If you enjoy variety in projects, have strong data processing, automation, integration, and modeling skills, and want to work in a fun and highly collaborative environment, then this is the job for you.

Responsibilities

For this senior engineer position, the ideal candidate will have ample experience delivering data platform infrastructure and tooling as well as collaborating across internal and partner teams.

We are looking for someone who has experience creating and maintaining ascalable pipeline architecture and infrastructure primarily in COSMOS/ADLS, while assembling large, complex datasets from multiple internaldata sources.

Automation and continuous improvement are fundamental to our platform, so familiarity with tooling such as ADF/xFlow, etc is important as is a natural drive to identify, design and implement process and system improvements/optimizations.In this role, you will need to be well versed in DataOps, especially where Agile development, DevOps, and Continuous Improvement intersect.

Experience in data modeling and an understanding of analytical tooling like DataBricks, PySpark,R ishighly desired as our platform is designed to support analytical and data science requirements as well as reporting. The candidate must be able to work in close collaboration with analysts and data scientists to understand their scenarios and needs andbuild the right datasets and solutions for innovative analysis.Finally, familiarity with Analysis Services, tabular models, DAX and PowerBIwould be a significant plus as reporting is still a core part of our democratization layer.

As part of a business that focuses on students and education, privacy, compliance, and security are fundamental to our business and we expect the ideal candidate to understand and adhere to the highest standards (GDPR, Dutch MoJ, Student Privacy Pledge, Torus). Finally, we serve a large set of diverse customers and needs, so a focus on data quality is a must.

Qualifications

Required:

  • 7+ years of experience developing data platforms with large and complex datasets
  • 4+ years of experience working with Azure Databricks, Spark and other big data technologies or Cosmos


Preferred: 

  • BA/BS in Computer Science, Engineering, or equivalent software/services experience
  • Experience building and optimizing large-scale data processing, integration and storage using big data platforms, Azure Data Lake and Data Services, Databricks, SQL, Power BI, and Spark as well as coding with C#
  • Understanding of Privacy and Compliance aspects of data storage & processing as it relates to GDPR and PII
  • Experience delivering data solutions via Agile methodologies
  • An analytical mindset with a successful history of manipulating data and extracting value from large, disconnecteddatasets
  • Excellent problem solving, critical thinking, communication,and collaboration skills
  • An attention to detail with self-discipline and a drive for results
  • Passion for using data and analytics to drive business value

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.