Do you want to lead the way on building and operating global scale cloud services in a data-driven way? We are at the center of Microsoft Azure, providing a common operational framework for cloud services topology and dependencies. We own the platform and experiences for collecting, storing and exposing the service topology and dependency data in the form of a service called Azure Graph. Azure Graph today is used in many different scenarios including but not restricted to Azure Support, On call engineers, Azure Buildout, Azure Security, Compliance and more. In the platform side we we deal with truly big data which we ingest from many Azure services, in both streaming and batch mode, connect the local topology together in real time to provide a global view of Azure topology. Core to our mission is collecting the right data on a massive scale, ensuring the quality of data and making it available for consumption through customer desired format and mechanisms. Building out computational logic
In this role you will: Design the backend for Azure Graph. Develop near real-time and batch data pipelines using big data technologies like Spark, Hadoop and ElasticSearch that scale to petabytes of data and thousands of datasets Leverage data science and ML to extract actionable insights from live and historical service data. Collaborate with multiple Azure cloud services and technology teams to both ingest the data and help meet end customer scenarios. Provide leadership in component and feature design, coding, engineering processes, and setting the product vision Lead a team of world class engineers
An undergraduate degree in computer science, engineering or eight years of software industry experience. 6+ years software development experience Design and development experience in C#, C++ and/or Java. Development and design background in multi-tiered distributed services. Prefered Qualifications Good understanding of efficient data structures, algorithms, asynchronous programming and high performance data processing. Strong problem solving and analytical skills. Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements