Bing Web Data team is looking for engineers who can design the next generation platform as well go deep in implementation. We are also looking to hire senior engineers who love to tackle deep technical challenges and strive for customer impact. We look at senior engineers to become experts and lead projects within a group of engineers, working with them to deliver business value. We are currently building an entire new system for web search indexing backend that will be orders of magnitude larger and faster than anything that currently exists. The new indexing pipeline is built on top of a petabyte scale table and incremental processing infrastructure. The goal of the system is to process billions of documents a day with seconds to minutes E2E latency. To design the new system, we are applying a combination of approaches from the fields of distributed computing, network programming, algorithm optimization, and machine learning. Come to define, design and deliver the next state of the art
Our core set of engineering challenges include Discover, Crawl from the Web, and Index 100s of billions of documents in a fast and efficient way. Build a Document Understanding platform that partner teams can use to plugin to run their classifiers, models and allow friction free experimentation. Provide Web Graph / Index as a service for Microsoft teams, utilize and build rich applications. Parsing and classifying billions of web documents, do encoding and language detection, script segmentation and sentence breaking. Use NLP, ML, DL techniques to extract document data, NER, POS tagging, parsing,
The successful candidate must have: - Strong C/C++/C# skills with at least 4 years of programming experience and a CS degree or equivalent - Ability to perform independent research and work with data - Strong design skills and engineering excellence fundamentals - Experience in writing efficient multi-threaded code - Passion for delivering high quality software on a rapid ship cycle Candidates would find the following experiences advantageous: - Optimizing complex systems - Working on distributed infrastructure - Hands on ML, NLP, DL, data mining - Working with data sets, and Big data - Shipping