Role responsibilities
Design and build scalable, fault-tolerant data processing pipelines and architectures to handle petabyte-scale data for Bing and MSN. Collaborate with cross-functional partners to develop data assets, anomaly detection, and real-time insights using Azure and open-source technologies.
Requirements
Requires a Bachelor's degree in Computer Science and at least 4 years of technical engineering experience in languages like C#, Java, or Python. Preferred candidates have 6+ years of experience with a focus on Spark, Flink, and large-scale data processing in cloud environments.
Key skills
Spark, Flink, Kafka, Azure, Python, Java, C#, HDFS, Azure Blob Storage, Data Pipeline Design, Big Data Processing, AI Integration, Data Governance, EventHub, Backend Service Development, Performance Optimization
Keywords
Spark, Flink, Kafka, EventHub, Azure, HDFS, Azure Blob, Big Data, Petabyte Scale, Data Pipelines, Artificial Intelligence, C#, Java, Python, C++, Data Governance, Data Compliance, Backend Development, Streaming Data, Batch Processing, SLA, Data Quality, Anomaly Detection, Software Engineering, Cloud Computing, Search Foundation, Real-time Signals, Bot Protection, Data Analytics, Distributed Systems