Data Pipeline Development Design, develop, and maintain batch and real-time data pipelines for ingestion, transformation, and delivery of enterprise data. Build scalable ETL/ELT solutions with monitoring, alerting, and data quality controls. Ensure data pipelines are reliable, performant, and cost-efficient. Troubleshoot and resolve pipeline failures, performance bottlenecks, and data quality issues. Design and optimize data models, data warehouses, lakehouses, and storage solutions to support analytics and reporting requirements. Support migration of legacy data environments to modern cloud-based architectures. Apply data security recommended approaches and ensure compliance with organizational policies and governance requirements. Protect enterprise data assets and support secure operational processes. Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or related technical field AND 3+ years of technical support, technical consulting, data engineering, or information technology experience o OR 5+ years of technical support, data engineering, technical consulting experience, or information technology experience Strong SQL and proficiency in a programming language such as Python or Scala. Experience building ETL/ELT pipelines and data modeling for analytics. Familiarity with orchestration tools (e.g., Airflow, Azure Data Factory) and cloud data platforms. Experience with big-data and streaming tools (e.g., Spark, Kafka). Experience with cloud data warehouses (e.g., Synapse, OneLake, Lakehouse). Knowledge of data quality frameworks, CI/CD, and infrastructure-as-code. Experinece with Near Real Time (NRT) event streams like Azure Event Hubs + Azure Synapse. Experience with Azure SQL Managed Instances, Power BI Gateways, and DataFlows
Want jobs like this matched to you?
SimpleCareer scores fresh postings against your résumé so you only see the matches that matter.