Engineer Software Testing

Role responsibilities

The role involves validating end-to-end ETL/ELT pipelines, Databricks workflows, and AI/ML model integrations. It also requires designing and developing automation frameworks for data and API validation integrated into CI/CD pipelines.

Requirements

Candidates need over 6 years of experience in ETL/Data testing, including 3+ years with Databricks or Spark and hands-on AI/ML model testing. A Bachelor's degree and strong proficiency in Python and SQL are required.

Key skills

ETL Testing, AI/ML Testing, Databricks, Python, SQL, PySpark, API Testing, Test Automation, MLOps, Data Validation, CI/CD, Integration Testing, Delta Lake, Spark, GenAI, RAG

Keywords

ETL, ELT, AI/ML, Databricks, Spark, PySpark, Python, SQL, Delta Lake, Unity Catalog, MLflow, Azure ML, GenAI, RAG, CDC, API Testing, CI/CD, MLOps, Data Quality, Integration Testing, Contract Testing, Feature Engineering, Data Drift, Schema Drift, Data Warehouses, Cloud Platforms, Automation Frameworks, Source-to-Target Validation, Data Lineage, Backend Validation