Delivery Manager - Data Engineering 4D

Delivery Manager - Data Engineering

Ready to turn bold ideas into real-world impact?
 At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. 
 
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises.
 Get to know us at genpact.com and on LinkedIn, YouTube, X, and Facebook.

Job Description

Key Responsibilities

Workspace Administration & Governance

• Administer all Databricks workspace-level settings under the ADM model, including access controls, feature flags, and workspace security configurations

• Ensure DBFS and Hive Metastore remain disabled (mandatory ADP default); prevent re-enablement

• Configure and manage workspace folder hierarchies for NH2030 teams (Data Engineering, ML, Shared)

• Set up and maintain notification destinations (email, webhook) for operational alerts

• Verify SCIM-synced Entra ID groups appear correctly in the Databricks account console post-provisioning

• Assign Entra ID groups to the workspace and configure role personas (Admin, Data Engineer, ML Engineer)

 

Compute & Cluster Management

• Design and create cluster policies for the NH2030 Dev environment: instance types, auto-termination rules, Databricks Runtime (DBR) versions, and shared access mode enforcement

• Confirm and validate serverless compute enablement at account level following AzTech provisioning

• Create and configure serverless SQL warehouses for data exploration, SQL analytics, and developer testing

• Monitor compute usage and enforce cluster policy compliance across development teams

 

Unity Catalog & Data Layer

• Validate AzTech-provisioned Unity Catalog metastore, external locations, and storage credentials

• Support the Data Governance Manager in configuring baseline RBAC, catalog bindings, and workspace-catalog assignments

• Administer Delta Live Tables (DLT) pipeline configurations and serverless job execution environments

• Manage MLflow model registry environment settings and model serving endpoint infrastructure

 

CI/CD & Git Integration

• Configure Git integration in the Databricks workspace using whitelisted GitHub repositories

• Set up Databricks Asset Bundles (DABs) for infrastructure-as-code deployment of notebooks, jobs, and pipelines

• Support the CI/CD pipeline (GitHub Actions / Azure DevOps) for automated deployment of Databricks assets to the Dev environment

• Conduct end-to-end deployment validation from Git commit through to Unity Catalog output

 

Environment Readiness & Onboarding

• Lead the Databricks environment onboarding session for all NH2030 developers (workspace navigation, compute options, secret scopes, Git workflows)

• Verify developer login and workspace access for all team members prior to sprint start

• Produce and maintain the NH2030 ADP Dev Environment Configuration and Runbook document

• Coordinate ServiceNow (SNOW) requests for catalog creation, budget policies, and platform provisioning with the ADP Platform Team (AzTech)

• Respond to ADP/SPM technical queries during workspace provisioning review

 

ADP-Specific Activities (from Operational Responsibility Matrix)

Phase 3–4 Activities

Phase 9–10 Activities

• Workspace administration (ADM model) – P4-01

• Cluster policy creation and pool management – P4-02

• Serverless SQL warehouse creation – P4-04

• Workspace folder structure – P4-05

• Notification destinations – P4-06

• SCIM sync verification – P3-01

• Workspace group assignment & persona configuration – P3-02

• Serverless compute enablement verification – P4-03

• Git integration configuration – P9-01

• End-to-end CI/CD deployment validation – P9-04

• Developer onboarding session – P10-01

• Access verification for all team members – P10-02

• Environment configuration documentation – P10-03

• SNOW request coordination and SPM query response – P1-01, P1-03

 

Required Skills & Experience

Core Technical Skills

Supporting Skills

• 3+ years Databricks platform engineering in enterprise environments

• Databricks workspace administration (ADM model preferred)

• Unity Catalog: RBAC, catalog/schema bindings, compute policies

• Databricks cluster policies, pool management, and DBR version governance

• Serverless compute: SQL warehouses, jobs, notebooks, DLT pipelines

• MLflow model registry and model serving endpoint management

• Databricks Asset Bundles (DABs) and IaC for Databricks

• Git integration with Databricks (GitHub / Azure DevOps)

• CI/CD pipeline design (GitHub Actions or Azure DevOps) for Databricks deployments

• Azure infrastructure: ADLS Gen2, Azure Monitor, Key Vault integration

• PySpark / Python / SQL for pipeline development and validation

• Delta Lake architecture: ACID transactions, Z-ordering, VACUUM, time travel

• Experience with SCIM provisioning and Entra ID group management in Databricks

• Strong written documentation skills (runbooks, environment config docs)

• Ability to lead cross-functional technical onboarding sessions

 

Certifications

• Databricks Certified Data Engineer Associate or Professional (required)

• Databricks Certified Associate Developer for Apache Spark (desirable)

• Azure Data Engineer Associate (AZ-204 / DP-203) (desirable)

 

Key Interfaces

• ADP Platform Team (AzTech): Coordinate provisioning, SNOW requests, SPM queries, environment handover

• IAM Specialist: Workspace group assignment, SCIM verification, SP workspace onboarding

• Data Governance Manager: Unity Catalog structure, baseline RBAC, catalog bindings

• Security / DevSecOps Engineer: DBFS lockdown verification, cluster policy security, exfiltration controls

• All NH2030 Developers: Onboarding, access support, workspace guidance

Qualifications

Bachelors - Business Analytics, Bachelors - Computer Science, Bachelors - Statistics, Masters - Data Science

Certifications

ITIL Foundation - AxelosAxelos, Project Management Professional (PMP) - Virtual Learning Academy (VLA)Virtual Learning Academy (VLA)

Required Skills

Agile Methodology, Banking Capital Markets, Change Management, Client Relations, Cloud Computing, Collaboration Tools, Commercial Sales, Consumer Packaged Goods (CPG), Data Engineering, Data Literacy, Design Thinking, Electronic Hardware, Executive Presence, Inclusion, Manufacturing Equipment, Modernizing Operations, People Leadership, Personal Effectiveness, Risk Management, Semiconductors, Sourcing and Procurement, Storytelling

Language

English (Required), English (Required)

Language Proficiency -

Advanced - C1

Additional Job Location -

Job Type

Regular

Master Skill List -

Data Engineering

Remote Type -

Hybrid

Work Shift -

Flex Time (India)

Why join Genpact?
•    Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
•    Make an impact – Help global enterprises solve business challenges that matter 
•    Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead
•    Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day 
•    Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress 
 
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.  
Let’s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.  
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.