AI Data Architect
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
Your role:
The ideal candidate will define and lead the target-state AI data architecture across all lifecycle stages—from initial transition and Day 1 operations to ongoing BAU support and continuous optimization. In this role, you will architect mechanisms to ingest, prepare, and structure complex enterprise data sources (including ServiceNow, CMDB, knowledge bases, code repositories, monitoring feeds, and operational logs) for seamless AI agent consumption. You will design governed Retrieval-Augmented Generation (RAG) pipelines, semantic search models, vector indexing strategies, knowledge graphs, and scalable data products tailored for agentic workflows. Crucially, you will enforce strict data governance, ensuring all data accessed by AI agents remains highly accurate, permission-aware, traceable, auditable, and compliant with customer privacy and data boundary standards. Additionally, you will provide cross-functional architectural leadership to AI Data Engineers, Agent Engineers, Forward Deploy Engineers, Solution Architects, and customer stakeholders to align data strategy with operational objectives.
What you will do:
End-to-End Data Architecture: Design blueprints and canonical models for ingesting, enriching, and serving operational enterprise data (ServiceNow, CMDB, Git, SharePoint, SOPs) to AI agents.
Agentic Data Enablement: Architect governed APIs, retrieval services, context packages, and structured output schemas for multi-agent workflows and Agent Builder platforms.
RAG & Search Strategy: Define enterprise RAG models, chunking/indexing policies, hybrid search patterns, and vector database topologies (Azure AI Search, Pinecone, Milvus, pgvector).
Data Quality & Benchmarking: Establish quality thresholds, retrieval precision/recall metrics, and golden evaluation datasets to measure drift and optimize response accuracy.
Security & Access Governance: Enforce Zero Trust data access, RBAC/ABAC, data boundaries, privacy masking, and lineage logging across all AI retrieval and model interaction layers.
Cloud & Platform Blueprinting: Architect scalable data pipelines, storage, and lakehouse/vector infrastructure across Azure, GCP, AWS, Databricks, or Snowflake landing zones.
AMS Domain Modeling: Map ITSM and Application Management Services operational workflows (incidents, CMDB, SLAs) into high-value data products for automated ticket analysis and runbook generation.
Engineering Leadership: Provide architectural direction to Forward Deploy and Data Engineers while managing standards for performance, cost, security, and production readiness.
Your Future at Kyndryl
The career path ahead is full of exciting opportunities to grow and advance within the job family. With dedication and hard work, you can climb the ladder to higher bands, achieving coveted positions such as Principal Engineer or Vice President of Software. These roles not only offer the chance to inspire and innovate, but also bring with them a sense of pride and accomplishment for having reached the pinnacle of your career in the software industry.
Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.
Required Technical and Professional Experience
AI & Agentic Data Architecture: 10+ years in enterprise data/platform architecture, with 3+ years specifically building GenAI, RAG, and AI agent data models using frameworks like LangChain, LlamaIndex, and AutoGen.
LLM, RAG & Vector Platforms: Expertise in context management, grounding, chunking, and hybrid search across vector engines (Azure AI Search, Pinecone, Milvus, pgvector) and major LLMs (Azure OpenAI, Gemini, Claude, Llama).
Enterprise Data & Storage: Deep experience in canonical and semantic data modeling, data products, lakehouses, and modern data platforms (Databricks, Snowflake, BigQuery, Fabric) across Azure, GCP, or AWS.
AMS & ITSM Domain Expertise: Proven track record with ServiceNow, CMDB models, ticket workflows, SLA analytics, and transforming operational IT assets into AI-ready data products.
Governance, Security & Lineage: Strong capability in designing Zero Trust data access (RBAC/ABAC), data mesh concepts, lineage tracking, privacy controls, and audit frameworks for enterprise compliance.
Evaluation & Lifecycle Quality: Skilled in establishing evaluation datasets, drift detection, retrieval performance metrics (precision/recall), and agent contract schemas to eliminate hallucinations.
Consulting & Stakeholder Leadership: Ability to facilitate workshops, drive data discovery under ambiguity, run architecture reviews, and align multi-disciplinary engineering and business teams.
Core Artifact Ownership: Responsible for delivering AI Data Blueprints, RAG/vector strategies, source-to-target mappings, governance frameworks, and data engineering implementation guidelines.
Preferred Technical and Professional Experience
Master Degree & any relevant certification
Being You
The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.
What You Can Expect
Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.