Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Scala
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a hands-on Technical Lead to design, develop, and manage real-time data pipelines that power core banking data products. In this role, you will build and operate Apache Spark Structured Streaming applications to process CDC events from Confluent Kafka, apply complex business transformations, and store data in MongoDB Atlas, all running on Amazon EMR in AWS. You will collaborate closely with mainframe, CDC, and platform teams to deliver scalable, reliable, and high-performance data solutions while providing technical leadership and driving engineering best practices..
Roles & Responsibilities:
Lead end-to-end development of Spark Structured Streaming pipelines in Scala, from ingestion to persistence
Own technical decisions around data modeling, processing logic and MongoDB write strategies
Coordinate with IBM CDC team, Confluent Kafka team and MongoDB/GFT teams for cross-system integrations
Review and approve code contributions from team members via Bitbucket pull requests
Ensure code quality through SonarQube quality gates, JaCoCo coverage and Checkstyle compliance
Manage CI/CD pipelines via Jenkins for INT, PRE and PRO environment deployments on Amazon EMR
Translate business requirements into technical specifications and low-level design documents
Mentor junior and mid-level engineers on Spark internals, Scala best practices and streaming concepts
Drive incident resolution and root cause analysis for production issues
Maintain technical documentation including Technical Documents, Confluence pages and READMEs
Technical Skills:
Must have:
Scala — strong proficiency in functional and object-oriented programming
Apache Spark Structured Streaming — foreachBatch, micro-batch processing, offset management, checkpointing
Kafka — consumer configuration, offset management, SASL/SSL authentication, Confluent Cloud
MongoDB — bulk write operations, upsert strategies, index design, Atlas connectivity
AWS — Amazon EMR, Amazon S3, CloudWatch log analysis
Good to have:
IBM CDC / Change Data Capture concepts
Delta Lake on S3
Jenkins CI/CD pipelines
SonarQube, JaCoCo, Checkstyle
Bitbucket / Git branching strategies (GitFlow)
Java (for mixed Scala/Java codebases)
Experience: Minimum 7 years of experience in Scala and distributed data processing. Prior experience leading a team of 3+ engineers preferred.15 years full time education
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Scala
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a hands-on Technical Lead to design, develop, and manage real-time data pipelines that power core banking data products. In this role, you will build and operate Apache Spark Structured Streaming applications to process CDC events from Confluent Kafka, apply complex business transformations, and store data in MongoDB Atlas, all running on Amazon EMR in AWS. You will collaborate closely with mainframe, CDC, and platform teams to deliver scalable, reliable, and high-performance data solutions while providing technical leadership and driving engineering best practices..
Roles & Responsibilities:
Lead end-to-end development of Spark Structured Streaming pipelines in Scala, from ingestion to persistence
Own technical decisions around data modeling, processing logic and MongoDB write strategies
Coordinate with IBM CDC team, Confluent Kafka team and MongoDB/GFT teams for cross-system integrations
Review and approve code contributions from team members via Bitbucket pull requests
Ensure code quality through SonarQube quality gates, JaCoCo coverage and Checkstyle compliance
Manage CI/CD pipelines via Jenkins for INT, PRE and PRO environment deployments on Amazon EMR
Translate business requirements into technical specifications and low-level design documents
Mentor junior and mid-level engineers on Spark internals, Scala best practices and streaming concepts
Drive incident resolution and root cause analysis for production issues
Maintain technical documentation including Technical Documents, Confluence pages and READMEs
Technical Skills:
Must have:
Scala — strong proficiency in functional and object-oriented programming
Apache Spark Structured Streaming — foreachBatch, micro-batch processing, offset management, checkpointing
Kafka — consumer configuration, offset management, SASL/SSL authentication, Confluent Cloud
MongoDB — bulk write operations, upsert strategies, index design, Atlas connectivity
AWS — Amazon EMR, Amazon S3, CloudWatch log analysis
Good to have:
IBM CDC / Change Data Capture concepts
Delta Lake on S3
Jenkins CI/CD pipelines
SonarQube, JaCoCo, Checkstyle
Bitbucket / Git branching strategies (GitFlow)
Java (for mixed Scala/Java codebases)
Experience: Minimum 7 years of experience in Scala and distributed data processing. Prior experience leading a team of 3+ engineers preferred.15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.