Application Manager - AI Solution

We are seeking a highly skilled and experienced Tech Lead to join our AI innovative team. This role requires a strong background in hands-on coding, excellent design thinking, and superior problem-solving abilities. The successful candidate will be instrumental in the deployment and fine-tuning of Large Language Models (LLMs), developing robust API proxy layers for LLM guardrails, and ensuring solutions comply with stringent information security, compliance, and governance policies. This individual will also play a key role in partnering with vendors, the Group Technology team, and cross-functional teams to identify, evaluate, and implement innovative solutions while ensuring the delivery of high-quality products.

Key Responsibilities

• Lead the design, development, and deployment of GenAI solutions using Java and Python.
• Own the enterprise LLM model layer, including model selection, deployment, fine-tuning, evaluation, and lifecycle management.
• Design and build secure LLM proxy/API gateway services with guardrails for security, compliance, content filtering, privacy protection, and usage monitoring.
• Develop and maintain LLM evaluation and testing harnesses to benchmark model performance, accuracy, safety, latency, and cost.
• Establish automated testing and regression frameworks for prompts, RAG applications, and AI agents to ensure consistent quality.
• Collaborate with Information Security, Compliance, and Governance teams to ensure AI solutions meet enterprise standards and regulatory requirements.
• Partner with business stakeholders and vendors to discover use cases, define requirements, and deliver high-quality AI solutions.
• Contribute hands-on across architecture, coding, testing, deployment, and production support.
• Mentor engineers and promote best practices in GenAI, software engineering, and platform development.
• Stay current with emerging AI technologies, LLM platforms, and GenAI engineering practices.

Required Skills and Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 7+ years of extensive hands-on experience in software development, with a strong emphasis on both Java and Python.
• Proven expertise in Java development, with a strong understanding of Java ecosystems and frameworks (e.g., Spring Boot).
• Demonstrable experience with LLM deployment and model fine-tuning.
• Experience in building API proxy layers, with an understanding of security policies like OAuth 2.0 and JWT validation.
• Familiarity with information security best practices and compliance and governance policies in software development.
• Strong problem-solving, analytical, and design thinking skills.
• Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams, vendors, and users.
• Experience working in Agile development environments.

Preferred Qualifications:

• Strong experience in microservices architecture and development.
• Experience with OpenAI, Anthropic, Qwen, or other foundation models.
• Familiarity with LangChain, LangGraph, or similar GenAI frameworks.
• Experience with RAG, agent-based architectures, vector databases, and AI observability.
• Knowledge of Kubernetes/OpenShift, Docker, and cloud-native application development.

Location:

PRC - Shanghai

Job:

Technology

Schedule:

Regular

Employee Status:

Full time