Senior AI Data Engineer, Wealth Management

Job Summary

•    As a Senior AI Data Engineer, your responsibilities include designing, developing, and optimizing scalable data platforms, ingestion frameworks, and transformation pipelines that power analytics, machine learning, and AI solutions across the organization. You will partner closely with data scientists, analysts, architects, business stakeholders, and engineering teams to ensure trusted, efficient, and secure data is available for operational and strategic use across both traditional data workloads and AI-powered systems.

•    You will also support AI agent use cases by building and maintaining the data services, retrieval architectures, semantic indexing pipelines, vector and knowledge store integrations, and monitoring capabilities required for agentic applications to access accurate, governed, and context-rich information.

•    You will be hands on in implementing robust data solutions that support business intelligence, machine learning models, operational reporting, and AI agent capabilities such as intelligent assistants, workflow orchestration, contextual search, and decision-support automation.

Key Responsibilities

• Application Data Engineering - Design, build, and maintain application-level data layers and pipelines that support business applications and AI agent use cases through reliable and governed data flows.
• Golden Source Data Integration - Implement scalable data ingestion and integration pipelines from authoritative upstream systems, helping reduce unnecessary duplication and improving consistency across consuming applications.
• Application-Focused Data Serving - Develop fit-for-purpose data stores, APIs, and serving patterns for application consumption, including Databricks-based serving layers where justified by performance or operational needs.
• Data Quality, Governance, and Observability - Build and operate data quality controls, lineage, access controls, monitoring, and troubleshooting practices that keep application data trustworthy and supportable.
• AI Agent and LLM Enablement - Implement data and integration capabilities for AI agent and LLM-based solutions, including retrieval-ready datasets, tool connectivity, prompt and retrieval orchestration, guardrails, and evaluation support.
• Cross-Functional Delivery - Work closely with engineers, architects, data owners, and AI teams to translate business and technical requirements into practical data solutions while keeping business logic outside the core data layer. Continuous Improvement and Innovation - Contribute to the evaluation and adoption of new tools, patterns, and platform capabilities that improve application data engineering, developer productivity, and AI solution delivery.

Strategy*

• Support the Lead AI Data Engineer, Product Area Lead, and engineering teams in executing data infrastructure priorities and roadmap deliverables.
• Drive and deliver high-quality data solutions that contribute to strategic objectives and enable reliable, data-driven business and AI outcomes.
• Contribute to data platform modernization, engineering best practices, and AI data enablement initiatives across the organization.

Business
•    Promote engineering craftsmanship and focus on delivering business value through reliable and efficient data solutions.
•    Responsible for technical delivery and technical excellence of data pipelines and infrastructure across squads.
•    Works across multiple squads or hives for delivery of complex data integration projects, Features, Epics & Releases.
•    Point of escalation for data pipeline issues and delivery challenges across all impacted hives and squads.
•    Work with Change Delivery Manager (Release Manager) to develop delivery and release plans for data projects with technical dependencies, aligning all partners with support from the team and architect.
•    Exhibit passion for data quality and reliability with a user-first mindset for data consumers.
•    Drive the domain towards future state of banking and technology through modern data practices.
•    Ensure the technical consistency of data solutions with the business architecture, technology architecture and enterprise technology standards. 

Processes
•    Study existing data engineering processes and contribute to improvements to drive up efficiencies in data delivery and operations.
•    Analyse, remove, or mitigate data dependencies across teams to enable speed and quality of delivery.
•    Responsible for the preparation of production data outputs and their planning in alignment to ESDLC standards.
•    Implement DataOps practices to streamline data pipeline development, testing, and deployment.

People & Talent
•    Work on upskilling technical expertise of Engineers to enable them to become more efficient in data engineering practices and tools.
•    Mentoring and training the squad on data engineering best practices, technologies, and methodologies.
•    Share knowledge on data modelling, pipeline design patterns, and performance optimization techniques. 

Risk Management
•    Follows the standards with respect to risk management as applicable to their chapter domain.
•    Adheres to common practices to mitigate risk in their respective domain.

Governance
•    Ensure all artefacts and assurance deliverables are as per the required standards and policies (e.g., SCB Governance Standards, ESDLC etc.).

Regulatory & Business Conduct
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.

Key stakeholders

• Architect, Engineering Leads, AI Capability Chapter, AI Factory
• Global Wealth Management Digital Owners, for business priority and initiatives.
• Business & Technology Managers, for solution design and delivery.

Other Responsibilities
•    Embed Here for good and Group’s brand and values in Wealth Journey squad;
•    Perform other responsibilities assigned under Group, Country, Business or Functional policies and procedures
 

Skills and Experience

•    Software Product Business Knowledge
        •    Strong understanding of Wealth Journey and WM Sales Governance processes (onboarding New to Wealth customers, risk profiling, pre/post trade compliance check, portfolio performance and etc)
•    Software Product Technical Knowledge
        •    Strong understanding of Wealth Journey Platform architecture, functionality, and capabilities, with hands-on experience in solution design, configuration, customisation, and integration.
        •    Databases – Oracle, MS SQL, PostgreSQL, Vector DB
        •    Container Platform – OCP, AKS, EKS
•    Agile Methodologies
•    Software Change Request Management
•    Application Delivery Process
•    Technical Troubleshooting 

Qualifications

•    Education: Bachelor's degree, or higher, in computer science, Software Engineering, Information Technology, or a related field (or equivalent experience)

Required Qualifications & Skills

• Strong programming skills in Python, Java, and SQL, including hands-on PySpark development and practical data engineering patterns for AI and analytics workloads.
• Strong understanding of data modeling, ETL/ELT, Apache Spark, Kafka, Delta Lake, and scalable data design for batch and near real-time use cases.
• Experience with cloud data platforms (AWS, Azure, GCP) and relevant data services, with strong preference for Databricks Lakehouse, Unity Catalog, and Databricks Workflows.
• Hands-on experience with orchestration tools (such as Airflow) for pipeline scheduling, dependency management, and operational reliability across environments.
• Strong knowledge of relational and NoSQL databases, data lakes, and data warehousing, with familiarity in vector data and retrieval patterns used by AI-enabled applications.
• Experience implementing data quality controls, governance, lineage, and security or compliance practices in enterprise environments.
• Strong analytical and problem-solving skills, with the ability to troubleshoot complex data pipeline issues and distributed Spark workloads.

• Ability to collaborate effectively with cross-functional teams, including data scientists, analysts, business stakeholders, AI engineers, platform teams, and architects.
• Experience with Git and CI/CD practices for data pipelines, including deployment automation for Databricks assets and Python services.
• Overall 10+ years of engineering experience building data-driven applications, with demonstrated delivery of enterprise-scale data platforms in cloud environments.
• Hands-on experience integrating AI-enabled capabilities, including retrieval-oriented data preparation, tool or service integration, and production observability for AI-driven workflows.

Preferred Qualifications (Nice to Have)
•    Previous experience in the Financial Technology (Wealth Management, Asset Management) sector.
•    Familiarity with financial concepts like portfolio modelling, rebalancing, risk profiling, and compliance regulations (e.g., FINRA, SEC).
•    Experience with observability tools (Prometheus, Grafana, ELK stack), and/or monitoring patterns for Databricks workloads, AI agents, LLM calls, and tool execution telemetry.
•    Experience building domain-oriented AI or analytics solutions for Wealth Advisory, client servicing, investment research, or advisor enablement use cases.
•    Familiarity with Databricks ML/AI capabilities, vector search, model serving, and integration patterns for enterprise LLM platforms.

About Standard Chartered

We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.

Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.

Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer

In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.