AI Engineer (Gen AI Platform Services) - New York
Core
Design, develop, and deploy scalable Gen AI platforms and services including LLM inference, agentic workflows, and vector search to improve associate productivity and customer engagement.
Role type
Senior IC AI Engineer (Gen AI Platform)
Builds
Production AI systems, foundation model training pipelines, and agentic workflows for banking products
Domain
Financial Services / Generative AI / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, LLM inference, vector databases, distributed systems design, model optimization, agentic AI workflows
Preferred skills
Leading AI system development, cloud platform deployment (AWS/GCP/Azure), hardware utilization optimization, AI model governance, architectural decision-making, mentoring
Technologies
AWS Ultraclusters, Hugging Face, PyTorch, vector databases, GPU/TPU infrastructure
Responsibilities
Design and implement end-to-end architecture for complex AI systems; optimize training and inference for latency, throughput, and cost; define service-level objectives for AI reliability; lead cross-functional technical reviews for security and compliance; mentor senior associates on scalable design and performance tuning.
Seniority
Senior, hands-on IC with mentorship responsibilities
