Vetted Data Pipelines Professionals

Stephen Koo

Screened

Senior Software Engineer specializing in LLM infrastructure and AI inference platforms

New York, NY8y exp

“Google Workspace AI engineer who owned major AI assistant infrastructure end-to-end: React/TypeScript UI, a Node.js context-aggregation gateway on Cloud Run, and a Go inference layer on GKE serving Gemini. Built and productionized Gmail RAG + agentic workflows with rigorous evals and guardrails, and has a strong track record of measurable impact (latency, engagement, acceptance-rate lifts) and zero-incident migrations using feature flags/strangler patterns across multiple ML teams.”

“Backend/data engineer with deep healthcare data experience (FHIR, de-identification) across both GCP and AWS. Has built and operated production microservices and ETL pipelines (FastAPI, Dataflow, Glue) with strong reliability practices, and led modernization of a legacy SAS compliance reporting system to cloud services with validated parity and stakeholder-facing Looker comparisons.”

“Engineering leader/player-coach who built and validated a preference-based recommendation engine using clustering, including generating test data to evaluate how clusters evolve over time. Has SRE/DevOps experience and has owned production incidents end-to-end (logging-driven RCA and refactoring patterns that failed at large data scale). Emphasizes quality and platform stability via unit, integration, and load testing, and has managed performance via regular 1:1s and PIPs.”

“Backend/ML platform engineer with Google experience leading Python microservices for an AI-driven recommendation/retrieval system, including PyTorch inference and a retrieval-augmented generation workflow. Strong in production Kubernetes + GitOps (ArgoCD), real-time Kafka/Spark pipelines, and phased on-prem/legacy to AWS/GCP cloud migrations with reliability-focused rollout and rollback practices.”

“Backend/platform engineer who has owned real-time reporting and streaming analytics systems end-to-end, combining FastAPI/Postgres APIs with Kafka consumers, Celery background jobs, and Redis caching. Strong DevOps/GitOps experience deploying Python/Node microservices to AWS EKS with Helm, ArgoCD/FluxCD, and CI pipelines, and has supported phased on-prem to AWS migrations using Terraform and traffic cutovers.”

“Senior engineering/technology leader with experience driving board-backed, multi-year platform transformations in retail commerce (American Eagle) and scaling ML/product delivery platforms at Amazon Alexa. Known for data-driven build-vs-buy decisions, org scaling (6→80), and measurable outcomes including 98.5%→99.9% uptime, 234 experiments generating ~$200M revenue lift, and increasing delivery velocity from 1.5 to 30 features/week while transitioning to DNN/large-model architectures.”

“Built and deployed a production LLM conversational AI system at OpenAI supporting chat, summarization, and semantic search at 1M+ requests/day, driving major latency (40%) and accuracy (25%) improvements through Pinecone optimization and tighter RAG with re-ranking. Also has Amazon experience improving recommendation systems by translating ML metrics into business terms to boost CTR and conversions, with strong MLOps/orchestration depth (Airflow, MLflow, SageMaker, Kubeflow).”