Vetted Microservices Professionals

Stephen Koo

Screened

Senior Software Engineer specializing in LLM infrastructure and AI inference platforms

New York, NY8y exp

“Google Workspace AI engineer who owned major AI assistant infrastructure end-to-end: React/TypeScript UI, a Node.js context-aggregation gateway on Cloud Run, and a Go inference layer on GKE serving Gemini. Built and productionized Gmail RAG + agentic workflows with rigorous evals and guardrails, and has a strong track record of measurable impact (latency, engagement, acceptance-rate lifts) and zero-incident migrations using feature flags/strangler patterns across multiple ML teams.”

“Built Reval as a full-stack product/company, using a Next.js frontend with Java Spring and Python FastAPI backends, including AI-driven workflows powered by frontier models. Has hands-on experience improving search UX and relevance with a KNN-based people search, and emphasizes heavy testing and dataset iteration to manage LLM nondeterminism.”

“Backend/data engineer with experience on large-scale consumer platforms (Google and Meta), building high-traffic Python microservices (REST/gRPC) on Kubernetes with strong reliability/observability practices. Delivered AWS container-based deployments with CI/CD and IaC, and built AWS Glue ETL pipelines on S3 with schema evolution and data quality controls; also has demonstrated SQL tuning impact (15% latency reduction) and incident ownership for batch pipelines.”

“Backend/data engineer with deep healthcare data experience (FHIR, de-identification) across both GCP and AWS. Has built and operated production microservices and ETL pipelines (FastAPI, Dataflow, Glue) with strong reliability practices, and led modernization of a legacy SAS compliance reporting system to cloud services with validated parity and stakeholder-facing Looker comparisons.”

“Chief AI Strategy at startup Zenera with 30 years in technology strategy/design, experienced in building business plans across startups and large enterprises (projects, new products, and M&A). Deeply familiar with enterprise AI go-to-market challenges (slow procurement/pilot cycles) and preparing for VC expectations (e.g., targeting a16z) by emphasizing unique tech and paying customers.”

“Engineering leader/player-coach who built and validated a preference-based recommendation engine using clustering, including generating test data to evaluate how clusters evolve over time. Has SRE/DevOps experience and has owned production incidents end-to-end (logging-driven RCA and refactoring patterns that failed at large data scale). Emphasizes quality and platform stability via unit, integration, and load testing, and has managed performance via regular 1:1s and PIPs.”