Data Engineer – AI, Agents, Context, Clinical – Senior Associate

Responsibilities

• Build and contribute to the AI context platform
• Implement end‑to‑end pipelines: ingestion → parsing/chunking → enrichment → embeddings → vector indexing → retrieval/serving
• Build and maintain patterns for incremental refresh, backfills, re‑embeddings, deduplication, and lineage across unstructured sources
• Contribute to retrieval quality improvements (query strategies, hybrid search, metadata filtering) in partnership with AI engineers
• Deliver semantic and governed data products
• Implement semantic layers (metrics/entities) that power BI and agent reasoning consistently
• Ensure datasets and indexes are documented and reusable
• Support reliability and performance across assigned workstreams: monitoring, alerting, runbooks, and incident response

Requirements

• BA or BS required, preferably in Computer Science, Engineering, or a technology‑based discipline
• 3–6 years in data engineering or data platform roles with strong hands‑on delivery
• Strong SQL and Python (or Scala/Java); solid production engineering habits
• Experience designing and operating cloud data pipelines at scale
• Experience working with unstructured data processing and search/retrieval concepts