Senior Data Infra Engineer
Mountain View, CA
* NewsBreak reaches tens of millions of users every day. Every feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own * We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform --- someone who takes end-to-end ownership, drives reliability, and can translate ambiguous business needs into production-grade data systems * Own the streaming data backbone --- design and operate high-throughput Kafka pipelines carrying user events (clicks, reads, impressions, shares) from mobile clients through to downstream consumers: the data warehouse and real-time analytics * Build and maintain batch pipelines at scale --- author and optimize Spark jobs processing billions of rows daily: content ingestion, engagement aggregation, and user-level feature computation. Own pipeline reliability, incremental backfill strategies, and cost per TB processed * Drive pipeline observability --- instrument data quality checks, freshness monitors, and anomaly alerts so issues are caught before they reach dashboards. Define SLOs for data freshness and completeness, and own them * Model structured and unstructured data --- design data models that serve analytics and product use cases. Act as the data POC across teams and be the person who pushes back when a schema decision will hurt us six months later * Partner with data scientists and platform engineers --- understand data needs across teams and drive key data infrastructure decisions. Unblock downstream teams without becoming a ticket queue * Improve efficiency --- reduce compute costs and job latency through query optimization, smarter partitioning, better resource scheduling, and tiered storage strategies * Raise the platform bar --- contribute to shared infrastructure: pipeline framework standards, orchestration patterns (Airflow), reusable Spark libraries, and data catalog hygiene. Mentor junior engineers on the team ### Benefits * Work from home opportunities * Paid time off and paid holidays * Paid parental leave * FSA and commuter benefit programs * Team activity budget * Top-tier 401(K) plan with company matching * Health, dental, and vision care for you and your family