Skip to content
NEXTMOVEFDE careers · United States
Weights & Biases

Senior Software Engineer - Data Lake & BI

AI summary of the role

Senior Engineer on CoreWeave's Benchmarking & Performance team, owning the planet-scale performance data warehouse.

What you’ll do

  • Design and build the core performance data lake on columnar storage (Apache Iceberg, Parquet, Avro) with hot/cold storage tiering at petabyte scale.
  • Define and govern schemas for performance telemetry including latency, throughput, GPU utilization, and hardware health signals.
  • Own and extend the time-series database layer, writing optimized PromQL/MetricsQL queries for real-time dashboards and alerting.
  • Build self-service BI views and dashboards (Grafana, Looker) that translate raw data into actionable insights for engineers and executives.

What you’ll bring

  • 5+ years building distributed systems, data platforms, or cloud services.
  • Strong coding in Python or Go; deep familiarity with networked systems and performance.
  • Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry).
  • Demonstrated expertise with data lake architectures, columnar databases, and modern table formats (Iceberg, Parquet, Avro).

Technologies

Python · Go · Kubernetes · Prometheus · Grafana · OpenTelemetry · Apache Iceberg · Parquet · Avro · PromQL · MetricsQL · Looker

Source and classification

Internal deployment & tooling · Evidence for this classification:

Engineer to be a driving force on CoreWeave's Benchmarking & Performance team, with a singular focus on our planet-scale performance data warehouse. You will own the architecture and evolution of how we ingest, store, transform, and surface performance data across every data center in our global infrastructure—turning billions of raw events into the trusted, queryable insights that power our engineering and business decisions. If you believe that the right storage format, the right schema, and the right query engine can turn a mountain of telemetry into a competitive advantage, this role was built for you. You will shape the data foundations that underpin industry-leading benchmark publications, internal performance SLAs, and executive-level reporting—working hand-in-hand with world-class partners and communities to ensure every number we publish is authoritative, reproducible, and
More from the job description

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com. What You'll Do: CoreWeave is the top-rated AI-cloud for high-performance GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost-efficiency—an unmatched alternative to traditional hyperscalers. At CoreWeave, infrastructure is the product. About this role: We're looking for a Senior Engineer to be a driving force on CoreWeave's Benchmarking & Performance team, with a singular focus on our planet-scale performance data warehouse. You will own the architecture and evolution of how we ingest, store, transform, and surface performance data across every data center in our global infrastructure—turning billions of raw events into the trusted, queryable insights that power our engineering and business decisions. If you believe that the right storage format, the right schema, and th [... source excerpt omitted ...] and executive-level reporting—working hand-in-hand with world-class partners and communities to ensure every number we publish is authoritative, reproducible, and actionable. Key Responsibilities: Data Lake Architecture - Design and build our core performance data lake on columnar storage foundations. Select, integrate, and optimize table formats (Apache Iceberg, Parquet, Avro) to balance query performance, storage cost, and schema evolution. Implement hot and cold storage tiering strategies that keep recent data instantly queryable while efficiently archiving historical benchmarks at petabyte scale. Schema Design & Data Modeling - Define and govern schemas for performance telemetr [... source excerpt omitted ...] data platforms, or cloud services. Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance. Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry). Demonstrated expertise with data lake architectures, columnar databases, and modern table formats (Iceberg, Parquet, Avro); you understand the trade-offs between them and know when to reach for each. Practical experience designing and managing hot/cold storage tiers for large-scale analytical workloads. Strong schema design instincts—you think in partitions, sort keys, and evolution strategies, not just tables and c

How jobs are selected

Employer postings · Data from · Sources