Staff/Senior Distributed Systems Engineer
AI summary of the role
Staff/Senior distributed systems engineer owning the architecture and operation of Proxi's distributed execution platform for government-facing intelligence systems.
What you’ll do
- Own architecture and operation of Proxi's distributed execution platform (ingestion, document processing, search, long-running research jobs).
- Manage deployment of GovCloud and Air-Gapped resources for sensitive environments.
- Orchestrate long-running agent research tasks including scheduling, lease management, and retention.
- Optimize queues and cross-cloud information pipeline scalability.
What you’ll bring
- Expertise in queue/log/workflow/actor systems (Kafka, Redpanda, Pulsar, SQS, Pub/Sub, RabbitMQ, Temporal).
- Experience with at-least-once delivery patterns, transactional outbox/inbox, sagas, dead-letter handling, replay.
- Deep knowledge of CPU/memory/disk/network/GPU-aware scheduling and distributed coordination (leader election, locks, leases).
- Proficiency with PostgreSQL, object storage, Redis, search indices (Elasticsearch/Typesense), vector stores, CDC.
Technologies
Kafka · Redpanda · Pulsar · SQS · RabbitMQ · Temporal · PostgreSQL · Redis · Elasticsearch · Typesense · Terraform · OpenTelemetry
Source and classification
Internal deployment & tooling · Evidence for this classification:
deep public-sector expertise, and forward-deployed execution. Our team includes leaders and builders from the White House, U.S. Department of State, Datadog, and Microsoft. We are backed by leading institutional investors and trusted by organizations working on high-stakes problems across government and industry. MISSION As a distributed systems engineer at Helios you will expand and operate the distributed execution, storage, scheduling, and reliability primitives that support data ingestion, document processing, search indexing, model inference, agents, and continuously running research workflows. The primary responsibility centers around the orchestration of critical infrastructure to meet mission-critical performance and reliability guarantees. Our platform runs a multitude of network crawling, compute grids, memory-heavy document processing, OCR, inference, and latency-sensitive
More from the job description
Staff/Senior Distributed Systems Engineer New York City | Full-time | On-site in SoHo, five days per week Reports to the CTO and works directly with the founding team. ABOUT HELIOS Helios is building a new kind of company to solve America’s hardest problems, starting with the government interaction layer. Government shapes every consequential market, but the infrastructure connecting public institutions and private organizations remains fragmented, manual, and difficult to navigate. Helios is rebuilding that layer. Our core platform, Proxi, gives organizations the intelligence they need to understand what government is doing, why it matters, and what to do next. From that foundation, we design and deploy secure, mission-specific systems for government agencies, enterprises, and institutions operating in complex and highly regulated environments. We bring together frontier AI, deep public-sector expertise, and forward-deployed execution. Our team includes leaders and builders from the White House, U.S. Department of State, Datadog, and Microsoft. We are backed by leading institutional investors and trusted by organizations working on high-stakes problems across government and industry. MISSION As a distributed systems engineer at Helios you will expand and operate the distributed execution, storage, scheduling, and reliability primitives that support data ingestion, doc [... source excerpt omitted ...] nd availability of our entire data corpus as well as supporting the continued construction of the Helios Rapid Ontology System (H.R.O.S.), our long horizon memory data plane. KEY RESPONSIBILITIES Own the operation and architecture of Proxi’s distributed execution platform, covering ingestion, document processing, search index performance and long-running research jobs. Manage the deployment of our GovCloud and Air-Gapped resources for sensitive environments. Manage the orchestration of long-running agent research tasks including scheduling, lease management and retention. Queue optimization and cross-cloud information pipeline scalability. Build out dedicated resource-aware auto [... source excerpt omitted ...] scaling architecture for fast search and document processing resources. Manage CI/CD and compliance operations across the entire Helios platform. Support global forward embedded customer infrastructure efforts. WORKING AT HELIOS This is a full-time, in-person role based in our SoHo office in New York City. Team members are expected to work from the office five days per week. Certain customer engagements may require background checks, security reviews, access approvals, or eligibility for a U.S. government security clearance. Some projects may be subject to U.S. citizenship or other customer-specific access requirements. We're not looking for passengers; we want driven innov
Employer postings · Data from · Sources