Backend Engineer

Backend Engineer (API Gateway + Routing + Rate Limiting)

Remote

Product Engineering / Core Services

$5,153 - $5,898/month USD

Role Overview

As a Backend Engineer for API Gateway and Core Services, you will build the control-plane and gateway layer that sits between customers and our serving infrastructure. You will own authentication and tenancy boundaries, request validation, routing to the right model endpoints, quota and rate limit enforcement, and reliability mechanisms that keep the platform stable under load. This role is not just "building endpoints"—it is building a platform interface that is secure-by-default, abuse-resistant, and operable at scale.

You will collaborate with serving/runtime engineers, infrastructure operations, and networking to ensure routing decisions reflect real capacity and failure domains, and that the system exposes the right telemetry for rapid debugging.

Responsibilities

• Build and maintain gateway semantics: streaming correctness, stable API contracts, consistent error models, versioning strategy, and predictable timeout/backpressure behavior.
• Own identity and tenancy boundaries: API key management, org/project separation, permission integration points, audit logging, and least-privilege defaults.
• Implement dynamic routing: model selection policies, endpoint health-aware routing, tenant-aware prioritization, fallback strategies, and safe degradation behavior.
• Design and implement rate limiting and quotas: per-key/org/model enforcement, burst control, fairness, and abuse prevention hooks with transparent feedback.
• Engineer reliability primitives: idempotency, retries/timeouts, circuit breakers, request shedding, queuing behavior, and progressive rollouts for safe change.
• Integrate observability end-to-end: tracing, request metrics, latency breakdown, error attribution, and usage accounting hooks that support debugging and billing-grade correctness.
• Build internal operator tooling: customer configuration, debugging workflows, incident response tools, and safe admin actions with audit trails.
• Partner with serving and infrastructure teams to align interface guarantees with real platform behavior and capacity constraints.

Requirements

• 5+ years backend engineering delivering high-availability production APIs.
• Strong distributed systems fundamentals and experience designing for operability (telemetry, debuggability, safe rollouts).
• Experience implementing routing, rate limiting, or multi-tenant control planes with rigorous correctness expectations.
• Strong security mindset: least privilege, secure defaults, and auditable operational actions.
• Strong written communication and attention to detail—API behavior is a contract.