jobs.pl/Oferty pracy/IT - Rozwój oprogramowania/Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)
Źródło: CrawlJobs

Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

Full-time On-site work

Publication date: 16/11/2026

Crusoe is seeking a Staff Engineer to be the technical lead and systems architect for Crusoe's Managed Data Transfer (MDT) service. MDT moves petabyte-scale training data between hyperscaler storage and Crusoe storage as a managed service, so AI labs and Physical AI companies can train on Crusoe GPUs without building their own transfer pipelines. The role owns the control plane, the transfer worker fleet and the integration with Crusoe's storage and network, and sets the path for adding other clouds and Crusoe-internal transfers. This is an engineering leadership role on a new team. MDT starts from a working prototype that already serves customers in production. The role leads the design through Crusoe's architecture review, mentors the engineers who build it, and reports to the Engineering Manager of Managed Data Transfer within Managed Platform Services.

Responsibilities

Architecture Ownership: Own the end-to-end design of MDT, including the job API and scheduler, the transfer workers on Kubernetes, storage integration and network paths; Prototype Assessment and Migration: Evaluate the production prototype, decide what gets refactored, extended or replaced, and move its current users onto the managed service without interruption; Throughput and Correctness: Set the data-plane strategy (sharding, concurrency, straggler handling, checksum verification) and the benchmarks that prove it, aiming for line-rate transfers over dedicated interconnects; Cross-Team Contracts: Own the interfaces between MDT and Storage, Network, Kubernetes, IAM, Console, Billing and Monitoring; Extensibility and Build-versus-Buy: Design for new clouds and Crusoe-internal transfers with a pluggable transfer engine and regional worker pools, and evaluate open-source and vendor options before the team builds; Operational Excellence: Set the bar for reliability, observability and on-call for every system the team ships; Product Partnership: Work with Product on scope, pricing trade-offs and milestones, and surface edge cases early; Technical Mentorship: Raise the team's level through design reviews, RFC feedback and direct coaching

Requirements

Hands-on experience designing and operating data-intensive distributed systems at scale, including the failure modes that only appear in production; 8+ years shipping production software, including leading a service from prototype to general availability; Understanding of object storage semantics, file systems and TCP throughput, and the ability to profile and fix a transfer that is slower than it should be; Proven ability to evolve a live system toward a better design while keeping risk to current customers low; Experience defining API boundaries and schema contracts with partner teams, and negotiating them to agreement; Operational ownership: carried customer-facing on-call and built systems that are maintainable, observable and predictable; Proficiency in Go or another modern compiled language (Go strongly preferred); Able to explain an architectural decision to an engineer, a PM and an EM, and know which parts matter to each

Nice to have

Experience building or operating bulk data transfer systems, such as AWS DataSync, Google Storage Transfer Service, or rclone at petabyte scale; Familiarity with cloud networking and interconnects, such as AWS Direct Connect or GCP Interconnect; Experience with cross-account cloud IAM and threat modeling for services that hold customer credentials; Approximate nearest-neighbor (ANN) indexing in depth: HNSW, IVF, product and scalar quantization, DiskANN-style indexes that live on SSD; Experience with AI, HPC or Physical AI data pipelines

Benefits

Competitive compensation and equity packages; Restricted Stock Units; Paid time off, paid holidays & leave of absence programs; Comprehensive health, dental & vision insurance; Employer contributions to HSA account; Paid parental leave; Paid life insurance, short-term and long-term disability; Professional development & tuition reimbursement; Mental health & wellness support; Commuter benefits (parking & transit); Cell phone stipend; 401(k) Retirement plan with company match up to 4% of salary; Volunteer time off; Global travel insurance & emergency assistance; Daily meals allowance; Additional perks & programs specific to location
Apply with employer

Podobne oferty

Wszystkie →

Dostosuj zgody

Każdy cel jest opcjonalny i domyślnie wyłączony. Zgodę możesz wycofać w dowolnym momencie.

Pokazujemy oferty najbliżej Ciebie