DDN is seeking a Staff Replication Development Engineer to lead the design and development of the replication engine for the Infinia AI Data Platform. This role focuses on building enterprise-grade asynchronous replication capabilities that enable reliable and secure disaster recovery for large-scale data systems.
You will work on developing high-performance replication pipelines, efficient data synchronization mechanisms, and secure data transfer systems. This role requires deep expertise in distributed systems and strong technical leadership to deliver a scalable and resilient replication foundation.
You will work on developing high-performance replication pipelines, efficient data synchronization mechanisms, and secure data transfer systems. This role requires deep expertise in distributed systems and strong technical leadership to deliver a scalable and resilient replication foundation.
Responsibilities
Design and develop multi-threaded asynchronous replication systems with parallel streaming capabilities; Build object-level delta replication with checkpointing and resume functionality; Develop replication engines supporting bucket/share-level replication controls; Implement secure data transfer mechanisms using TLS 1.3 with mutual authentication; Ensure end-to-end data integrity through checksum validation and verification pipelines; Design and implement manual failover workflows for disaster recovery scenarios; Build and maintain REST APIs for replication configuration, control, and automation; Develop metadata tracking and change detection systems to enable efficient replication; Implement RPO visibility, alerting, and operational insights for replication status; Contribute to monitoring dashboards focused on replication health and performance; Ensure systems are designed for high availability, fault tolerance, and scalability; Partner with QA teams to drive performance, resiliency, and scale validation; Collaborate with backend, security, and platform teams to deliver end-to-end replication workflows; Participate in debugging, production issue resolution, and continuous improvement of replication reliability; Provide technical leadership, architectural guidance, and mentorship to the engineering teamRequirements
8+ years of experience in distributed systems, storage systems, or backend software engineering; Strong programming skills in one or more languages: C++, Go, Java, or Rust; Experience designing and building data replication systems, data pipelines, or distributed data services; Deep understanding of distributed systems concepts (consistency, availability, scalability, fault tolerance); Strong expertise in multi-threading, concurrency, and parallel processing; Knowledge of networking protocols and secure communication (TCP/IP, HTTP/HTTPS, TLS); Experience implementing data integrity mechanisms (checksums, validation, consistency checks); Experience designing and building REST APIs and service-based architectures; Familiarity with checkpointing, failure recovery, and retry mechanisms in distributed systems; Basic understanding of observability concepts (metrics, logging, alerting); Strong debugging, problem-solving, and system design skillsNice to have
Experience with asynchronous replication, disaster recovery (DR), or backup systems; Familiarity with object storage or large-scale data storage systems; Knowledge of delta encoding, change data capture, or incremental data synchronization techniques; Experience building high-throughput, low-latency data movement systems; Exposure to security practices including mutual TLS, encryption, and authentication; Experience working on enterprise-scale data platforms or storage products; Familiarity with performance optimization and large-scale system tuningHow to apply
Apply online: https://www.jobs.pl/en/oferta/103150640/aplikuj
JOBS.pl · https://www.jobs.pl/staff-engineer-replication-oferta-103150640


