The position grows our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
Responsibilities
Brainstorm and create new platforms that can help make available to cluster users in all shapes and forms, with low latency and horizontal scalability; Make changes to diagnose any problems across the entire technical stack; Design and develop a real-time events pipeline for data ingestion for real-time dashboarding; Develop complex and efficient functions to transform raw data sources into powerful, reliable components of the data lake; Design and implement new components and various emerging technologies in Hadoop Eco-System, and successful execution of various projectsRequirements
Strong hands-on experience of 4+ years with Spark, preferably PySpark etc.; Excellent programming/debugging skills in Python; Experience with any scripting language such as Python, Bash etc.; Good experience in Databases such as SQL, MongoDB etcNice to have
Good to have experience with AWS and cloud technologies such as S3How to apply
Apply online: https://www.jobs.pl/en/oferta/103451828/aplikuj
JOBS.pl · https://www.jobs.pl/data-engineer-oferta-103451828






