Data Engineer (Python/Spark)

We are looking for a dynamic Data Engineer to join a team involved in designing, building, and maintaining reliable and scalable data solutions. The ideal candidate is a strong Python developer who has some experience in front-end technologies like JavaScript, CSS3 and/or HTML5. They are a self-starter, comfortable with ambiguity, able to think big (while paying careful attention to detail) and enjoy working in a fast-paced environment.

Responsibilities

Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity; Work with business teams and analysts to understand complex business rules and implement these for deriving insights; Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it; Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues; Provide thought leadership and collaborate with other team members to continue to scale our architecture to evolve for the needs of tomorrow; Develop and support continuous integrations build and deployment processes using Jenkins, Docker, Git, etc.; Define and implement monitoring and alerting policies for data solutions

Requirements

3+ years of hands-on experience in Python; 3+ years of hands-on experience in using advanced SQL queries and writing/optimizing highly efficient SQL queries; 2+ years of working in AWS environment; Experience with Git; Experience with Docker; Comfortable working with business customers to collect requirements and gain a deep understanding of varied business domains; Knowledge of software coding practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations; Bachelor’s degree or equivalent in an engineering or technical field such as Computer Science, Information Systems, Statistics, Engineering, or similar

Nice to have

Some experience in front-end technologies like JavaScript, CSS3 and/or HTML5; Experience integrating with 3rd party APIs is highly desirable

Benefits

Great Company Culture; Growth; Work Hard, Play Hard; Medical (HSA & FSA), dental, vision, 401(k) with company match, employee stock purchase plan, commuter benefits, in-house wellness program, broad learning & development opportunities, charitable giving platform with company match; Perks: fitness allowance, employee discount programs, free games & events, stocked pantries; 14 paid holidays per calendar year; paid vacation time per calendar year (ranging from 15 to 25 days) or eligibility for discretionary time off; up to 10 paid sick days per calendar year; paid parental and compassionate leave; wellbeing programs for mental health and other wellness support; family planning support through Maven; commuter benefits; reimbursements for fitness-related expenses