Data Engineer
lokalizacja: Polska
numer referencyjny: 1192333/jobs.pl
Hays IT Contracting is a cooperation based on B2B principles. We connect IT specialists with the most interesting, technological projects on the market.
Join the group of 500 satisfied contractors working for Hays clients!
For our Client, we are currently looking for Candidates for the position:
Senior Data Engineer
Location: Remote
Contract type: B2B Via Hays
Rate: 210 - 230 PLN/h + VAT
Contract length: Long-term cooperation
Start: ASAP
Project and responsibilities:
- Python/ PySpark
- ETL
- Cloud migration experience (mostly AWS but other clouds are also acceptable)
- Databricks : very nice to have
- Database Experience (Oracle, MSSQLServer preferably)
(We are looking for a Data Engineer with a strong Python Development background with a focus on Data Bricks as a very nice to have)
Team is working remotely (PL/ US/ EU); there is a possibility to work from Kraków office.
Building ecosystem for commercial risk to help companies of Aon to operate the risk. Building Data feed & pipelines across the data system for operations, finance etc. Ecosystem is planned to be launched in as more as possible amount of countries (Aon operates in 120 countries)
About the role:
We are seeking for highly experienced Senior Data Engineer to join our team, bringing expertise in data engineering, migration methodologies with proven track of record working on large data migration projects in insurance/finance industry. Successful candidate will collaborate with data migration lead, business stakeholders and cross-functional team of data analysts & engineers responsible for end to end data migration process.
Responsibilities:
- Architecture Design: be familiar with the design and implementation of scalable and efficient data architectures for large-scale systems.
- Data Integration: Design, develop, and maintain data pipelines for integrating diverse data sources into a unified format embedding best practices and standards.
- Data Management: Manage and optimize data to ensure efficient data storage, retrieval, and processing.
- ETL Processes: Develop and implement ETL (Extract, Transform, Load) processes to facilitate data migration and transformation.
- Data Quality Assurance: Implement data quality checks and ensure data integrity throughout the migration process.
- Collaboration: Work closely with cross-functional teams, including data migration delivery lead, data analysts, business analysts, stakeholders and clients to support data-related needs. Participate in agile ceremonies, providing regular updates on technical progress and addressing potential risks
- Documentation: Create and maintain comprehensive documentation for data processes, ensuring knowledge transfer and system transparency as well as contribute to development of the data migration playbook.
- Performance Monitoring: Monitor and optimize data performance to meet defined service-level agreements.
- Troubleshooting: Identify and resolve data-related issues in a timely manner, collaborating with relevant teams.
Requirements:
- Experience: Proven experience (7+ years) as a Senior Data Engineer or similar role in data migration projects
- Advanced Technical Skills: In-depth knowledge in programming languages such as Python or Scala.
- Experience with ETL tools and frameworks (DataBricks, Apache SparkSql).
- Strong SQL skills for data manipulation and querying.
- Hands on experience with agile practices, source versioning and agile project management tools (GitLab, Jira, Confluence, other similar)
- Database Knowledge: Familiarity with relational and non-relational databases (Oracle, MSSQLServer).
- Problem-Solving: Proven ability to solve complex data engineering challenges and optimize system performance.
- Good communication and interpersonal skills to collaborate effectively with team members and stakeholders
- English C1; German nice to have.
- Education: Bachelor’s or higher degree in Computer Science, Information Technology, or a related field.
What will the recruitment process look like:
2-3 stages
Offer????!
Hays Poland sp. z o.o. is an employment agency registered in a registry kept by Marshal of the Mazowieckie Voivodeship under the number 361.
hays.pl
Hays Poland sp. z o.o. jest agencją zatrudnienia nr 361
Niemcy
Wielka Brytania
Holandia
Irlandia
Norwegia
Szwajcaria