Data Engineer

With the international capability to deliver engineering services in electrical, controls, machine design, information technology, and manufacturing business strategy, Avanceon creates integrated solutions that enable clients to control, improve, and optimize their manufacturing processes. Avanceon's experience in engineering services, software solutions, energy optimization, and support services enable our clients the opportunity to achieve powerful business results and financial returns.

Octopus Digital (a subsidiary of Avanceon Limited) is looking for experienced Data Engineers who are willing to develop and implement data warehouse solutions for company-wide applications and manage large sets of structured and unstructured data by using the technologies mentioned below.

Responsibilities

Hands-on experience on Azure/AWS.; Experience on a spark, python.; Design and develop code, scripts, and data pipelines that leverage structured and unstructured data; Should be able to manage Data ingestion pipelines and stream processing; Write and optimize complex SQL and shell scripts; Experience in Big Data querying; Experience with NoSQL databases; Experience with Hadoop distributions as Azure DataLake HDFS; Training/Certification on Data Lake HDFS will be a plus.; Ability to meet deadlines, identify issues and resolve with minimal direction

Requirements

At least 2-3 years of relevant working experience with Cloud Development; Bachelor/Master Degree in Computer Science with relevant working experience.