Data Engineer, Databricks

Forward with Cuscal
At Cuscal, our Commercial and Business teams are the backbone of our organisation. From supporting clients and driving growth to ensuring compliance, managing finances, and fostering a positive workplace culture, our people play a vital role in achieving our commercial objectives while staying true to our values.
If you’re looking for a role where your skills and ideas make a real impact, join us to help shape the future of payments in Australia.

Responsibilities

To suceed in this role you will:; Participate in discovery workshops to understand internal and client problems; Work with the product owner to design solutions that address identified pain points; Employ Cuscal infrastructure for extraction, transformation, and loading (ETL) of data from a wide variety of data sources using ‘Big Data’ technologies; Create and maintain Data pipelines in an efficient manner; Maintain, troubleshoot, and improve the workflow and job scheduling of ETL processes; Assist in the design & development of analytic solutions. Mostly in Databricks SQL Analytics &/or PowerBI; Manage and process complex, large data for analysis (e.g. hierarchies of datasets, inter-relationships, partitions, views, etc.); Maintaining a high level of system availability, system monitoring, fault diagnosis and change implementation and review; Work with our Data Practice to support the tracking, analysis and review of trends in commonly occurring support issues and then embed identified risk management strategies.; Maintain and support applications in line with approved standards and adjust in alignment with Enterprise Architecture; Respond to incidents and manage systems availability (change, incident and problem management); Take part in 24 x 7 on call support roster, as required.

Requirements

You'll stand out if you have:; 5+ years in Data Engineering, ideally in Payments; Strong knowledge in Databricks, Datalake and Data Warehousing techniques.; Experience in one or more programming languages, Python preferred; Experience with Oracle and/or SQL databases and writing SQL. ·; Knowledge and understanding of Databricks tuning and functions; Experience in Analytics; Databricks SQL Analytics &/or PowerBI preferred. ·; Experience in scripting & Infrastructure as Code; eg: PowerShell, Terraform ·; Experience in the financial services or payments sector ·; Experience working within PCI-DSS compliant environment ·; Knowledge of project delivery techniques and methodologies ·; Knowledge of Software Delivery Lifecycle techniques and methodologies ·; Knowledge of Secure Development lifecycle (SDLC) ·; Sound knowledge of ITIL standards.