Job Description
To design, code, verify, test, document, amend, and secure data pipelines and data stores according to agreed architecture, solution designs, standards, policies and governance requirements. To monitor and report on own progress and proactively identify issues related to data engineering activities. To collaborate in reviews of work with others where appropriate
Qualifications
Type of Qualification: First Degree
Field of Study: Information Technology
Experience Required
Software Engineering
Technology
5-7 years
Experience in building databases, warehouses, reporting and data integration solutions. Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
5-7 years
Experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools
5-7 years
Understanding of data pipelining and performance optimisation, data principles, how data fits in an organisation, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory
