Role Description
The Data Integration / Analytics Engineer unlocks the business value of data by managing, transforming and operationalising data to meet the specific analytics requirements of end users. This includes the development and sustainment of data transformations that map domain specific datasets to the enterprise ontology using Palantir platforms including Gotham and Foundry.
They also develop and support end-to-end data management processes, using appropriate tools and techniques that conform to agreed process standards and industry specific regulations. This involves sharing outcomes and experience with others to support development and growth in a diverse team environment.
This role sits within the AIT team which provides fit-for-purpose data analytics capabilities that reliably serve business use cases. The team employs contemporary and Innovative tools and techniques to automate data engineering tasks on enterprise analytic platforms.
Part of this role is ensuring that development activities align with standard engineering and technical approaches employed by the team, and that risks associated with deployment are adequately managed and mitigated.
Key Responsibilities
Manages the iteration, review and maintenance of data requirements and data models. DTAN
Sets standards for data modelling and design tools and techniques, advises on their application and ensures compliance. DTAN
Provides expert guidance in the selection, provision and use of database and data warehouse architectures, software and facilities. DBDS
Manages the investigation of enterprise data requirements based upon a detailed understanding of analytic use cases. DTAN
Coordinates the application of analysis, design and modelling techniques to establish, modify or maintain data structures and their associated components. DTAN
Provides expert advice and guidance to enable the organisation to get maximum value from its data assets. DATM
Creates and maintains data pipelines to connect data within and between data stores, applications and organisations. DENG
Works collaboratively with teams of technology specialists, security professionals and systems administrators, within the organisation and with external partners.
Core Capabilities
A deep understanding of systems integration and architecture including integration patterns, middleware and platforms.
Proficiency in a number of programming and scripting languages including SQL, Python and Java.
Analytical and problem-solving skills including the ability to apply logical reasoning to overcome integration challenges.
Effective data management and workflow design abilities including the understanding of data structures, databases and ETL processes.
Strong communication and collaboration skill including a proven ability to work effectively as a member of cross-functional teams.
Mandatory Qualifications
5+ years of relevant data integration / analytics engineering experience.
Desirable Qualifications
IT-related degree (e.g. Bachelor of Computer Science or Bachelor of IT)
Required Knowledge/Experience and tools
Required:
Proven experience in using enterprise data pipeline platforms such as MS-SSiS, Informatica, Apache Kafka and NiFi to manage corporate data assets.
Proven experience using enterprise data platforms such as Oracle, MS SQL Server, Apache Spark and ElasticSearch to support analytic use cases.
Experience In one or more of the below technologies/languages: Python Swing, React
Experience troubleshooting IT systems and using logging tools such as Elastic Stack (ELK).
Highly Desirable:
• Experience with continuous integration and delivery pipeline toolsets including GitLab, Artifactory, Jenkins, Docker, Ansible or similar applications.
• Experience using and maintaining Jira tickets and boards.
• Experience providing advice and support to analytic end-users.
• Experience with Palantir products such as Gotham or Foundry
SFIA Skills/Attributes
DATM - Data management
DTAN - Data modelling and desig
DENG - Data engineering
DBDS - Database design
Desirable skills:
SINT - Systems integration and build