Data Engineer

About Uni Systems

At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.

What You'll Do

What will you be doing in this role?

• Designs and implements data pipelines and data stores to acquire and prepare data.
• Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
• Carries out routine data quality checks and remediation Programming/software development.
• Designs, codes, verifies, tests, documents, amends and refactors moderately complex programs/scripts.
• Applies agreed standards and tools to achieve a well-engineered result.
• Proposes practical solutions to resolve issues.
• Collaborates in reviews of work with others as appropriate.
• Defines the software modules needed for an integration build and produces a build definition for each generation of the software.
• Assesses the integrity of data from multiple sources.
• Provides advice on the transformation of data from one format/medium to another.
• Enables the availability, integrity and search ability of information through the application of formal data and metadata structures and protection measures.
• Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
• Establishes, modifies and maintains data structures and associated components.
• Communicates the details of data structures and associated components to others using the data structures and associated components

Requirements

What will you be bringing to the team?

• Have at least a high school certificate.
• Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management in an on premise environment.
• At least 4 years' experience planning and maintaining data lakes, databases and pipeline processes, both batch-wise and (near) real-time.
• Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using data integration technologies on premise.
• Experience in using of data engineering tools to support data science, data analytics and data visualization (KNIME, SQL Server, Power BI is the preferred toolset).
• Familiarity with KNIME Analytics Platform and Server is preferred
• Experience with state-of-the-art data engineering, analytics, data integration and pipeline tools/programming language (Python).
• Solid understanding of data security best practices, including data encryption, access controls, authentication/authorization mechanisms, and compliance requirements.
• Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines.
• Familiarity with containerization and orchestration tools such as Docker and Kubernetes is a plus.
• Knowledge of best practice of software development. E.g. CI/CD pipelines, unit/functional testing, following styling guides is a plus.
• Experience working within NCIA or similar defence-related environments is considered an advantage.
• Knowledge of NATO Communication and Information Systems Infrastructure is considered an advantage.
• Prior experience working in an international environment comprising both military and civilian elements is considered an advantage.
• Proficiency in English language a a C1 level.