Job Advert Summary

• We are developing and refining our existing IoT platform, policy management system, and agent app. To support these efforts, we need to migrate and improve our business intelligence (BI) infrastructure.
• As a Data Engineer, you will take ownership of this migration, focusing on designing and building scalable data pipelines that will support our BI and analytics needs.
• In this role, you will be responsible for evaluating architectures and technologies, building proofs of concept (PoCs), and driving the development of ETL processes that will enhance our data infrastructure.
• You’ll work closely with other team members to ensure the systems you develop are cohesive, maintainable, and scalable, aligning with the broader goals of the organisation.

Required Knowledge and Experience

• Hard skills
• Experience with data warehousing solutions.
• Strong data modelling skills, ensuring data structures are efficient and well-optimised.
• Experience designing and implementing ETL processes and data pipelines.
• Experience with Python and its libraries commonly used in data engineering.
• A strong understanding of relational databases (e.g. MySQL, PostgreSQL) and SQL.
• Experience with AWS (S3, EC2, GLUE, Redshift).
• Strive to create clean, maintainable code with an emphasis on scalability and performance.
• Emphasis on testability, implementing proper unit and integration tests in data pipelines.
• Have strong research skills to stay up to date with new technologies.

Soft skills

• Be diligent, with strong attention to details such as naming conventions, data accuracy and performance optimisations.
• Be willing to work closely in a team, and contribute to the overall Lumkani development practice.
• Be excited about sharing knowledge with the team and learning from others.
• Be self-motivated, with the ability to work autonomously and deliver quality work under minimal supervision.

Educational Requirements

• 6+ years of relevant work experience in Data Engineering.
• Be able to demonstrate data-related projects or code you are proud of.