These jobs were popular with other job seekers We currently have an exciting opportunity for a Data Engineer to join our growing team, our offices are based in Samrand, Centurion, kindly submit all applications to Kyle.Govender@mediro-ict.co.za Job Description Profile Outline A technology focussed individual, data engineers will need to design, configure, develop and deploy data transformations. Key Responsibilties Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates Combine and curate data in a central data lake Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail. Knowledge Bachelor Degree in Computer Science, Software Engineering or Engineering Key Skills Python PySpark SQL Solution Architecture API Design Containers CI/CD Azure Cloud Data stream patterns and technology Data engineering design patterns Package&Remuneration Salary Market Related These jobs were popular with other job seekers #J-18808-Ljbffr