18.04.2024
Data Engineer Pretoria
Mediro ICT Recruitment
South Africa, Pretoria
These jobs were popular with other job seekersOur client in Pretoria is recruiting for AWS Data Engineer (Advanced) join their team.Job DescriptionData Engineers are responsible for building and maintaining Big Data Pipelines using our client’s Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.Qualifications/Experience:Relevant IT / Business / Engineering DegreeCandidates with one or more of the certifications are preferred:AWS Certified SysOps AssociateAWS Certified Architect AssociateAWS Certified Architect ProfessionalHashicorp Certified Terraform AssociateBusiness Intelligence (BI) ExperienceAdvantageous Skills Requirements:Exceptional analytical skills analysing large and complex data sets.Perform thorough testing and data validation to ensure the accuracy of data transformations.Strong written and verbal communication skills, with precise documentation.Self-driven team player with ability to work independently and multi-task.Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.Experience preparing specifications from which programs will be written, designed, coded, tested and debugged.Strong organisational skills. Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Experience working with Data Quality Tools such as Great Expectations.Experience developing and working with REST API's is a bonus.Basic experience in Networking and troubleshooting network issues.Knowledge of the Agile Working Model.Creating a network community with all needed data stewards within the Group IT.Self-driven data obtaining within the community.Advantageous Technical Skills / Technology:TerraformPython 3xPy SparkBoto3ETLDockerPowershell / BashBasic experience/understanding of AWS Components (in order of importance):Glue (ETL Scripting)CloudWatchSNSS3LambdaDynamoDBStep FunctionParam StoreSecrets ManagerCloudFormationTechnical data modelling and schema design (“not drag and drop”)KafkaAWS EMRRedshiftPackage & RemunerationSalary Market RelatedThese jobs were popular with other job seekers#J-18808-Ljbffr
Attention! You will be redirected to another site