These jobs were popular with other job seekersOur client in Pretoria is recruiting for AWS Data Engineer (Senior) join their team.Job DescriptionData Engineers are responsible for building and maintaining Big Data Pipelines using our client’s Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.Qualifications/Experience:Relevant IT / Business / Engineering DegreeCandidates with one or more of the certifications are preferredAWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform AssociateTerraformPython 3xPy SparkBoto3ETLDockerPowershell / BashAdvantageous Skills Requirements:Exceptional analytical skills analysing large and complex data setsPerform thorough testing and data validation to ensure the accuracy of data transformationsStrong written and verbal communication skills, with precise documentationSelf-driven team player with ability t work independently and multi-taskExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etcExperience developing technical documentation and artefactsKnowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etcExperience working with Data Quality Tools such as Great ExpectationsExperience developing and working with REST API's is a bonusExperience building data pipeline using AWS Glue or Data Pipeline, or similar platformsFamiliar with data store such as AWS S3, and AWS RDS or DynamoDBExperience and solid understanding of various software design patternsExperience preparing specifications from which programs will be written, designed, coded, tested and debuggedStrong organizational skillsBasic experience/understanding of AWS Components (in order of importance):GlueCloudWatchSNSS3LambdaDynamoDBStep FunctionParam StoreSecrets ManagerCloudFormationBusiness Intelligence (BI) ExperienceTechnical data modelling and schema design (“not drag and drop”)KafkaAWS EMRRedshiftBasic experience in Networking and troubleshooting network issuesKnowledge of the Agile Working ModelPackage & RemunerationSalary Market RelatedThese jobs were popular with other job seekers#J-18808-Ljbffr