09.06.2024
AWS Data Engineer/JHB
Rooftop Recruitment
South Africa, Johannesburg
AWS Data Engineer/JHB Contract Type: 12 months Our client is seeking a highly motivated and experienced AWS Data Engineer to join their Global Markets division. The role is responsible for closely working with traders, quantitative analysts, and Data Scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS GlueSpark. This role offers an exciting opportunity to collaborate with leading financial institutions, contributing to the design and implementation of data pipelines to support global markets business. It will be advantageous if the candidate has the AWS Certified Machine Learning Specialty Certificate or can develop machine learning (ML) models and automate ML pipelines. Minimum Experience: 5 Years Python/C# Development 3 Years AWS Data Engineering Education Requirements: Bachelor's degree in Computer Science, Information Systems, or related field. Advantageous: AWS Certified Machine Learning Specialty Certificate Responsibilities differ across client engagements but may include: Creating data models that can be used to extract information from various sources and store it in a usable format. Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data. Utilize expertise in SQL and have a strong understanding of ETL and data modelling. Ability to ingest data into AWS S3, perform ETL into RDS or Redshift. Use AWS Lambda (C# or Python) for event-driven data transformations. COMPETENCIES Designing and implementing security measures to protect data from unauthorized access or misuse. Maintaining the integrity of data by designing backup and recovery procedures. Work on automating the migration process in AWS from development to production. You will deliver digestible, contemporary, and immediate data content to support and drive business decisions. You will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation. #J-18808-Ljbffr
Attention! You will be redirected to another site