06.04.2024
Data Engineer
Intellinexus
South Africa, Cape Town
These jobs were popular with other job seekersIntellinexus is a business-led data and business intelligence consultancy that empowers organisations with data-driven decision-making capabilities. We combine innovation and expertise with access to the best talent to help organisations become smarter, more agile, and more resilient to the changes in their operating environments. Our expert teams apply a mastery of data and technology to craft strategies that revolutionise business decision-making, and give organisations access to real-time, actionable insights into the performance of their business. For more information, please visit www.intellinexusgroup.com What do we offer?We offer both remote and hybrid work opportunities.Intellinexus is an SME, therefore you get a lot of exposure to different technologies, solutions and techniques during projects.Intellinexus supports career development and growth of its employees, therefore time and money is invested to grow their consultants in their careers.Overall purpose of the roleThe Data Engineer is responsible for designing, building, and maintaining the data infrastructure that supports the organization's data needs. They will work closely with various teams to gather requirements, design, and develop data pipelines, and ensure data quality and availability for analysis and reporting.Duties & ResponsibilitiesWork with business stakeholders and data analysts to understand data requirements and design scalable data architectures that meet those needs.Develop and maintain data pipelines that extract, transform, and load data from various sources into the data warehouse or data lake.Design and develop data models and schemas that support efficient querying and analysis.Develop and maintain data integration solutions to ensure data consistency and accuracy across various systems and applications.Ensure data quality and availability for analysis and reporting by implementing data validation, cleansing, and enrichment processes.Conduct performance tuning and optimization of data pipelines and data storage solutions to ensure optimal performance and scalability.Collaborate with other teams to integrate data engineering solutions with other systems and applications.Ensure that data engineering solutions are secure, compliant, and meet data governance requirements.Provide documentation and support for data engineering solutions to ensure that they are maintainable and scalable.Desired Experience & QualificationBachelor’s degree in Commerce, Computer Science, Data Science, Engineering, or related field.Minimum of 5 years of experience in data engineering or a related field.Strong understanding of data warehousing concepts, ETL processes, and data modelling techniques.Experience with big data technologies.Proficient in SQL and data querying.Experience with cloud-based data storage solutions such as AWS S3 or Azure Blob Storage.Experience with data integration solutions such Data Services and Azure Data Factory.Familiarity with Azure analytics services such as Azure Synapse Analytics (formerly SQL Data Warehouse).Experience with Azure data services such as Azure Data Factory, Azure Data Lake, and Azure Databricks.Strong understanding of SAP BIP architecture, administration, and security.Knowledge of SAP systems such as SAP ERP, SAP BW, and SAP HANA.Experience with integrating SAP BIP with other systems and applications.Experience with SAP BusinessObjects Cloud, SAP Lumira, or SAP Analytics Cloud is a plus.Experienced in implementation of CI/CD pipelines through technologies such as GitLab, Azure DevOpsProficiency in Python, Java, or ScalaStrong problem-solving and analytical skills.Excellent communication and collaboration skills.Ability to work independently and as part of a team.Azure ADF, Synapse, Data Modelling (Kimball and Data Vault)Interested?Our aim is to help you build a successful career with usWe’re all about building strong, lasting relationships with our employees. We know that you have hopes for your future – your career, your personal development, and for achieving great things. We pride ourselves in helping our employees to realize their worth. Through Intellinexus and its clients, we provide many opportunities for growth and development.These jobs were popular with other job seekers#J-18808-Ljbffr
Attention! You will be redirected to another site