FunctieomschrijvingAbout Dimension DataAt Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts at what they do and serious about delivering measurable and sustainable value at every turn.RequirementsExtensive understanding and application of Python Development and building complex solutions and applications.Extensive understanding and application of Python and data processing and transformationStrong understanding of Microsoft SQL Server and T-SQL DevelopmentStrong Understanding of Code OptimizationUnderstanding of Real-Time Data Processing and StreamingUnderstanding of Apache BeamAdvantageousUnderstanding of Apache NiFi and building complex workflows.Understanding of opensource streaming technologies (Apache Spark Streaming, Flink)Understanding of Apache KafkaUnderstanding of Apache SparkUnderstanding of Apache HadoopCompetency in Python and developing Spark models.Fundamental understanding of MongoDBFundamental understanding of RedisFundamental understanding of DatabricksFundamental understanding and optimization of Linux and cloud environments.Key Performance Areas:Effectively conceptualize, design, and create high-quality, custom workflows and analytics solutions.Develop, test, and implement big data solution designs.Understand client requirements and establish knowledge of data for accurate design, analysis, and retrieval.Pull data from various data sources and combine it to store it in a data store for analysis and retrieval.Collaborating with end users on standardized and best practice approaches.Making suggestions and enhancements on existing solutions.Providing regular and timely feedback to clients on design and build statusEducating requestors as to appropriate and desirable parameters to ensure they get the information they needEnsure all tasks are updated on agile boards in a timely mannerAssist Project Managers and Change and Training Managers with any project and training related administration tasksActively Upskill in relevant technologies as prescribed by team leadershipIntegration and execution with Machine-learning models and AI in-flow.Documentation and Design of SolutionsJob Related Experience:Minimum 4+ years work experience with exposure to data pipeline development and solutionsarchitecture as well as project management/coordination experience.Behavioural Competencies:Good Communication SkillsGood Presentation SkillsGood AdaptabilityMust take InitiativeGood at planning and organisingGood at TeamworkGood at InfluencingGood at Problem SolvingMust have Attention to DetailMust be good at Analytical ThinkingMust have a desire for InnovationMust be able to Conceptualise ideasQualificationsB Degree – Computer Science / EngineeringHortonworks Certified