05.06.2024
BI Operations Manager
Sanlam
South Africa, Bellville
Role Overview: As a BI Operations Manager, you will play a pivotal role in ensuring establishing the operation of our business intelligence (BI) data hubs and vaults. Your responsibilities will include defining the monitoring batch processes, optimizing data loading procedures, managing data incidents, and collaborating with technical teams to maintain efficient data workflows. We are seeking a highly skilled and motivated individual with a strong background in data operations and analytics to join our team. Key Responsibilities: Monitor Batch Processes: Implement and maintain robust monitoring mechanisms to track the performance and health of Vaults within the data hubs, ensuring timely identification of performance issues, anomalies, and system failures. Proactively suggest and drive the adoption of standardized tools and processes to automate monitoring tasks, enhancing operational efficiency. Manage the roster and standby list to ensure that Hub team members are available to provide 1st and 2nd line support as needed, minimizing downtime and disruptions. Job Development, Sequencing, Orchestration, and Monitoring: Collaborate closely with Hub teams to develop blueprints and templates for setting up alerts and notifications, enabling prompt response to job execution failures or delays. Work in tandem with technical teams, including the Center of Excellence (CoE) and Hub teams, to ensure that jobs are executed as per schedule and within expected runtime parameters, maintaining smooth operations. Optimize Data Loading Processes and Asset Performance: Conduct in-depth analysis of raw vault data loading processes and ETL workflows, utilizing tools such as Automic and WhereScape logs (with potential use of Splunk), to identify trends and opportunities for optimization. Provide insights and recommendations to optimize workloads, improve job scheduling, and enhance overall workflow efficiency for both raw vault (RV) and business vault (BV) datasets. Take ownership of managing the backlog of load processes and ETL jobs, collaborating with the CoE scrum master to track and implement improvements. Data Incident/ Issue Management: Define and implement a robust data incident and issue management process to track, monitor, and communicate the impacts of Raw (and Business) vault data loads on downstream processes, ensuring timely resolution and minimal disruption. Collaborate with Platform Team: Foster strong collaboration with the platform team and other service providers to monitor the availability of Automic agents and WhereScape servers, proactively addressing any issues to prevent interruptions in job execution. Act as a liaison between the BI team and the platform team to address platform requirements, incidents, and challenges, ensuring seamless data ingestion processes and integration with the data lake. Requirements: Bachelor's degree or higher in Computer Science, Information Technology, Software Engineering, or a related field. Minimum of 5 years of relevant experience in managing or operating medium to large-scale data warehouse environments. Proven track record of managing data warehouses with 20 or more sources that feed data using various integration methods on a daily basis. Hands-on experience with batch processing, data loading, and ETL workflows. Proficiency in utilizing monitoring tools and implementing automation solutions to enhance operational efficiency. Strong understanding of data modeling principles and best practices, Data Vault advantageous Experience with tools such as Automic, WhereScape, and Splunk for monitoring and optimization is preferred, or any other equivalent tools Excellent analytical skills with the ability to analyze complex data sets and identify optimization opportunities. Effective communication skills with the ability to collaborate with cross-functional teams and stakeholders. #J-18808-Ljbffr
Attention! You will be redirected to another site