Senior Data Engineer Ref: MN089

Vacancy Details

  • Career Level Supervisor / Manager
  • Experience 8 Years
  • What we do Computers & IT & TelecomsOther professional services
  • Qualifications Bachelors DegreeProfessional QualificationCertificate level

Job Description

Our client is a growing consulting company that specializes in providing data strategies at all levels of organizations. They work with businesses using the latest technologies to help them optimize their data and make informed decisions.

Our client is looking for a talented Senior Data Engineer to join their dynamic team. This is an exciting opportunity to work with cutting-edge technologies and contribute to the growth and success of a consulting company. You will be based in Durban and Johannesburg as this is a hybrid position.

As a Senior Data Engineer, you will play a crucial role in collaborating with various stakeholders and teams to develop cohesive data strategies and architectures that align with the organization’s goals.

Duties and Responsibilities:

  • Collaborate with business stakeholders, Data Integration teams, Data Scientists, and other IT teams to understand data requirements and develop a cohesive data strategy and architecture.
  • Design and optimize data models to meet data storage, retrieval, and analytical needs while ensuring data integrity and performance.
  • Create data pipelines to extract data from various sources, transform it into a suitable format, and load it into data storage systems like databases, data warehouses, and data lakes.
  • Ensure seamless integration of data from different sources, including databases, applications, APIs, and third-party platforms.
  • Transform raw data into a usable format by applying cleansing, enrichment, aggregation, and other data processing techniques.
  • Work with data warehousing technologies to design, create, and maintain data warehouses for reporting and analysis purposes.
  • Establish data governance frameworks, data quality standards, and data security measures.
  • Develop real-time data processing solutions to enable organizations to analyze and act on data as it is generated or received.
  • Implement data quality checks and validation processes to identify and resolve data inconsistencies or errors.
  • Work with a combination of cloud-based data platforms and on-premises environments, often utilizing different landscapes.
  • Collaborate closely with data scientists, data analysts, business stakeholders, and other IT teams to understand data requirements and ensure the delivery of accurate and reliable data solutions.
  • Continuously monitor and optimize data processes, pipelines, and storage systems to improve performance, reduce latency, and lower operational costs.
  • Provide technical leadership and mentorship to data engineering teams, fostering a collaborative and innovative work environment.
  • Manage and implement project schedules related to data engineering projects, ensuring effective communication to stakeholders.
  • Stay updated with the latest trends and advancements in data technologies, recommending and implementing innovative solutions.
  • Document data integration blueprints, pipelines, architectures, and processes to enable easier maintenance, troubleshooting, and knowledge sharing.
  • Provide technical support to end-users, troubleshoot data-related issues, and assist with ad-hoc data requests and analyses.

Qualifications and Experience:

  • Diploma/Bachelor’s Degree in Information Technology, Computer Science, Engineering, or a similar degree with a major in Mathematics.
  • Vendor certifications in a Data Integration platform such as Talend, Attunity, Oracle, SQL, or other ETL/Data Warehouse tools.
  • Proven experience (8 years) in data warehousing/systems design, development, and implementation across multiple business pillars.
  • Expertise in ETL tools and processes, data integration techniques, and data quality management.
  • Strong understanding of ERD’s and Data Normalization/Denormalization techniques.
  • Working knowledge of Inmon and Kimball data modeling methods.
  • Proficiency in both SQL and non-SQL querying languages for data extraction and manipulation.
  • Strong knowledge of BI tools (e.g., Qlik, Power BI, Tableau) and visualization best practices.
  • In-depth knowledge of database management systems (e.g., SQL Server, Oracle, MySQL) and data modeling concepts (e.g., star schema, snowflake schema).
  • Understanding of data security and privacy practices.
  • Experience with big data technologies and cloud-based data warehousing platforms (e.g., Azure).
  • Working knowledge of API/JSON/SOAP based connectivity.
  • Expansive knowledge and experience of industry direction.

If you are interested in this position, please apply with your up-to-date CV.

RecruiTech IT & Freight Specialists

Required skills

Share this job with friends and relatives

Sorry, Applications have been closed.

Related Jobs in South Africa