Description:
Our client is looking for a highly skilled and driven Data Engineer to join their dynamic team in Sandton. If you have a passion for data management, cloud technologies, and are proficient in SQL, Python, and ETL processes, this is your opportunity to make an impact in a fast-paced, innovative environment. Key Responsibilities:- Develop, optimize, and manage data pipelines and data storage solutions.
- Work with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, Glue, Fire Hose, or similar AWS tools.
- Set up and manage data ingestion processes across Azure, AWS, or GCP environments.
- Work closely with cross-functional teams to design and implement scalable data solutions.
- Ensure optimal database performance by understanding SQL internals, including execution plans, wait types, isolation levels, DMVs, and indexing.
- Optimize and write complex queries, focusing on high performance.
- Leverage data visualization tools such as Power BI, SSRS, Tableau, or QlikView to produce actionable insights.
- Develop and maintain version control using Git, and participate in CI/CD pipeline management for deployment strategies.
- Bachelor’s degree in Computer Science, Software Engineering, Informatics, or Information Systems. Equivalent qualifications or certifications combined with significant industry experience may also be considered.
- 3-5 years of professional experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
- Strong T-SQL knowledge and experience writing and optimizing complex queries.
- Intermediate Python development skills with familiarity in data-related libraries (e.g., Pandas, PySpark, Numpy).
- Hands-on experience with NoSQL DB systems and understanding of Hadoop, Spark, Map Reduce, and MPP systems.
- Experience with cloud platforms (Azure, AWS, or GCP) and related data ingestion processes.
- Working knowledge of SQL Server and database design.
- Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA\MCSE SQL Server 2012/2014) are a plus.
- Proficient in version control and CI/CD practices with Git and repositories such as GitHub or Bitbucket.
- Advantageous: Experience in C# or Java, and understanding of microservices architecture and containerization (e.g., Docker, Kubernetes).
Apply now!
For more IT jobs, please visit www.networkrecruitment.co.za
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles/positions.
For more information contact:
Reinie Du Preez
Senior Specialist Recruitment Consultant
E-mail: rdpreez@networkrecruitment.co.za
Requirements:
- Develop, optimize, and manage data pipelines and data storage solutions.
- Work with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, Glue, Fire Hose, or similar AWS tools.
- Set up and manage data ingestion processes across Azure, AWS, or GCP environments.
- Work closely with cross-functional teams to design and implement scalable data solutions.
- Ensure optimal database performance by understanding SQL internals, including execution plans, wait types, isolation levels, DMVs, and indexing.
- Optimize and write complex queries, focusing on high performance.
- Leverage data visualization tools such as Power BI, SSRS, Tableau, or QlikView to produce actionable insights.
- Develop and maintain version control using Git, and participate in CI/CD pipeline management for deployment strategies.
- Bachelor’s degree in Computer Science, Software Engineering, Informatics, or Information Systems. Equivalent qualifications or certifications combined with significant industry experience may also be considered.
- 3-5 years of professional experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
- Strong T-SQL knowledge and experience writing and optimizing complex queries.
- Intermediate Python development skills with familiarity in data-related libraries (e.g., Pandas, PySpark, Numpy).
- Hands-on experience with NoSQL DB systems and understanding of Hadoop, Spark, Map Reduce, and MPP systems.
- Experience with cloud platforms (Azure, AWS, or GCP) and related data ingestion processes.
- Working knowledge of SQL Server and database design.
- Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA\MCSE SQL Server 2012/2014) are a plus.
- Proficient in version control and CI/CD practices with Git and repositories such as GitHub or Bitbucket.
- Advantageous: Experience in C# or Java, and understanding of microservices architecture and containerization (e.g., Docker, Kubernetes).
17 Feb 2025;
from:
careers24.com