Description:
Our client based in Sandton seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have 3 to 5 years of professional experience in a Data Engineer or related role. This position involves maintaining, implementing, and innovating current and new projects within a collaborative and fast-paced environment.Required Minimum Education / Training
- Bachelor’s degree in Computer Science, Software Engineering, Informatics, or Information Systems.
- A degree from an accredited institution is essential to ensure foundational knowledge in programming, algorithms, and software design.
- Equivalent qualifications or certifications combined with significant industry experience may also be considered.
- Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.
Required Minimum Work Experience
- 3-5 years of professional experience in a Data Engineer or related role.
Technical Competencies
- At least 3 years of experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
- Familiarity with NoSQL DB systems.
- Strong T-SQL knowledge.
- Intermediate Python development and familiarity with data-related libraries (Pandas, PySpark, NumPy, etc.).
- Experience with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, or similar tools for AWS (e.g., Glue, Fire Hose).
- SQL Internals – statistics, execution plans, wait types, isolation levels, DMVs, indexes.
- Understanding of Hadoop, Spark, MapReduce, columnar databases, and Massive Parallel Processing systems.
- Setting up data ingestion processes in Azure, AWS, or GCP.
- Experience with visualization tools such as Power BI, SSRS, Tableau, or QlikView.
- Knowledge of writing and optimizing complex queries with 3-5 years’ expertise.
- Version Control and CI/CD:
- Proficient in using Git and working with repositories like GitHub or Bitbucket.
- Familiarity with CI/CD pipelines and deployment strategies.
Advantageous Skills: - Experience in C# or Java and its ecosystem.
- Understanding of microservices architecture and containerization (e.g., Docker, Kubernetes.
Key Performance Areas
Maintain and Enhance Existing Systems:- Identify and resolve issues in existing software systems.
- Perform system upgrades and ensure compatibility with new technologies
- Collaborate with stakeholders to gather requirements.
- Implement new features and functionalities in both front-end and back-end systems.
- Explore new tools and technologies to enhance system performance and scalability.
- Propose and implement improvements to existing workflows and processes.
- Work closely with developers, QA, and product managers to deliver high-quality solutions.
- Participate in code reviews and share best practices.
Apply now!
If you are interested in this opportunity, please apply directly. For more IT jobs, please visit www.networkrecruitment.co.za. If you wish to send your CV per email forward your CV to clombard@networkrecruitment.co.za and copy the reference number in brackets in the subject line of your e-mail.
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any further possible positions
Requirements:
- Bachelor’s degree in Computer Science, Software Engineering, Informatics, or Information Systems.
- A degree from an accredited institution is essential to ensure foundational knowledge in programming, algorithms, and software design.
- Equivalent qualifications or certifications combined with significant industry experience may also be considered.
- Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.
- 3-5 years of professional experience in a Data Engineer or related role.
- At least 3 years of experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
- Familiarity with NoSQL DB systems.
- Strong T-SQL knowledge.
- Intermediate Python development and familiarity with data-related libraries (Pandas, PySpark, NumPy, etc.).
- Experience with ETL/ELT tools such as SSIS, Data Factory, Synapse, AirFlow, or similar tools for AWS (e.g., Glue, Fire Hose).
- SQL Internals – statistics, execution plans, wait types, isolation levels, DMVs, indexes.
- Understanding of Hadoop, Spark, MapReduce, columnar databases, and Massive Parallel Processing systems.
- Setting up data ingestion processes in Azure, AWS, or GCP.
- Experience with visualization tools such as Power BI, SSRS, Tableau, or QlikView.
- Knowledge of writing and optimizing complex queries with 3-5 years’ expertise.
- Version Control and CI/CD:
- Proficient in using Git and working with repositories like GitHub or Bitbucket.
- Familiarity with CI/CD pipelines and deployment strategies.
Advantageous Skills: - Experience in C# or Java and its ecosystem.
- Understanding of microservices architecture and containerization (e.g., Docker, Kubernetes.
- Proficient in using Git and working with repositories like GitHub or Bitbucket.
- Familiarity with CI/CD pipelines and deployment strategies.
Advantageous Skills: - Experience in C# or Java and its ecosystem.
- Understanding of microservices architecture and containerization (e.g., Docker, Kubernetes.
- Identify and resolve issues in existing software systems.
- Perform system upgrades and ensure compatibility with new technologies
- Collaborate with stakeholders to gather requirements.
- Implement new features and functionalities in both front-end and back-end systems.
- Explore new tools and technologies to enhance system performance and scalability.
- Propose and implement improvements to existing workflows and processes.
- Work closely with developers, QA, and product managers to deliver high-quality solutions.
- Participate in code reviews and share best practices.
17 Feb 2025;
from:
careers24.com