Description:
Data Engineer – Unlock the Power of Scalable Data Systems! A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you!Qualifications:
- BSc in Computer Science, Information Systems, Engineering, or a related technical field.
- 5+ years of experience in data engineering .
- Minimum of 2 years working with big data pipelines, architectures, and data sets .
- Proficiency in Python and SQL (PostgreSQL, MS SQL).
- Experience with cloud services (AWS, Azure, or GCP).
- Strong understanding of ETL processes, data lifecycle management, and governance .
- Experience in Glue and PySpark is highly desirable.
Requirements:
- Suggest and implement internal process improvements for automation and scalability.
- Develop and maintain high-performance data pipelines .
- Streamline CI/CD processes for optimal data operations.
- Assemble and optimize large, complex data sets for business needs.
- Conduct unit tests and ensure data consistency .
- Maintain data quality, security, and governance across all platforms.
- Support analytics and reporting infrastructure.
KPA’s:
- Develop and maintain data warehouse and data lake infrastructure.
- Optimize database performance, including collations, engines, and indexing .
- Manage metadata, data catalogues, and user documentation .
- Implement best practices for data transformation and processing .
- Ensure compliance with data security and governance standards .
Apply Now!
For more IT jobs, please visit https://www.networkrecruitmentinternational.com/If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles.
ð© For more information, contact:
âï¸ tschoeman@networkrecruitment.co.za
11 Feb 2025;
from:
careers24.com