Lead - Data Engineering

Job Description

Data Engineering Lead
Responsibilities
•
Design, develop, and maintain scalable and reliable data pipelines and architectures that can handle large volumes and variety of data from multiple sources.
•
Lead and mentor a team of data engineers and provide technical guidance and feedback.
•
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet business objectives and quality standards.
•
Implement best practices and standards for data engineering, such as data quality, testing, documentation, and security.
•
Research and evaluate new technologies and tools for data engineering and recommend solutions that can improve performance, efficiency, and scalability.
Requirements
•
Bachelor's degree or higher in computer science, engineering, or related field.
•
10-15 years of experience in data engineering, with proven track record of leading and delivering complex data projects.
•
Expertise in data engineering tools and frameworks, such as Spark, Hadoop, Kafka, Airflow, AWS, GCP, etc.
•
Proficiency in programming languages, such as Python, Java, Scala, etc.
•
Strong knowledge of data modeling, data structures, data quality, and data governance.
•
Excellent communication, collaboration, and problem-solving skills.
•
Ability to work in a fast-paced and dynamic environment.