Lead - Data Engineering

Location:  Gurugram
|
Mar 18, 2024

Data Engineering Lead 

 

Responsibilities 

 

  • Design, develop, and maintain scalable and reliable data pipelines and architectures that can handle large volumes and variety of data from multiple sources. 

  • Lead and mentor a team of data engineers and provide technical guidance and feedback. 

  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet business objectives and quality standards. 

  • Implement best practices and standards for data engineering, such as data quality, testing, documentation, and security. 

  • Research and evaluate new technologies and tools for data engineering and recommend solutions that can improve performance, efficiency, and scalability. 

 

Requirements 

 

  • Bachelor's degree or higher in computer science, engineering, or related field. 

  • 10-15 years of experience in data engineering, with proven track record of leading and delivering complex data projects. 

  • Expertise in data engineering tools and frameworks, such as Spark, Hadoop, Kafka, Airflow, AWS, GCP, etc. 

  • Proficiency in programming languages, such as Python, Java, Scala, etc. 

  • Strong knowledge of data modeling, data structures, data quality, and data governance. 

  • Excellent communication, collaboration, and problem-solving skills. 

  • Ability to work in a fast-paced and dynamic environment.