Lead - Data Engineering

Data Engineering Lead 

Responsibilities 

• Design, develop, and maintain scalable and reliable data pipelines and architectures that can handle large volumes and variety of data from multiple sources. 

• Lead and mentor a team of data engineers and provide technical guidance and feedback. 

• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet business objectives and quality standards. 

• Implement best practices and standards for data engineering, such as data quality, testing, documentation, and security. 

• Research and evaluate new technologies and tools for data engineering and recommend solutions that can improve performance, efficiency, and scalability. 

Requirements 

• Bachelor's degree or higher in computer science, engineering, or related field. 

• 10-15 years of experience in data engineering, with proven track record of leading and delivering complex data projects. 

• Expertise in data engineering tools and frameworks, such as Spark, Hadoop, Kafka, Airflow, AWS, GCP, etc. 

• Proficiency in programming languages, such as Python, Java, Scala, etc. 

• Strong knowledge of data modeling, data structures, data quality, and data governance. 

• Excellent communication, collaboration, and problem-solving skills. 

• Ability to work in a fast-paced and dynamic environment.