Lead Data Engineer

Description

United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.

Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the world." drives us to be the best airline for our employees, customers, and everyone we serve, and we can only do that with a truly diverse and inclusive workforce. Our team spans the globe and is made up of diverse individuals all working together with cutting-edge technology to build the best airline in the history of aviation.

With multiple employee-run "Business Resource Group" communities and world-class benefits like health insurance, parental leave, and space available travel, United is truly a one-of-a-kind place to work that will make you feel welcome and accepted. Come join our team and help us make a positive impact on the world.

Job Overview And Responsibilities

United Airlines is seeking talented people to join the Data and Machine Learning Engineering team. The organization is responsible for leading data driven insights & innovation to support the Machine Learning needs for commercial and operational projects with a digital focus. This role will frequently collaborate with data scientists and data engineers. This role will design and implement key components of the Machine Learning Platform, business use cases, and establish processes and best practices.

• Build high-performance, cloud-native machine learning infrastructure and services to enable rapid innovation across United. Set up containers and Serverless platform with cloud infrastructure.
• You will design and develop tools and apps to enable ML automation using AWS ecosystem.
• Build data pipelines to enable ML models for batch and real-time data. Hands on development expertise of Spark and Flink for both real time and batch applications.
• Support large scale model training and serving pipelines in distributed and scalable environment.
• This position is offered on local terms and conditions within United’s wholly owned subsidiary United Airlines Business Services Pvt. Ltd
• Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded.
  
  

This position is offered on local terms and conditions. Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded. This position is for United Airlines Business Services Pvt. Ltd - a wholly owned subsidiary of United Airlines Inc.

United Airlines is an equal opportunity employer. United Airlines recruits, employs, trains, compensates, and promotes regardless of race, religion, color, national origin, gender identity, sexual orientation, physical ability, age, veteran status, and other protected status as required by applicable law.

Qualifications

Required

• 6 + years of software engineering experience with languages such as Python, Go, Java, Scala, Kotlin, or C/C++
• 4+ years of experience in machine learning, deep learning, and natural language processing.
• 3 + years of experience working in cloud environments (AWS preferred) - Kubernetes, Dockers, ECS and EKS
• 2 + years of experience with Big Data technologies such as Spark, Flink and SQLprogramminG.
• 3 + years of experience with cloud-native DevOps, CI/CD.
• 1+ years of experience with Generative AI/LLMs.
• Strong software engineering experience with Python and at least one additional language such as Go, Java, or C/C++
• Familiarity with data science methodologies and frameworks (e.g., PyTorch, Tensorflow) and preferably building and deploying production ML pipelines.
• Experience in ML model life cycle development experience and prefer experience to common algorithms like XGBoost, CatBoost, Deep Learning, etc.
• Experience setting up and optimizing data stores (RDBMS/NoSQL) for production use in the ML app context
• Cloud-native DevOps, CI/CD experience using tools such as Jenkins or AWS CodePipeline; preferably experience with GitOps using tools such as ArgoCD, Flux, or Jenkins X
• Experience with generative models such as GANs, VAEs, and autoregressive models.
• Prompt engineering: Ability to design and craft prompts that evoke desired responses from LLMs.
• LLM evaluation: Ability to evaluate the performance of LLMs on a variety of tasks, including accuracy, fluency, creativity, and diversity.
• LLM debugging: Ability to identify and fix errors in LLMs, such as bias, factual errors, and logical inconsistencies.
• LLM deployment: Ability to deploy LLMs in production environments and ensure that they are reliable and secure.
• Experience with LLMOps (Large Language Model Operations) to manage the end-to-end lifecycle of large language models.
  
  

Preferred

• Computer Science or related STEM field
  
  

Equal Opportunity Employer - Minorities/Women/Veterans/Disabled/LGBT GGN00001540