Tech Lead - AIOps

Essential functions

• Lead development of scalable data platforms and ETL pipelines using Python, PySpark, SQL/Scala on AWS.

• Architect and optimize data workflows with Glue, EMR, S3, Athena, and related AWS services.

• Drive ML/LLM adoption using SageMaker, Bedrock, OpenAI, Anthropic, and open-source tools.

• Oversee deployment and observability of production ML systems using CloudWatch and guardrail frameworks (e.g., LangChain, LangSmith).

• Enforce data governance and quality standards using Great Expectations, Soda, and data contracts.

• Build and manage big data environments using Spark, Trino, and Presto.

• Mentor engineering teams and champion AIOps and data engineering best practices.

Qualifications

• Proficiency in Python, PySpark, SQL, and/or Scala.

• Expertise in AWS services, especially Glue, S3, Athena, EMR, EC2, and MWAA.

• SageMaker AI or any other ML/LLM experiment management tool

• EC2, EKS, CloudFormation

• Knowledge of AIOps best practices

• Experience with AWS Bedrock, OpenAI, Anthropic and similar

• Experience deploying open source LLMs will be a plus

• LangSmith/LangChain guardrails

• Big Data Technologies: Hands-on experience with Spark and Trino, Presto

• Data Platforms: Experience in building data platforms, not just using them. (MUST HAVE)

Would be a plus

• Experience with monitoring/logging for production models (e.g. CloudWatch)

• Data Engineering: 3+ years of work experience as a Data Engineer in a cloud-based environment, with a focus on AWS.

• ETL and Data Modeling: Advanced understanding of ETL processes, data modeling techniques, and best practices.

• Data Governance and Quality: Experience in applying data governance policies, implementing data contracts, and using data quality frameworks like Great Expectations and Soda.

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.