Senior LLM/RAG Engineer (Legacy Modernization)
The LLM/RAG Engineer will play a pivotal role in a high-profile modernization project, transitioning a legacy RPG/IBM i-based Dealer Management System (DMS) into a modern, cloud-native Java architecture.
In this Proof of Concept (POC) phase, you will specialize in CodeRAG (Retrieval-Augmented Generation for code) and Abstract Syntax Tree (AST) techniques. Your primary objective is to automate the parsing, transformation, and migration of legacy business logic into modern microservices. You will work at the intersection of Generative AI and legacy system modernization, ensuring that automated code generation remains accurate, performant, and aligned with architectural specifications.
Essential functions
Code Transformation & Analysis: Utilize AST techniques to parse legacy RPG code and transform it into structured formats suitable for automated migration.
RAG Implementation: Design and maintain RAG pipelines using AWS Bedrock and Vector Databases to provide LLMs with high-fidelity context from legacy documentation and code analysis.
Data Preprocessing: Clean, structure, and enrich metadata from legacy systems, potentially involving the creation of knowledge graphs or embeddings to improve LLM accuracy.
Iterative Validation: Perform rigorous validation and correction of AI-generated code assets to ensure they meet modern Java standards and functional parity with the legacy system.
Legacy Integration: Collaborate with specialized code analysis tools (such as PKS eXplain) to extract business logic and code flows from IBM i environments.
Collaboration & Documentation: Work closely with cross-functional teams in India and Germany, documenting complex business logic and ensuring tight feedback loops during the POC.
Quality Assurance: Adhere to strict architectural specifications and collaborate on testing strategies to validate the migrated solution.
Qualifications
Total Work Experience: Minimum of 4–8 years of experience in software engineering, with a significant focus on AI/ML or Backend development.
AI & LLM Expertise: Proven experience working with advanced LLMs (e.g., Claude 3.5/3.7/4) and building RAG pipelines.
Technical Proficiency: * Languages: Strong proficiency in Python.
Cloud: Hands-on experience with AWS Bedrock.
Databases: Experience with Vector Databases such as Milvus or Pinecone.
Code Transformation Skills: Deep understanding of Abstract Syntax Trees (AST) and experience in parsing or transforming code programmatically.
Modernization Knowledge: Familiarity with code migration processes, microservices architecture, and cloud-native design patterns.
Tools & Version Control: Expert-level knowledge of Git for managing generated code and collaborative development.
Soft Skills: A proactive nature with strong communication skills, essential for navigating the ambiguity of a POC environment and working with distributed global teams.
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.Apply to the position
Information on personal data processing
You cannot apply for a position without accepting “INFORMATION ON PERSONAL DATA PROCESSING”
Applications for this job are no longer accepted. Please explore other open opportunities on our platform.
Thank you!
You applied for the position Senior LLM/RAG Engineer (Legacy Modernization) successfully. We will get back to you soon. Have a great day!
Something went wrong...
There are possible difficulties with connection or other issues. Please try to use another browser (it's recommended to use the latest version of Google Chrome browser). If the problem still persists, please send your application to cv@griddynamics.com
RetrySomething went wrong...
Please double-check the information filled in the form, and make sure to provide valid data.
RetryDon’t see the right opportunity?
Contact us anyway and let’s talk! To apply, send your resume and cover letter to jobs@griddynamics.com
Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.
All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.