Senior Java Backend Engineer - Generative AI Platform

Essential functions

Key Responsibilities:

• Develop and maintain scalable backend services for generative AI applications using Java and Spring Boot

• Design and implement APIs for LLM integration and AI agent orchestration

• Build robust microservices architecture to support RAG systems and LLM-powered applications

• Implement caching strategies and optimization for vector database operations

• Integrate with multiple LLM providers and manage API rate limiting and failover mechanisms

• Develop real-time streaming capabilities for conversational AI applications

• Ensure system observability and implement comprehensive logging and monitoring

Qualifications

Required Skills:

Backend Development:

• 3+ years of experience with Java and Spring Boot framework

• Strong understanding of RESTful API design and microservices architecture

• Experience with Spring Security, Spring Data JPA, and Spring Cloud

• Proficiency with database technologies (PostgreSQL, MongoDB, Redis)

• Knowledge of message queuing systems (RabbitMQ, Apache Kafka)

• Experience with caching mechanisms and performance optimization

Generative AI Integration:

• Experience integrating LLM APIs (OpenAI, Gemini, Anthropic) into backend systems

• Knowledge of vector database integration and semantic search implementations

• Experience with AI agent frameworks and orchestration (LangGraph, etc.)

• Understanding of RAG architecture and implementation patterns

• Experience with streaming responses and WebSocket connections for real-time AI interactions

• Knowledge of prompt management and template systems

Would be a plus

Good to Have:

• Experience with fine-tuning workflows and model deployment pipelines

• Knowledge of self-hosted LLM integration and management

• Experience with observability tools (LangSmith, custom monitoring solutions)

• Understanding of natural language to SQL query systems

Additional Requirements:

• Experience with containerization (Docker) and orchestration (Kubernetes)

• Knowledge of CI/CD pipelines and DevOps practices

• Cloud platform experience with certifications preferred (AWS, GCP, Azure)

• Understanding of authentication and authorization patterns

• Experience with testing frameworks (JUnit, Mockito, TestContainers)

• Knowledge of system design and scalability patterns

• Familiarity with Elasticsearch or similar search technologies

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.