Big Data Engineer

Essential functions

·      Perform all levels of ETL/ELT data systems development including design, prototyping, development, monitoring and governance.

·      Implement JVM/Spark optimization techniques on all levels of development.

·      Develop and maintain custom data frameworks using Scala, Java and Python.

·      Configure and support CI/CD pipelines for ETL/ELT processes in Data Lake and DataWarehouse.

·      Design cloud native solutions using Spark frameworks.

·      Provide accurate estimations for data engineering activities and maintain data pipelines within a given roadmap.

·      Analyze, investigate and resolve production issues and incidents, elaborate steps to reduce risks and improve target metrics of data pipelines.

·      Perform code interviews, mentor other developers and interns.

·      Various worksites—job may allow for remote work, job may involve relocation to anticipated or unanticipated locations across the United States, including client sites and Grid Dynamics’ offices throughout the United States and/or company headquarters located in San Ramon, CA.

Qualifications

·      High School Diploma or equivalent, plus at least two years of college-level study in Computer Engineering, Computer Science, or a closely related field. 

·      At least TWO (2) years of experience in the job offered or at least TWO (2) years of experience in the following:

1.              Design and optimization of Petabyte-scale distributed data processing systems using Apache Spark for real-time and batch analytics.

 2.              Functional programming in Scala, Java and Python for enterprise-scale distributed data systems utilizing immutable and idempotent data structures, multithreading, JVM optimization techniques and reactive programming.

3.              Design and optimization of enterprise data warehouse and data lake solutions including ingestion, transformation, storage, load and governance layers.

4.              Implementation of enterprise-scale cloud native distributed data storage systems.

5.         Design and implementation of low-latency monolithic and microservices-based data intensive applications with global customer base.

We offer

·      Opportunity to work on bleeding-edge projects

·      Wage range: $142,538.00-$150,000.00 per year

·      Work with a highly motivated and dedicated team

·      Competitive salary

·      Flexible schedule

·      Medical insurance

·      Benefits program

·      Social package - medical insurance, sports

·      Corporate social events

·      Professional development opportunities
Please note that all onboardings must occur in person and you may be asked to travel to attend.

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.