Big Data Engineer

Essential functions

·      Design and implement scalable, high-performance data pipelines leveraging extract, transfer, load (ETL) patterns for large-scale data ingestion, transformation, and storage using SQL and Python.

·      Develop and maintain complex data models, stored procedures, materialized views, and analytical queries optimized for cloud data warehouses.

·      Orchestrate data workflows using Apache Airflow and Azure Data Factory, ensuring robust scheduling, monitoring, and error handling.

·      Build and manage cloud-native data solutions on Azure.

·      Integrate CI/CD pipelines for automated deployment and testing of data infrastructure.

·      Monitor data quality, lineage, and governance while implementing proactive data validation strategies.

·      Collaborate with product, analytics, and engineering teams to translate data requirements into technical specifications.

·      Support and troubleshoot the data environment.

·      Provide support for production data systems and lead root cause analysis for critical issues.

·      Maintain comprehensive technical documentation and enforce best practices in data architecture, security, and performance tuning.

·      Various worksites—job may allow for remote work, job may involve relocation to anticipated or unanticipated locations across the United States, including client sites and Grid Dynamics’ offices throughout the United States and/or company headquarters located in San Ramon, CA.

Qualifications

·      Master of Science degree in Computer Science, Computer Engineering, Data Science or a closely related field.   

·      At least ONE (1) year of experience in the job offered or at least ONE (1) year of experience in the following:

 1.              Azure cloud platform, including Azure Databricks

2.              Python for data transformation and integration with cloud services, including PySpark

3.              Airflow

4.              Data visualization tool: Power BI

5.              Version control systems and CI/CD tools: Azure DevOps and GitHub

6.              Data Engineering and ETL, including Data Warehousing, Data Modeling, Data Lakes, Data Profiling, Data Cleansing, and Mapping

7.              SQL queries, scripts, stored procedures, and materialized views

We offer

·      Opportunity to work on bleeding-edge projects

·      Wage range: $151,070.00 per year

·      Work with a highly motivated and dedicated team

·      Competitive salary

·       Flexible schedule

·      Medical insurance

·      Benefits program

·      Social package - medical insurance, sports

·      Corporate social events

·      Professional development opportunities

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.