Data Engineer - Cloud & Big Data
We are seeking a Data Engineer to support the modernization and scaling of cloud data platforms and high-volume ELT pipelines for global enterprise retail and consumer leaders. In this role, you will design, build, and optimize end-to-end batch and streaming pipelines, consolidate complex business KPIs into single-source-of-truth data models, and improve warehouse query performance. Working alongside cross-functional cloud architecture and analytics teams, you will leverage modern cloud platforms, big data frameworks, and workflow orchestrators to drive business-critical data solutions.
Essential functions
Design, build, and maintain production-grade ELT/ETL data pipelines to ingest, transform, and consolidate large-scale data from multiple enterprise sources.
Optimize data warehouse architectures, table structures, and query performance for business-critical reporting and advanced analytics.
Develop data processing workflows using Python, SQL, and big data processing frameworks (such as Apache Spark / PySpark).
Automate data pipeline scheduling, monitoring, and quality validation using modern orchestration tools (Airflow or Kubeflow).
Establish reliable API and cloud database connectors while collaborating with business and technical stakeholders to adapt to evolving analytics requirements.
Qualifications
Proven hands-on experience as a Data Engineer building and maintaining complex ELT/ETL data pipelines in enterprise environments.
Strong proficiency in Python and advanced SQL for complex data transformations, aggregations, and performance tuning.
Hands-on experience developing data pipelines on Google Cloud Platform (GCP) or Microsoft Azure (including services like BigQuery, GCS, Azure Data Factory, or Azure Data Lake).
Practical experience working with big data processing frameworks (Apache Spark / PySpark) and pipeline orchestrators (Apache Airflow or Kubeflow).
Solid background in containerization (Docker, Kubernetes) and modern CI/CD practices (GitHub Actions, Azure DevOps, or similar).
Would be a plus
Experience with Databricks for unified analytics and large-scale data transformation.
Exposure to search, indexing, or vector storage technologies (such as Elasticsearch).
Active industry cloud certifications (GCP Professional Data Engineer or Azure Data Engineer Associate).
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.Apply to the position
Information on personal data processing
You cannot apply for a position without accepting “INFORMATION ON PERSONAL DATA PROCESSING”
Applications for this job are no longer accepted. Please explore other open opportunities on our platform.
Thank you!
You applied for the position Data Engineer - Cloud & Big Data successfully. We will get back to you soon. Have a great day!
Something went wrong...
There are possible difficulties with connection or other issues. Please try to use another browser (it's recommended to use the latest version of Google Chrome browser). If the problem still persists, please send your application to cv@griddynamics.com
Something went wrong...
Please double-check the information filled in the form, and make sure to provide valid data.
Don’t see the right opportunity?
Contact us anyway and let’s talk! To apply, send your resume and cover letter to jobs@griddynamics.com
Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.
All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.