Senior Data Platform Engineer
We are seeking a Data Platform Engineer to manage and scale our core data infrastructure while empowering engineering and Data Science teams with reliable, streamlined processes. In this role, you will maintain distributed big data systems, drive operational excellence, and ensure robust data governance and observability across our production ecosystem.
This is a long-term, contractor position.
Working hours: Overlap until 11 am PST time zone.
Essential functions
Manage, maintain, and scale our on-premise Kubernetes clusters, Airflow orchestrations, and distributed Spark infrastructure.
Build and maintain robust CI/CD pipelines to streamline deployment, data governance, and authentication protocols.
Perform routine file compaction, storage optimization, and maintenance across HDFS and cloud object stores.
Maintain system observability, monitor health, and participate in an on-call rotation using Prometheus, Grafana, and OpenTelemetry.
Apply core data engineering principles to optimize table formats (Iceberg/Hive), partitioning, schema design, and query performance.
Qualifications
Proven background in distributed systems with deep expertise in managing Kubernetes resources in production.
Hands-on experience scaling and managing infrastructure for heavy Apache Spark workloads.
Strong proficiency in modern CI/CD pipelines, Docker containerization, and data pipeline orchestration (Python/Airflow).
Deep understanding of data engineering fundamentals, including schema design, partitioning, type safety, and modern table formats (Iceberg/Hive/Trino/Presto).
Practical experience implementing authentication, access control, and data governance frameworks.
Solid experience with observability, monitoring, and on-call practices using Prometheus, Grafana, and OpenTelemetry.
Would be a plus
Hands-on experience with Scala for big data processing systems.
We offer
Opportunity to work on bleeding-edge projects
Work with a highly motivated and dedicated team
Competitive salary
Flexible schedule
Professional development opportunities
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.Apply to the position
Thank you!
You applied for the position Senior Data Platform Engineer successfully. We will get back to you soon. Have a great day!
Something went wrong...
There are possible difficulties with connection or other issues. Please try to use another browser (it's recommended to use the latest version of Google Chrome browser). If the problem still persists, please send your application to cv@griddynamics.com
Something went wrong...
Please double-check the information filled in the form, and make sure to provide valid data.
Don’t see the right opportunity?
Contact us anyway and let’s talk! To apply, send your resume and cover letter to jobs@griddynamics.com
Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.
All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.
