Senior Big Data Engineer

Essential functions

• Design, develop, optimize and maintain scalable and reliable big data solutions, including data pipelines, data warehouses, and data lakes.
• Collaborate with cross-functional teams including data product managers, data scientists, analysts, and software engineers to understand business data requirements and deliver efficient solutions.
• Architect and optimize data storage, processing, and retrieval mechanisms for large-scale datasets.
• Establish scalable, efficient, automated processes for data analyses, model development, validation, and implementation.
• Implement and maintain data governance and security best practices to ensure data integrity and compliance with regulatory standards.
• Write efficient and well-organized software to ship products in an iterative, continual-release environment.
• Reporting key insight trends, using statistical rigor to simplify and inform the larger team of noteworthy story lines that impact the business.
• Troubleshoot and resolve performance issues, bottlenecks, and data quality issues in the big data infrastructure.
• Guide and mentor junior engineers, fostering a culture of continuous learning and technical excellence.
• Communicate clearly and effectively to technical and non-technical audiences.
• Contribute to internal best practices, frameworks, and reusable components to enhance the efficiency of the data engineering team.
• Embody the values and passions that characterize Levi Strauss & Co., with empathy to engage with colleagues from multiple backgrounds.

Qualifications

• University or advanced degree in engineering, computer science, mathematics, or a related field

• 10+ years' experience developing and deploying data pipelines both batch and streaming into production

• Bachelor’s degree required, preferably in Computer Science or a related field.

• Strong experience working with a variety of relational SQL and NoSQL databases.

• Extensive experience with the cloud-native data services of Google Cloud Platform (BigQuery, Vertex AI, Pub/Sub, Cloud Functions, etc.).

• Deep expertise in one of the popular data warehousing tools such as Snowflake, Big Query, RedShift, etc

• Hands-on experience with dbt (Data Build Tool) for data transformation

• Experience working with big data tools and frameworks such as Hadoop, Spark, Kafka, etc. Familiarity with Databricks is a plus.

• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

• Hands-on experience in the Data engineering Spectrum, e.g. developing metadata-based framework-based solutions for Ingestion, Processing, etc., building Data Lake/Lake House solutions.

• Strong knowledge of Apache Airflow for orchestration and workflow management.

• Working knowledge of Github /Git Toolkit.

• Experience with providing operational support to stakeholders.

• Expertise in standard software engineering methodology, e.g. unit testing, test automation, continuous integration, code reviews, design documentation.

• Experience working with CI/CD pipelines using Jenkins and Github Actions.

• Experience with data visualization using Tableau, PowerBI, Looker or similar tools is a plus

We offer

• Opportunity to work on cutting-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, vision, dental, etc.
• Corporate social events
• Professional development opportunities
• Well-equipped office

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.