Home
Services
Industries
Insights
Making agentic AI production-ready white paper cover
White paper
Explore frameworks
About us
Let's talk
Home Careers Discover openings Bigdata Developer

Bigdata Developer

Hyderabad, Bangalore, India

Experience  with creating data driven business solutions and solving data problems using  a wide variety of technologies such as Hadoop, MapReduce, Hive, Scala, Spark,  NoSQL as well as traditional relational databases like MySQL  Experience  building real time streaming data pipelines using technologies like Kafka,  Spark Streaming, ELK etc  Experience  building ETL/ELT data pipelines, data quality checks and data anomaly  detection and notification systems  Experience  with development and programming languages such as Java or python  Experience  with agile development incorporating continuous integration and continuous  delivery  Knowledge  on any AI ( CHATGPT/COPilot/ GitHub copilot/ Claude) is added advantage

Essential functions

Responsibilities

  1. Design and Develop Data Pipelines
    Build and maintain scalable data pipelines to process large volumes of structured and unstructured data.

  2. Big Data Framework Development
    Develop and optimize applications using big data technologies like Apache Hadoop, Apache Spark, and Apache Kafka.

  3. Data Processing and Transformation
    Implement ETL (Extract, Transform, Load) processes to ingest and transform large datasets from multiple data sources.

  4. Database and Data Storage Management
    Work with distributed storage systems such as Apache Hive, Apache HBase, and cloud data platforms.

  5. Performance Optimization
    Optimize big data applications and queries for high performance and scalability.

  6. Collaboration with Data Teams
    Collaborate with data engineers, data scientist

Qualifications

Minimum Requirements – Big Data Developer

1. Experience

  • 5-7 years of experience in Big Data / Data Engineering / Data Processing

2. Programming Skills

  • Strong programming skills in Java, Python, or Scala

3. Big Data Technologies

  • Hands-on experience with big data frameworks such as

    • Apache Hadoop

    • Apache Spark

4. Data Processing & ETL

  • Experience building ETL pipelines for large-scale data processing

  • Knowledge of batch and real-time data processing

5. Data Storage Technologies

  • Experience working with tools such as

    • Apache Hive

    • Apache HBase

    • Distributed file systems like HDFS

6. Streaming Tools (Good to Have)

  • Exposure to real-time streaming tools such as

    • Apache Kafka

7. Database Knowledge

  • Strong knowledge of SQL and experience with NoSQL databases

We offer

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Apply to the position

apply status Information on personal data processing
decline status You cannot apply for a position without accepting “INFORMATION ON PERSONAL DATA PROCESSING”

    decline-status file-icon
    Invalid file size or format. DOC, DOCX, TXT, PDF (2 MB)

    Consent to the processing of personal data in future recruitment processes*

    We are committed to maintaining a transparent and ethical workplace. To learn more about how we support open communication, please review our Whistleblower Policy.

    decline-status file-icon
    Invalid file size or format. DOC, DOCX, TXT, PDF (2 MB)
    Submitting
    decline status

    Applications for this job are no longer accepted. Please explore other open opportunities on our platform.

    Vacancy

    Thank you!

    You applied for the position Bigdata Developer successfully. We will get back to you soon. Have a great day!

    check

    Something went wrong...

    There are possible difficulties with connection or other issues. Please try to use another browser (it's recommended to use the latest version of Google Chrome browser). If the problem still persists, please send your application to

    Retry

    Something went wrong...

    Please double-check the information filled in the form, and make sure to provide valid data.

    Retry

    Don’t see the right opportunity?

    Contact us anyway and let’s talk! To apply, send your resume and cover letter to jobs@griddynamics.com

    Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.

    All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.

    Grid Dynamics Privacy Policy and E-verify