Big Data Engineer – Java/Scala & AWS
Experience Range: 4–10 Years
Education: Bachelor’s degree in computer science
Hiring Location: Bangalore
Mandate skills: Java + Scala, Big data using Apache Spark, AWS, Terraform/Ansible/CloudFormation
Must Have Skills:
* 3+ years of hands-on experience in Big Data processing using Apache Spark (Scala). * Strong programming experience in Java or Scala. * Proven expertise in AWS Cloud (S3, EC2, EMR, Lambda). * Experience in Spark Streaming, Hadoop, Spark SQL, Presto/Hive. * Proficiency in RDBMS (PostgreSQL, MySQL, or Oracle). * Experience with orchestration tools like Apache Airflow. * Strong skills in Unix/Linux OS, Shell scripting, Python, JSON, and YAML. * Source control experience with GitLab or Bitbucket. * Agile/Scrum methodology experience in application development. * Strong troubleshooting, problem-solving, and communication skills.
Good to Have Skills:
* Experience with Docker and containerized application deployment. * Familiarity with Infrastructure-as-Code tools like Terraform, Ansible, or CloudFormation. * AWS Certification (any level). * Exposure to service-oriented architecture. * Ability to develop reusable code/components across multiple projects. * Experience collaborating with Data Science teams and building rapid technical prototypes. * Mentoring and guiding junior team members. * Awareness of industry trends and participation in peer networks or forums.
Skills
Java + Scala, Big data using Apache Spark, AWS, Terraform/Ansible/CloudFormation