Jobs Listings

Map Reduce & MRUnit, Spark, Hadoop

Developer will be responsible for analyzing requirements, prototyping data analysis solutions (primarily in Hive SQL or Spark and UNIX scripting), designing, developing and unit testing solutions, and facilitating solution deployment and support.

Candidates need to have strong capabilities in HiveQL, UNIX scripting.

Candidates should have experience with the Hadoop ecosystem and working with large data sets.

The system will consist of batch analytic processing on large sets of data.

Experience with Spark is preferred.

Skills/Qualifications:

Required:

7+ years IT experience

Strong HiveQL and SQL Development skills

Performance Tuning Map Reduce/Hive

The candidate will be interviewing for a big data project which processes over 3 billion records daily. Experience with Map Reduce and MRUnit is preferred. Experience with Spark and Scala is a plus. Experience leading a small team is a plus.

Return to job openings