Hive Expert – Pattern Development Job Description: Developer will be responsible for analyzing requirements, prototyping data analysis solutions (primarily in Hive SQL or Spark and UNIX scripting), designing, developing and unit testing solutions, and facilitating solution deployment and support. Candidates need to have strong capabilities in HiveQL, UNIX scripting. Candidates should have experience with the Hadoop ecosystem and working with large data sets. The system will consist of batch analytic processing on large sets of data. Experience with Spark is preferred.
Skills/Qualifications:
Required: 7+ years IT experience Required: Strong HiveQL and SQL Development skills Required: Performance Tuning Map Reduce/Hive Jobs Required: Programming Experience with Hadoop / Map-Reduce with Java/Python/Scala Required: Unix / Shell scripting Required: Designing distributed solutions for parallel processing of large data Required: Full SDLC Experience (requirements analysis, design, development, unit testing, deployment, support) Required: Good communication skills Preferred: Experience with Spark/Scala programming Preferred: Experience with AWS Cloud Technologies Preferred: Experience with Agile Development Methodologies Preferred: Experience with Big-Data Technologies in Hadoop Eco System Preferred: Test driven development
