This project is your opportunity to gain invaluable exposure to their innovative product suites and to work with highly technical, industry recognized, subject matter experts. Due to the amount of data that the applications need to process, the engineering team has adopted big data technologies, including Hadoop. We are seeking a senior software engineer, with commercial Hadoop development experience, to work on the team that is building up the big data practice.
Job Description:
•Design and implement map reduce jobs to support distributed processing using java, hive and hbase
•Build libraries, user defined functions, and frameworks around Hadoop
•Research, evaluate and utilize new technologies/tools/frameworks around hadoop eco system such as MapReduce, HDFS, Hive, HBase, etc.
•Develop user defined functions to provide custom hbase/hive capabilities
•Work with Site-Operations team on upgrades of the cluster
•Participating in the installation, configuration and administration of a single-node and multi-node Hadoop HDFS cluster
Required Skills:
•1 year of commercial Hadoop experience, including 1 Hadoop based project completed successfully.
•1 year of commercial experience with HDFS, MapReduce, HBase, Hive is preferred.
•5+ years of experience in analysis, design, development and implementation of large scale products and java/j2ee projects.
•Experience with Unix based distributed systems
•5+ years of experience developing shell scripts and some knowledge in linux administration commands
