Job Description :
Hi,
If you have any consultant for this position, please share resume to
Role: Hadoop Developer
Location: Malvern, PA
Job Description:
Duties and Responsibilities:
- The candidate needs to be able to design, develop, and implement Hadoop-based/AWS big data solutions.
Technical Skills:
Hadoop ecosystem such as: Hadoop, HDFS, Spark, MapReduce, Pig, Hive, Flume, Sqoop, Cloudera Impala
Programming language Java, Python, Scala, Shell scripting in UNIX, Linux
Batch processing Hadoop MapReduce, Apache Spark
Run Hadoop map reduce jobs to parse and then process (simple reporting, machine learning)
Ingesting large amount of raw data (web logs, web pages, data feeds, etc )
Basic Knowledge of probability and statistics
Stream processing Apache Storm, Spark streaming
AWS Ecosystem-
Compute – EC2, Lambda,
Storage – S3, Glacier
Database – RDS, Dynamo DB, Redshift
Management Tools – CloudFormation,
Analytics – Athena, EMR, Kinesis, Quicksight
Tools - Spark, EMR, Python, Hue, Hive etc
Optional:
Code/Build/Deployment git, hg, svn, maven, sbt, jenkins, bamboo, .
The emphasis is more on the analytics side than the infrastructure
Other Competencies:
Five years developer or systems analyst experience
Strong, demonstrated analysis and problem solving skills
Strong planning and organizational skills
Strong written and oral communication skills
Ability to learn and grow in the new technologies as they become available.