Job Description :
Ideal candidate will have Elastic Search, Hadoop, Hive scripts, Unstructured Data experience, and Data Visualization

Top 3 Skills (Hadoop, Java, Hive, Spark, Data Visualization)
1. Implementing CICD through Jenkins for Hadoop jobs and between external sources & HDFS while implementing Hive scripts
2. Experience digging into unstructured data using unstructured logs to find sources, load and aggregate the data to make it visible and easy for business partners to draw insights from by building and designing data sets for consumption and developing analytics or visualizations using tools such as Domo, Micro strategy, Cognos, Tableau, etc.
3. Someone that can take high level design direction or ownership of design for automating data within Elastic Search, Kafka, Hive and Hadoop

They use Domo for visualizations, but Cognos, Tableau, Micro strategy, etc. will do

Job Description
Create and Manage automated "data pipelines" through multiple data environments including MongoDB, Hive, Elastic search, Postgres.
Interact with Elastic search, with unstructured logs, experience with regex, and building/designing datasets for consumption.
Implement extensive Hive scripts
Implement continuous integration & deployment [CICD] through Jenkins for multiple Hadoop jobs.
Organize multiple batch jobs in Oozie scheduler based on file watchers and time constraints.
Develop integration between external and HDFS.
Develop analytical visualization cards using DOMO tool.


Client : xxx

             

Similar Jobs you may be interested in ..