Job Description :
Hi,
My name is Yusuf; I represent PURPLE DRIVE INC. We have an opportunity with one of our direct client.
Please find below the Job Description. Kindly revert if interested.

Job Description:

Big Data Automation Engineer
Location: Fort worth TX
Duration: long term
Hire Type: Fulltime or Subcon

The big data and predictive analytics team is seeking an individual to standardize and automate open source processes and functions. Primarily, this position will focus on automating quality assurance, testing, and provisioning processes. Extended areas of concentration will be creating end user applications intended to expedite and automate data acquisition, integration, and control processes.
DUTIES/RESPONSIBILITIES:
Responsible for identifying and designing automation opportunities
Build a working knowledge of all existing operational analytics and data pipeline methods and functionality
Create effective and automated processes to drive efficiency and consistency across all areas of big data and advanced analytics projects
Work closely with peers and leadership within Technology Services to develop an automation framework
Create an infrastructure to support continued growth in the open source environment
BASIC QUALIFICATIONS:

Bachelor’s in Business, Information Technology, Computer Science or other related discipline or equivalent work related experience
Strong personal and organizational skills to execute project deliverables
Excellent verbal and written communication skills to lead a cross functional team
Proficient with automation tools and framework design
Experience in automation scripting and web application development
Apache Hadoop software library knowledge
PREFERRED QUALIFICATIONS:
MBA or equivalent degree
Working knowledge of Hortonworks 2.3 or greater
Experience in using Java, Python, Scala, Spark, Shell script
Background in ETL, data warehousing
Spark with Python, spark streaming and SQL.
Sqoop, Hive and Big data concepts.
Shell scripting.
NiFi is good to have.
             

Similar Jobs you may be interested in ..