Job Description :
Title: Big Data Admin
Location: Atlanta, GA
Duration : Long Term
Be responsible for development of large Application Services development program, specifically in the Big Data and Data Warehouse space
Develop Master Data Management, Data Warehouse, and Distributed Master Data
Work with department and team leads to expand current architecture s scalability
Interact with Product and Client teams to better understand the technical functionality requirements
Create optimal data pipeline architecture and systems
Analyze, debug and correct issues with data pipelines
Operate on the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Spark and Azure technologies.
Undertake performance tuning of real-time, near-real time or batch data integration code
Implement Data extraction, parsing and massaging of large disparate data sets using multiple platforms and technologies to enable complex aggregations, data analytics and visualization.
Build ETLs and other high-bandwidth services to help discover problems early
Help design, instantiate, and maintain data storage setups for analytics and data science
Installation, configuration and administration of Cloudera Hadoop platform. Help maintain the Hadoop Infrastructure and Operations. Work with Infrastructure teams to setup new Hadoop clusters.
Automate monitoring and server job processes.
Perform cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise. Monitor Hadoop cluster connectivity and security. Conduct performance tuning of Hadoop clusters and Hadoop MapReduce routines.
Screen Hadoop cluster job performances and capacity planning. Manage, troubleshoot and review Hadoop log files.
Perform file system management and monitoring as well as HDFS and other Cloudera Hadoop components support and maintenance.
Design and implement Backup and Disaster Recovery strategy based out of Cloudera BDR utility.
You bring:
BS in Computer Science / Software Engineering or equivalent experience.
8+ years of professional experience in Information Technology or related field including3+ years hands on Systems Administration and Production Support experience with Big Data technologies, job scheduling utilities such as Control-M, ETL integration tools such as Ab Initio. Also, Administrator experience working with batch processing and tools in the Hadoop technical stack (e.g. MapReduce, Yarn, Pig, Hive, HDFS, Oozie)
3+ years of experience with Big Data technology and Analytics
3+ years of experience in ETL and ELT data modelling
Strong understanding & usage of algorithms and data structures.
Experience working with traditional warehouse and correlation into hive warehouse on big data technologies
Understanding of Big Data tools (e.g., NoSQL DB, Hadoop, Hbase) and API development consumption.
Proficiency in using query languages such as SQL, Hive
Knowledge of SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment
Experience in agile software development paradigm (e.g., Scrum, Kanban)
System usage and optimization tools such as Splunk
ETL solution experience, preferably on Hadoop
Strong analytic skills, hands-on experience Unix/Linux environment, Hadoop, HIVE and Big Data technologies.
Administrator experience working with tools in the stream processing technical stack (e.g. Spark, Storm, Sama, Kafka, Avro)
Administrator experience with NoSQL stores (e.g. ElasticSearch, Hbase, Cassandra, MongoDB, CouchDB)
Expert knowledge on AD/LDAP security integration with Big Data
Hands-on experience with at least one major Hadoop Distribution such as Cloudera, Horton Works, MapR or IBM Big Insights
Experience in data stewardship and data quality processes
Excellent verbal and written communication skills
For this role, we value:
Experience with relevant Cloud technologies
Experience in one or more languages (e.g., Python or Java, Groovy)
Big Data – Administrator (certification)
Prior experience in healthcare domain
Overall Experience level:8+ years in IT with min 3+ years in Big DataAdministration