Job Description :
VDart We are a Global Information Technology Services & Workforce Solutions firm headquartered out of Atlanta, GA with presence in US, Canada, MX, UK, Belgium, Japan & India. Founded in 2007, Our team of over 2550+ professionals continually create impact for our customers worldwide in solving complex technology challenges with cutting edge technologies. We specialize in providing the Fortune 1000 companies, niche hard to find skills in technologies including Social, Mobile, Big Data Analytics, Data Sciences, Cyber Security, IoT, Cloud, Machine Learning, and Artificial Intelligence. With delivery centers in the UK, Mexico, Canada, and India, we provide global workforce solutions to our customers covering EMEA, APAC & Americas. VDart is an award-winning organization recognized by Inc 5000 Hall of Fame; Atlanta Business Chronicle*s Fastest Growing Companies; NMSDC*s National Supplier of the Year; Ernst & Young*s Regional Entrepreneur of the Year and more. Title- BigData Engineer Location: Plano, TX Rate / Salary: Negotiable Full time and Contract Main Requirement: - Very strong data modeling skills - Analytical and problem solving skills & experience, applied to Big Data domain is a MUST - 1+ years hands on experience with SQL, Hadoop, Hive, Pig, Impala, and Spark - Hive is a mandatory skill - 5-8 years of Python or Scala programming or Java/J2EE development experience - 3+ years of demonstrated technical proficiency with Hadoop and big data projects Job Responsibilities Big Data Engineer: Translate complex functional and technical requirements into detailed design. Design, construct, install, test and maintain highly scalable data management systems. Hadoop technical development and implementation. Loading from disparate data sets. by leveraging various big data technology e.g. Kafka Pre-processing using Hive, Impala, Spark, and Pig Design and implement data modeling Maintain security and data privacy in an environment secured using Kerberos and LDAP High-speed querying using in-memory technologies such as Spark. Following and contributing best engineering practice for source control, release management, deployment etc Production support, job scheduling/monitoring, ETL data quality, data freshness reporting Skills Required: 5+years of Python development experience 3+ years of demonstrated technical proficiency with Hadoop and big data projects 5-8 years of demonstrated experience and success in data modeling Fluent in writing shell scripts [bash, korn] Writing high-performance, reliable and maintainablecode. Ability to write MapReduce jobs Ability to setup, maintain, and implement Kafka topics and processes Understanding and implementation of Flume processes Good knowledge of database structures, theories, principles, and practices. Understand how to develop code in an environment secured using a local KDC and OpenLDAP. Familiarity with and implementation knowledge of loading data using Sqoop. Knowledge and ability to implement workflow/schedulers within Oozie Experience working with AWS components [EC2, S3, SNS, SQS] Analytical and problem solving skills, applied to Big Data domain Proven understanding and hands on experience with Hadoop, Hive, Pig, Impala, and Spark Good aptitude in multi-threading and concurrency concepts. B.S. or M.S. in Computer Science or Engineering Skills: "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" "Bigdata Developer" "Bigdata Engineer" "Hadoop Engineer" "Hadoop" "Spark" "Scala" Python" "ETL" "Data Modeling" "Bigdata Consultant" Referral Program: Ask our recruiting team about how you can be a part of our referral program. If you refer a candidate with the desired qualifications and your candidate accepts the role, you can earn a generous referral fee. We want to hire the best talent available and are committed to building great teams and partnerships. We are Equal Employment Opportunity Employer. VDart Inc Alpharetta, GA Follow us on Twitter for the hottest positions: @VDart_Job Follow us on Twitter: @vdartinc