Job Description :
VDart We are a Global Information Technology Services & Workforce Solutions firm headquartered out of Atlanta, GA with presence in US, Canada, MX, UK, Belgium, Japan & India. Founded in 2007, Our team of over 2550+ professionals continually create impact for our customers worldwide in solving complex technology challenges with cutting edge technologies. We specialize in providing the Fortune 1000 companies, niche hard to find skills in technologies including Social, Mobile, Big Data Analytics, Data Sciences, Cyber Security, IoT, Cloud, Machine Learning, and Artificial Intelligence. With delivery centers in the UK, Mexico, Canada, and India, we provide global workforce solutions to our customers covering EMEA, APAC & Americas. VDart is an award-winning organization recognized by Inc 5000 Hall of Fame; Atlanta Business Chronicle*s Fastest Growing Companies; NMSDC*s National Supplier of the Year; Ernst & Young*s Regional Entrepreneur of the Year and more. Position: Big Data Engineer / Lead Location: New York, NY Duration: Contract MUST HAVE 5-10 years of recent hands on experience in data engineering and pipeline development. Programming experience, ideally in Python, Scala with Spark, Kafka, and a willingness to learn new programming languages to meet goals and objectives. Experience in distributed computing and MapReduce paradigm is a must. Understanding Hadoop ecosystem components like HIVE is must. Knowledge of data cleaning, wrangling, visualization and reporting using tools like Looker/Quilk. Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources. GOOD TO HAVE Use tools like DBT (data ) and workflows like airflow/Perfect for data transforms and pipeline is a plus. Knowledge of data mining, machine learning, natural language processing, or information retrieval is a plus. Experience in production support and troubleshooting is a plus. Strong knowledge of and experience with statistics. If your skills match our requirements, click here to Apply. Be sure to reference the job number and title in the subject line. Referral Program: Ask our recruiting team about how you can be a part of our referral program. If you refer a candidate with this background and if the candidate accepts the role our team pays a generous referral. We are keen on networking and establishing a long-term, mutually beneficial partnership with you. We are Equal Employment Opportunity Employer. VDart Inc Alpharetta, GA Click here to Apply Follow us on Twitter for the hottest positions: @VDart_Jobs Follow us on Twitter: @vdartinc