Job Description :
Job title: Lead Data Engineer Location:Dallas, TX. Duration: Long term Skillsets Pre-requisites?Must have worked in Big Data technologies for atleast 4 yrs Must have worked on Azure Databricks / Databricks Delta for atleast 1 yr Mandatory SkillsTechnical Experience Hands on experience on Hadoop technologies (Hive, Sqoop & Spark) Good expertise in Python programming language Must have experience in understanding business vision to prepare ETL/ELT solution architecture Fair knowledge on Azure on services like Azure Data Factory v2, Azure Synapse Good understanding of Lambda Architecture Experience with integration of data from multiple data sources Good knowledge on any RDBMS and Data Warehousing Concepts Good working experience in SQL / TSQL / PLSQL Designing Skills Must have experience in understanding business vision to prepare Data integration solution Identifying solutions to key technical challenges in projects concerning Data Integration Preferred SkillsTechnical Skills Fair Knowledge on Machine learning and Exposure on Big Data ML toolkits, such as SparkML / Azure ML Fair knowledge on NoSQL databases such as MongoDB, HBase, Cassandra etc Research Skills Need to be proactive towards research, POC implementation, comparing alternative components and preparing reports on the same