Job Description :
This is Samantha from TechnoGen Inc. And I am writing to see whether you are interested in an exciting/challenging opportunity in DC Metro Area. Kindly reach me on or Title: Data Engineer Location: DC Metro Area (Remote till COVID) Duration: Long Term Contract Our client is looking for a Data engineer with Data Bricks and Python. Each selected candidate must pass following three criteria before on-boarding: Credit check to make sure no bankruptcy is pending or candidate should be discharged from bankruptcy. Employment verification check. Finger print check for criminal background checks. Responsibilities: Build end-to-end direct capabilities. Create and maintain optimal data pipeline architecture. Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources. Use analytics for capitalizing on the data for making decisions and achieving better outcomes for the business. Derive insights to differentiate member and team member experiences. Collaborate with cross-functional teams. Analyze and define with product teams the data migration and data integration strategies. Apply experience in analytics, data visualization and modeling to find solutions for a variety of business and technical problems. Querying and analyzing small and large data sets to discover patterns and deliver meaningful insights. Integrate source systems with information management solutions and target systems for automated migration processes. Create proof-of-concepts to demonstrate viability of solutions under consideration. Qualifications: Design-thinking & excellent communication skills: ability to translate innovative ideas to clearly articulated technical solutions. Bachelor's degree in computer science, information systems, or other technology-related field or equivalent number of years of experience. Solid foundation in data structures, algorithms, design patterns and strong analytical and problem-solving skills. 8+ years of professional software or data engineering experience. 4+ years of experience in IT related to Data Management and Data Migration activities. 2+ years of strong experience with Azure services, including Azure Data Factory, Databricks, Python, Azure Storage (ADLS Gen2) and Azure SQL. 2+ years of professional Apache Spark data processing application design and development experience, PySpark preferred, but Java/Scala are also acceptable. Experience with any of the following Analytics and Information Management competencies: Data Management and Architecture, Performance Management, Information Delivery and Advanced Analytics. The follow certifications are preferred: Microsoft Certified Azure Data Engineer. Microsoft Certified Azure Solutions Architect. Databricks Certified Associate Developer for Apache 2.4/ 3
             

Similar Jobs you may be interested in ..