Job Title: Data Engineer
Duration: 6+ months
Location: Dallas, TX (Hybrid 2 days onsite) LOCAL CANDIDATES ONLY
Job Description:
We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and implementing programs using their skillset in Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, and Azure. The candidate should have a solid understanding of Data Lake and Data Warehouse concepts, as well as expertise in SQLs. Responsibilities also include creating design documents, performing program coding and testing, and resolving technical issues through debugging, research, and investigation.
Responsibilities:
- Design, develop and implement using Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, Basics of Azure.
- Create design documents, perform program coding and testing.
- Resolve technical issues through debugging, research, and investigation.
- Collaborate with team members to develop new features and improve existing functionality.
- Maintain a high level of knowledge of programming languages, operating systems, and database concepts.
Requirements:.
- Experience in Java and design, implementation, and support of Data Lake, Data Warehouse, Python , SQLand Azure Data bricks.
- Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, Basics of Azure.
- Hands-on experience with Unix, Teradata and other relational databases. Experience with Pyspark is a plus.
- Strong communication and problem-solving skills.
- Bachelor's degree in Computer Science or related field or equivalent combination of industry-related professional experience and education.