Greetings From SM Solutions!!!
Hope your doing well,
Job Title: Sr Hadoop Developer
Location: Palo Alto, TX
Duration: Long Term Contract
Job Description:
We are seeking a highly skilled and experienced Senior Hadoop Developer to join our dynamic team. As a Senior Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies. You will collaborate with cross-functional teams to gather requirements, design solutions, and implement robust data pipelines to support our business needs. This role requires strong analytical skills, attention to detail, and a deep understanding of distributed computing concepts.
Responsibilities:
-
Design and develop Hadoop-based solutions to process large volumes of data efficiently.
-
Implement and maintain scalable data pipelines using Hadoop ecosystem tools such as HDFS, MapReduce, Hive, Pig, Spark, Kafka, etc.
-
Optimize and tune Hadoop applications for maximum performance and reliability.
-
Collaborate with data scientists and analysts to integrate advanced analytics and machine learning algorithms into Hadoop workflows.
-
Troubleshoot and resolve issues related to data processing and performance bottlenecks.
-
Ensure data security, integrity, and compliance with regulatory requirements.
-
Stay updated with the latest developments in Hadoop technologies and recommend best practices to enhance our data infrastructure.
-
Mentor junior developers and provide technical guidance and support as needed.
Requirements:
-
Minimum of 10 years of experience in software development with at least 5 years of hands-on experience in Hadoop ecosystem technologies.
-
Proficiency in programming languages such as Java, Scala, or Python.
-
Strong understanding of distributed computing principles and experience with large-scale data processing frameworks.
-
Extensive knowledge of Hadoop ecosystem components and their functionalities.
-
Experience with data warehousing concepts and technologies.
-
Excellent problem-solving skills and ability to troubleshoot complex issues.
-
Strong communication and collaboration skills with the ability to work effectively in a team environment.
-
Experience with cloud platforms such as AWS, Azure, or Google Cloud is a plus.
-
Certifications in Hadoop-related technologies (e.g., Cloudera, Hortonworks) are desirable.
,
Sid