Job Description :
Big Data/Hadoop Technical Developer with extensive experience on the Hadoop platform and related Big Data tools/technologies.
8+ years of experience in implementing and managing high performance scalable enterprise applications in the Financial Services industry.
Good knowledge of architecture, design patterns, Source target mappings, ETL Architecture in Hadoop space, data modeling techniques, performance tuning in Hadoop environment.
Experience with big data tools: Hadoop, Spark, Kafka, PySpark, python, Impala, Hive, HDFS and related tools
Experience in CI/CD tools such as Maven, Git/Stash, Jenkins, Docker etc.
Advance level knowledge and experience with SQL queries
Able to analyze huge volume of data and understand patterns, data quality issues and design solutions to manage volume.
Expertise in building application in Cloud Platforms such as AWS and leveraging native services an asset
Experience working in Agile environment
Experience working with shell scripting.
Modularize the project components. Architect the complete project and provide solution architecture.