Job Description :
4+ projects experience in Technical Lead /Architect roles in Big Data, Analytics, BI, DW projects with overall 10+ projects experience in BI and DW areas
Complete knowledge and hands on expert level experience on Kafka
Complete knowledge and hands on expert level experience building and managing Data Lakes, Big Data ecosystem including Data Ponds and Data Droplets
Aware and implement Enterprise Information Architecture and Connected Data Architecture best practices
Atleast 3 full cycle Big Data projects for organizations. Strong concepts in Hadoop and DBs including Relational SQL and NoSQL databases, including Postgres ,Aurora and MongoDB.
Strong understanding & experience of Hadoop eco-system such as Spark, Scala, Hbase, Hive, Flume, Glue HDFS, MapReduce, Yarn, Spark, Scala, Hive, HBase, SQL on Hadoop, Zookeeper, Sqoop
Knowledge of Hadoop Security, Data Management and Governance, Data pipeline and Workflow Management Tools, Stream-processing Systems
Evaluating and recommending Big Data technology stack for the platform
Ability to articulate pros & cons of “TO-BE” design/ architecture decisions across a wide spectrum of factors
Provides technical leadership for entire big data management and data architecture