Job Description :
Job Code : Big Data
Primary Skill : Vertica
Role : Technical Architect III
City : Albany
State : New York
Country : United States
Needed GC& CITIZENS
Skill Description Skill Type Min Exp(months) Max Exp(months)
Vertica PRIMARY 96 144
Job description :
o Senior Big Data Architect with AWS background.
o Will use his/her diverse experience across BigData technologies to come up with solutions and use cases that appeal to customers.
o Must have experience of executing at least two-three big data projects (end to end) and one big data analytics project (end-to-end)
o Gather and process raw data at scale (including writing shell and cloud formation scripts, leveraging APIs, write SQL queries, using ETL tools (Informatica or AWS Database Migration Services)
o Working with serverless architectures (Lambda, Docker)
o Work closely with our cloud and onsite engineering team to integrate innovations and algorithms into our production systems.
o Process unstructured data into a form suitable for analysis.
o Support business decisions with ad hoc data collections as needed.
o AWS experience with EMR and other Hadoop based services (Hive, PIG) or noSQL databases (DynamoDB, MongoDB
o Knowledge of analytic programming tools or languages a plus (Python, R, SAS)
o Ability and desire to take in new technologies and incorporate them to the solution stack.
o Candidate must have strong background & hands on experience of a. JAVA or b. Data warehouse / ETL/BI or c. DWH appliances
o Must have strong client handling skills and excellent verbal and written communication skills.
o Excellent problem solving and analytical skills.
o Ability to work cross functionally to deliver appropriate resolution of technical, procedural, and operational issues.
o Deep Knowledge of either Cloudera/HortonWorks/MapR/Pivotal
o Hands-on experience with either Mahout/Spark-MLlib/any other platform support distributed machine learning platforms
o Familiar with analytic techniques for classification, clustering, recommendation engine, time series modeling etc.
o Good knowledge of NoSQL Databases/HBase/ MongoDB
o Very good understanding of in-memory databases and distributed databases
o Thoroughly understanding of how to handle real time data integration
o Good understanding of security aspects including Kerberos, Sentry etc
o Good experience with databases and SQL
o Good experience with one programming language like Scala, Java, Python etc
o Proven expertise of delivering end to end projects working with virtual and global teams