Job Description :
Job Title: Big Data
Primary Skill: Vertica
Role : Technical Architect III
Country : USA
Job Location : Albany, NY
No C2C
Interested candidate pls send resume and contact details to
Senior Big Data Architect with AWS background.
Profile under 10 years will be rejected
Will use his/her diverse experience across Big Data
technologies to come up with solutions and use cases that appeal to
customers.
Must have experience of executing at least two-three big
data projects (end to end) and one big data analytics project (end-to-end)
Gather and process raw data at scale (including writing
shell and cloud formation scripts, leveraging APIs, write SQL queries, using
ETL tools (Informatica or AWS Database Migration Services)
Working with server less architectures (Lambda, Docker)
Work closely with our cloud and onsite engineering team to
integrate innovations and algorithms into our production systems.
Process unstructured data into a form suitable for analysis.
Support business decisions with ad hoc data collections as
needed.
AWS experience with EMR and other Hadoop based services
(Hive, PIG) or NoSQL databases (Dynamo DB, MongoDB
Knowledge of analytic programming tools or languages a plus
(Python, R, SAS)
Ability and desire to take in new technologies and
incorporate them to the solution stack.
Candidate must have strong background & hands on experience
of a. JAVA or b. Data warehouse / ETL/BI or c. DWH appliances
Must have strong client handling skills and excellent verbal
and written communication skills.
Excellent problem solving and analytical skills.
Ability to work cross functionally to deliver appropriate
resolution of technical, procedural, and operational issues.
Deep Knowledge of either Cloudera/Horton Works/MapR/Pivotal
Hands-on experience with either Mahout/Spark-MLlib/any other
platform support distributed machine learning platforms
Familiar with analytic techniques for classification,
clustering, recommendation engine, time series modeling etc.
Good knowledge of NoSQL Databases/HBase/ MongoDB
Very good understanding of in-memory databases and
distributed databases
Thoroughly understanding of how to handle real time data
integration
Good understanding of security aspects including Kerberos,
Sentry etc
Good experience with databases and SQL
Good experience with one programming language like Scala,
Java, Python etc
Proven expertise of delivering end to end projects working
with virtual and global teams