Job Description :
Need an Architect with a wide array of Big Data skills: Platforms, Cloud, Integration.

Looking for a minimum of 12 years experience in IT and 5 years in Big Data. Should have at least 5 recent years working as an architect. Prefer a hands on person who comes from a development background.

Design, develop and document
data ingestion pipelines
data anonymization and security (e.g. encryption, masking and redaction)
data storage
data preparation
Provide assistance with
Installation, configuration and administration of cloud services and other technology components
Data usage by data scientists and BI analysts
Documentation of solution design

Must-have Skills
Real-time and/or event-based micro/mini batch data ingestion
Cloud services and Big Data technology installation/configuration
Ingestion pipeline debugging and optimization
Platform – Cloudera and at least one cloud-based platform (AWS or Azure)
Ingestion – Python/Scala/Java or equivalent, open-source or commercial data ingestion technologies such as Kafka/Confluent, Talend, StreamSets etc.
Storage – HDFS, Kudu, S3 or equivalent
Experience with supporting data scientists/analysts with data access/usage
Good documentation skills
Good verbal and written communication skills
Ability to work in fast-paced environment and evolving solution technologies/design
Ability to learn new technologies quickly

Nice-to-have Skills
Experience with telematics data, automotive industry
Building accelerators for labor-intensive/mundane tasks
Preparation – Python/Scala/Java or equivalent, open-source or commercial data preparation technologies such as Trifacta Wrangler, Talend Data Prep etc.
Data science / machine learning basics