Job Description :
good fit with AWS, Spark, cassandra experience
- Knowledge of API integration, ETL, data cleansing, filtering etc. and having good understanding about related challenges
- AWS Cloud based big data and analytics applications experience
- Experience on Apache Spark, Apache Cassandra
- Experience on Python scripting/programming
Responsibilities -
Solution Data Engineering
Require a Solution Data Engineering as a three months
- AWS environment setup knowledge such as VPC setup, security, server provisioning, availability zones etc.
- AWS services knowledge to define data processing and governance pipeline using S3, SQS, SNS, EC2, Lambda, EMR, Redshift etc.
- Knowledge of API integration, ETL, data cleansing, filtering etc. and having good understanding about related challenges
- Cloud based big data and analytics applications experience
Need to be able to understand easily different types of the data such as Business metadata, reference data, master data, operation and analytical data.
Good understand of solution data engineering documentation and data dictionaries.
The appropriate Attitude should include:-
An Enquiring Mind
The ability to abstract general principles from specifics.
A strong desire to establish Standards of Best Practice.
Recognition of the value of Data Architecture Design Patterns
The required Skills include:-
Data Analysis
Data Migration Tools Knowledge
Data Integration Concepts
SDLC
Personal Qualities should include:-
Communications and Presentation Skills
A good architect, thinker and solution provider
Out of the box thinker