Job Description :
Job Title: Data Engineer Job ID: # 715096 Duration: 6 Months+ (W2 contract) Location: Remote across USA Interview process: Telephonic Candidate must be in US and be able to work EST time zone. Skill Sets: Python, Glue, Lambda, Data Sync, Kafka, Lake Formation, Redshift Data Engineer • As Data Engineer you will be working to ingest data, build ETL pipelines and work with messy data daily. You will also produce data models when necessary. You will be working hands-on in building data pipelines and will be expected to communicate the work you do. • Engage with business and technology stakeholders to create a compelling vision of a data-driven enterprise in their environment. • Use AWS services such as Athena, Glue, Lambda, S3, DynamoDB NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift. • Focus on Data processing capabilities and helping our customers and partners remove the constraints that prevent them from leveraging their data to develop business insights • Producing fault-tolerant, scalable data platforms in the cloud • Working with Spark, Airflow, as well as various reporting tools • Design technical solution for features • Refine user stories into tasks • Support data platform migration to AWS • Provide research and analysis on data sources in support of data discovery and requirements elicitation • Identify data quality problems; identify internal and external data sources; and, select subsets of data relevant for meeting business requirements through development of an analytic solution. • Collect data, verify data completeness, identify redundancies, statistically adjust for missing values, and assess utility of the data with respect to analytic goals • Perform analysis of accessibility and availability of data, selection of relevant data attributes, and processes for storing and managing data • Identify execution models based upon refresh cycles (e.g., batch vs. streaming support and sustain the models and analytic technologies within those environments • Tune Spark/Glue jobs for optimal performance