Role: Data Engineer
Location: Charlotte, NC
Job Description:
Roles/Responsibilities:
AWS Data Engineer
• Create and maintain optimal data pipeline using Python, Spark
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python (PETL, CX-ORACLE, Sybase, DB2, JASON, NUMPY, PANDAS. PYSPARK)
• Able to store-migrate data files securely between On-Off Premises in AWS-S3
• Able to manipulate file or data in cloud using AWS Lambda Function, Glue ETL, Step function
• Work with data and analytics experts to strive for greater functionality in our data systems
• Advance SQL skills and ability to write and analyze medium to complex SQLs, performance tuning
• Analytical skills for data quality and insights gathering
• Experience in building processes supporting data transformation, data structures, metadata, dependency, and workload management
• Strong analytic skills related to working with unstructured datasets
• Have experience/knowledge in DevOps processes using Git and Jenkins
• Good experience in Agile and tools like Jira, Confluence