Job Description :
Role: Data Engineer Position
Location : Columbus / Remote
Type : Contract
Rate: DOE
Position ID - 202221
Job Description
This role requires a wide variety of strengths and capabilities, including:
BS/BA degree or equivalent degree with 10+ years of IT experience as a Data Engineer.
Expertise in application, data, and infrastructure architecture disciplines
Proficiency in multiple modern programming languages
Knowledge of industry wide technology trends and best practices
Ability to work in large, collaborative teams to achieve organizational goals, and passionate about building an innovative culture
Experience with building large scale big data applications development
Provide technical contribution developing data solutions and building frameworks
Experience building Data Lake using AWS and Hands-on experience in AWS Glue, AWS KMS, AWS Firehose, EMR, Athena, Redshift, Quick Sight and Lake Formation
Experience in working Amazon cloud managed services Amazon S3, Athena, EC2, RedShift, RDS, Lamda, EMR.
Extensive experience in Spark leveraging Python, Scala
Extensive experience on PL/SQL, performance tuning of queries.
Experience in implementing Concurrency/Multi-threading and Hashing Algorithms in Scala.
Experience in creating and executing Athena Query using Amazon Glue Crawlers, Data Catalog setup and Workgroup creation.
Demonstrable experience of successfully delivering big data projects using Kafka
Experience working on NoSQL Databases such as Cassandra, HBase, DynamoDB, and Elastic Search
Hands on experience with leveraging CI/CD to rapidly build & test application code
Expertise in Data governance and Data Quality
Experience working with PCI Data and working with data scientists is a plus
In depth knowledge of design principles and patterns
Ability to tune big data solutions to improve performance and data recovery plan implemented for RDBMS and Amazon Cloud.