Job Description :
Job Title- Data Engineer,
Duration- 6+ Months,
Location- Jersey City, NJ
Analyst:
Functions and Responsibilities
Wrangle data (a.k.a. data engineering) from a wide variety of complex data sets large volumes of data into normalized and enriched data sets.
Perform data discoveries to understand data formats, source systems, file sizes, etc. This will include engaging with internal and external business partners in the discovery process.
Deliver data acquisition, transformations, normalization, mapping, and loading of data into a variety of data models.
Clear understanding of, and the ability to navigate file structures such as CSV files, Excel spreadsheets, relational data bases
Ability to design and architect method of extracting data from its original source to another location (i.e. a data lake) to make that data consumable for a variety of downstream purposes such as applications, visualizations, analytics and other related data science activities.
Ability to transforming and map one "raw" data form into another format with the intent of making it more appropriate and valuable for a variety of downstream purposes such as analytics.
Lead and execute activities to support all aspects bringing new data sources into Client''s data lake environment, Collaborate extensively with Technology to design data ingestion, data models, and automated operational metrics for consistent high quality data loading into Client Data platform.
Ensure quality, coverage and accuracy of data. Validate data quality content in conjunction with respective data stewards by developing reports and tools to monitor and visualize data.
Skills:
Expert level proficiency in SQL.
Expert level proficiency in Microsoft Excel
Experience working independently with minimal guidance
Strong problem solving and troubleshooting skills with experience exercising mature judgment
Agile Methodologies, Scrum, XP, particularly with more than one team within an organization
Iterative project delivery, Scrum experience
Experience in multiple roles of an Agile team
Ability to work directly with highly experienced user community.
Must have effective collaboration skills
Strong time management skills and multi-tasking capabilities
An understanding of technical concepts, principles and terminology
Self-motivated, ability to set priorities and meet deadlines
Ability to handle multiple tasks/assignments/projects simultaneously
Strong attention to detail
Ability to clearly and correctly state and summarize technical information
Ability to present finds to both technical and non- technical audiences.
Experience with ETL and/or other Big Data processes.