Job Description :
Hello,

Hope you are doing Good !!

We are looking for Data Engineer/ Scientist with one of our Clients, below is the Job Description. If you are available and interested then, please reply me with your updated resume. For more details please reach me at Ext: 366.

Title: Data Engineer-Python
Location: New York City, NY
Duration: Fulltime / Contract

Skills Required
5+ years of software engineering experience with 2+ years in data engineering
Worked with Python and experience with either Java or Scala
Experience with Apache Spark and/or Apache Hadoop
Understanding of Apache Kafka and its use cases
Experience with build and dependency management tools (Gradle, sbt, Maven, npm)
Ability to build cloud native apps on Amazon Web Services
Good experience with agile development processes like Scrum and Kanban
Insist on automating everything (testing, Continuous Integration, Continuous Delivery)
Preferred experience in traditional business intelligence (e.g. star schemas, OLAP cubes)
Experience in working on the command line in a Unix/Linux environment

Responsibilities for data engineer:
Building, maintaining, and optimizing data pipelines and ETL jobs
Collaborating across the team to shape the Data Platform technology stack
Creating technical documentation
Improving automation and test coverage (unit/integration/user acceptance tests, etc
Resolving technically advanced problems
Keeping up to date with modern data engineering technologies

Responsibilities for data engineer with Python:
Extending and customizing open source data catalog solutions to meet our needs
Help drive our API connector framework architecture and engineering efforts
Collaborating across the team to shape the Data Platform technology stack
Creating technical documentation
Improving automation and test coverage (unit/integration/user acceptance tests, etc
Advising across teams on "Pythonic" Python development
Keeping up to date with modern software engineering technologies

Key Skills: Python and experience with either Java or Scala, Apache Spark and/or Apache Hadoop
Some experience in (Gradle/ sbt/ Maven/ npm)
build cloud native apps on Amazon Web Services
good enough experience in Business Intellegence
Agile Development
             

Similar Jobs you may be interested in ..