Job Description :
Kafka Architect
St Louis, MO Minneapolis, MN
Long term

Primary Skill:

Kafka, Zookeeper, Kafka Connect, NoSQL

Secondary Skill:

Docker, Kubernetes, GCP technologies, Spark

Job Description: Detailed overview of functional and technical role expectations
Collaborate with senior leaders to develop solution roadmaps/implementation paths
Lead the cross functional Kafka development team/s
Build, deploy, and support modules of large, world-class enterprise-level solutions in a highly collaborative group.
Leverage sound judgment and problem solving to tackle some of most critical data problems and connect the .s to broader implications of the work
Design, architect, and help implement data flow processes to help engineering teams comply with standards, processes, policies and procedures Bachelor’s/Master’s in Computer Science or related disciplines, with strong technical leadership in software development.
In-depth knowledge of Kafka architecture & core concepts, components (Brokers, Producers, Consumers), server/client configuration, client libraries and APIs, Kafka Streams, Kafka authentication (SASL), Zookeeper, Kafka Connect, NoSQL (MongoDB, Cassandra), etc.
Hands-on experience with client AND server-side problems (duplicate message, lag, skewed partitions, resource usage, missing leader), performance tuning, monitoring and metrics.
Experience in Docker, Kubernetes and GCP technologies.
Experience Apache, Spark, or Hadoop and data analytics ecosystem relevant tools (Sqoop, Flume, Kinesis, Kafka, Oozie, Hue, Zookeeper, Ranger, Elastic search, and Avro)
Experience of building large scale data systems