DirectClient: Texas Health and Human Services Commission(HHSC)
Solicitation#302CSD2113/302CSD2114
Title: Big Data Engineer (Kafka)
Location: OAG CSD State Office, 5500 E. Oltorf St., Austin TX 78741
Duration: Until 8/31/2021 with possible extension upto 8/31/2022
Last date for submission: April 23, 2021 (2.00 PM-CST)
No. of positions: 2
DESCRIPTION OF SERVICES:
The Data division is part of the OAG’s technology organization and is responsible for building data assets to provide value added products and services to drive innovation for our partners and clients. As a Senior Data Engineer, you will help design, enhance and build solutions dealing with real-time data in a fast-paced environment working with/on cutting-edge data and cloud technologies. You will work with colleagues who will support and challenge you daily. We believe in self-managing Agile teams who build products end to end, focusing on unit testing, code reviews and continuous integration for excellent code quality.
The ideal Senior Data Engineer is a collaborative leader skilled in designing and constructing highly scalable data focused applications. You are committed to data automation and integrity, are highly analytical, and can work on multiple projects at once. You will use your skills to engineer, automate, and manage data systems across multiple cloud services platforms and toolsets. Additionally, you will act as a mentor to junior team members and coach them on best practices and engineering standards. The team culture of working collaboratively, cross-functionally, using new technologies combined with the work/life balance provided by Texas OAG are core reasons people enjoy working as part of the Data Division.
CANDIDATE SKILLS AND QUALIFICATIONS
Minimum Requirements:
Years Required/Preferred Experience
8 Required Experience in large-scale IT Project/Product delivery with at least 3 years of work experience in current data streaming, messaging, management, and database technologies
8 Required Ability to establish and always maintain effective and professional working relationships with others in the course and scope of conducting business
8 Required Excellent communication, problem-solving, and organizational skills
5 Required Strong data integrity, analytical, and multitasking skills
4 Preferred Graduation from an accredited four-year college or university with major coursework in Computer Science or Engineering
3 Preferred Experience creating producer and consumer applications with Kafka
2 Preferred Experience with designing and building data platforms
2 Preferred Experience in tuning and troubleshooting streaming/messaging platforms
2 Preferred Experience coding and scripting (Python, Java, Scala) and design experience
2 Preferred Experience with ELT methodologies and tools
2 Preferred Hands-on experience with AWS and/or Azure
2 Preferred Experience with KStreams and KSQL
2 Preferred Experience with designing and automating build and deployment solutions/process for data solutions
2 Preferred Familiarity with data visualization, warehouse, and analytics tools/platforms such as Qlick, SAS Viya, Kibana, Snowflake
2 Preferred Experience with streaming/messaging platforms (Kafka, MQ, RabbitMQ, Elk, Elasticsearch)
1 Preferred Basic knowledge of database technologies (PostgreSQL, Vertica, Redshift, etc.)
1 Preferred Able to work independently