Job Description :
Launch Your Career with Cook Systems
Ready to elevate your career? Cook Systems, a certified veteran owned IT consulting firm, has been transforming businesses and careers since 1990. Whether you're aiming to work with a Fortune 500 company or a small business, we've got you covered.
Our core values: integrity, investment, and innovation drive everything we do, ensuring you grow and succeed in a dynamic, supportive environment. We understand the importance of work life balance and personal growth. Our cutting edge IT consulting partners and FastTrack talent program are designed to help you excel.
Join our forward thinking team where excellence and creativity are valued every day. Check out what our associates have to say on Glassdoor. Ready to take your career to new heights? Cook Systems is where your journey to success begins!
AI Engineer
Memphis, TN (onsite/Hybrid-3 days per week, may consider remote)
6 months plus
LLM Platform Engineer for GenAI Infrastructure Overview is seeking a highly skilled engineer with deep expertise in large language models (LLMs), information retrieval, and distributed systems to design and build the foundation for GenAI applications at enterprise scale. This role is not about building end-user AI apps?it is about creating the centralized AI infrastructure that will enable 50+ teams across the organization to innovate securely, efficiently, and consistently. The contractor will lead the design and implementation of an enterprise LLM Gateway, a central API layer that mediates all LLM interactions, enforcing governance, security, observability, and performance best practices. Over time, you will extend this platform with retrieval-augmented generation (RAG) capabilities and shared vector database integrations.
ESSENTIAL JOB FUNCTIONS:
LLM Gateway Design & Development
Architect and implement an enterprise-grade LLM Gateway serving as the single-entry point for all application teams.
Build mediation pipelines for prompt cleansing, PII detection/masking, guardrails, linting, throttling, and quota enforcement.
Ensure system supports multi-tenant, policy-driven routing and governance. Governance, Security, and Observability
Design centralized controls to enforce organizational compliance and security policies across all LLM usage.
Enable logging, monitoring, and reporting for auditability, cost tracking, and usage insights.
Implement safeguards to mitigate brand and messaging risks, ensuring LLM outputs remain aligned with enterprise communication standards, especially in consumer-facing applications.
Future RAG & Vector Database Integration
Architect a shared, hybrid retrieval-augmented generation layer to support enterprisewide use cases.
Design abstraction layers to minimize coupling with any one vector database provider, enabling portability and cost optimization.
Optimize information retrieval pipelines: semantic search, embeddings, metadata filtering, hybrid retrieval.
Research & Systems Thinking: Apply formal methods, distributed systems design, and computer science principles to ensure correctness, scalability, and resilience.
Stay current with advancements in embeddings, search algorithms, vector stores, and LLM serving platforms.
Advise teams on tradeoffs of embedding models, vector DB choices, and migration strategies.
REQUIREMENTS
Strong background in Computer Science, Machine Learning, or related field (M.S. preferred).
Deep expertise in LLM integration, prompt/response mediation, and GenAI system design. Hands-on experience with vector databases (e.g., Pinecone, Weaviate, Milvus, FAISS, Vespa, pgvector) and embedding models.
Knowledge of information retrieval methods: dense retrieval, semantic search, filtering, hybrid approaches.
Experience building distributed, high-scale backend systems with strong governance/security requirements.
Hands-on experience with cloud-native development such as AWS, including containerization technologies (e.g., Docker, Kubernetes) and CI/CD pipelines for scalable deployment and automation.
Proficiency in at least one modern programming language used in AI/ML systems (Python, Java, Go, etc.).
Familiarity with frameworks such as LangChain, LlamaIndex, LiteLLM, or equivalent orchestration layers.
Familiarity with Microsoft M365 Copilot (strongly preferred) and Salesforce Agentforce (nice to have), particularly in the context of LLM integration and governance.
Strong systems thinking: ability to design abstractions, modularity, and portability across providers.
Excellent communication skills?able to collaborate with both technical and nontechnical stakeholder.
SKILLS PREFERRED
Experience with policy-driven API gateways or enterprise middleware. Knowledge of formal verification methods or program analysis techniques for correctness/guardrails.
Prior work on multi-tenant ML platforms or enterprise ML Ops Contributions to open-source libraries in LLM/RAG/vector search space.
Impact: This role is foundational. The infrastructure you build will enable several internal teams to safely and effectively leverage GenAI, while ensuring the enterprise maintains control, compliance, and efficiency
Why Work with Us
Benefits
At Cook Systems, we don't just offer jobs we build futures. Our team is the heart of everything we do, and we're committed to supporting you with benefits that go beyond the basics. We want you to feel secure, valued, and empowered from the very beginning of your journey with us. When you join Cook Systems, here's what you can look forward to:
Your Health, Your Way: Choose from two comprehensive medical plans through Blue Cross Blue Shield, complete with dental and vision coverage. With access to one of the nation's largest networks, you'll get the care you need for yourself and your family wherever life takes you.
Peace of Mind, Every Step of the Way: Protect what matters most with life, critical illness, and accident insurance through Unum. Because your loved ones deserve security no matter what the future holds.
Flexibility for Life's Needs: Save money and plan ahead with a Flexible Spending Account and Daycare FSA through Navia, helping you manage healthcare and dependent care expenses on your terms.
Bridging the Gaps: Unexpected costs? No problem. Our Health Gap Insurance through Sunlife helps ensure you're covered when it counts.
Your Future Starts Now: Dream big with our 401(k) retirement plan through The Standard. After just six months, you will be eligible to participate, because your future deserves a strong foundation.
At Cook Systems, you're not just another employee you're family. Here, your ideas matter, your contributions shine, and your career will thrive. Together, we innovate, grow, and celebrate success every step of the way. Are you ready to be part of something bigger? Let's build the future together at Cook Systems.