Devconf.cz 2023

Ansible Lightspeed (Previously Project Wisdom https://www.redhat.com/en/engage/project-wisdom) infuses Ansible with new capabilities from a generative AI model. It is a model inferencing service that generates Ansible content when automation engineers are writing their intention in plain English. It is a real-time service that has strict latency requirements for the sake of user experience.

In this session, we will walk you through the platform we have built to sustain a high-performing team on its mission to deliver the service. It is an automated pipeline to ensure the new bits (code or model) are well tested as early as in the PR reviewing stage and all the way to production. The pipeline enables the team to practice "shift left" by providing a full-stack ephemeral deployment at pull request time to post-deployment tests in staging and production environments. We will cover the tech stacks and discuss how we have come to decide on the tools and the process we have ultimately adopted.