Devconf.cz 2023

Batch processing pipelines are a common way to automate the processing of large volumes of data on a scheduled basis. However, building and managing these pipelines can be challenging, especially in a containerized environment like OpenShift. In this talk, we will explore how Tekton, a Kubernetes-native framework, can simplify the process of building and managing batch processing pipelines in OpenShift.

During this session, we will cover:

- An overview of batch processing pipelines
- How to define and run a batch processing pipeline using Tekton in OpenShift
- Best practices for designing and building scalable and maintainable batch processing pipelines with Tekton
- Real-world examples of how Tekton has been used to orchestrate batch processing pipelines at Red Hat to process insights data from OpenShift clusters