Uber developed Testopedia, a centralized system for managing flaky tests in its CI pipelines, to address the issue of flaky tests in its legacy system. Testopedia focuses on tracking test entities identified by Fully Qualified Names (FQNs). It uses a finite state machine model to capture their states. Testopedia supports scalable data ingestion, flexible partitioning for efficient cone queries, and customizable analyzers and ticketing systems.
Wednesday, June 5, 2024Uber developed Testopedia to manage its large suite of tests. It's used to track test statistics and categorize tests based on their stability. Testopedia uses a bucketing algorithm to handle test queries and uses a sliding window algorithm to identify flaky tests.