Keysight AI Data Center Builder
Solution Briefs
The Keysight AI Data Center Builder (KAI DC Builder) is a robust evaluation and benchmarking solution that optimizes AI / ML system design. This solution is faster to deploy and operate, providing deeper insights and higher precision of per-flow measurements.
The Keysight AI Data Center Builder Collective Benchmarks application runs performance micro-benchmarking for distributed communications algorithms commonly used in scaled-out AI systems called collective communications. The typical objective of using the Collective Benchmarks app is to make sure the network delivers the optimal and consistent bandwidth for a range of data exchanges expected from the distributed AI jobs.
The Keysight AI Data Center Builder Workload Emulation application replays short sequences of steps that real AI workloads, like pre- or post-training, go through thousands and millions of iterations called epochs. These workloads form a mix of computational and communication steps, mostly defined by the type of AI model partitioning schemas to distribute the job across hundreds or thousands of GPUs. The Workload Emulation app provides a way to experiment with the performance of the model partitioning choices over various types of network topologies. It helps to find an optimal combination that would minimize the time spent on moving the data and prioritize computations on GPUs, ultimately reducing the Job Completion Time (JCT).
The combination of these two applications results in a more cohesive and automated testing environment, reducing the complexity and time required for setup and analysis. Users gain more accurate insights and can optimize their AI systems more effectively.