Huawei's newest software tool, called the Unified Cache Manager, seeks to optimize utilization across the traditional cache hierarchy for AI inference, allowing China's AI firms to be more competitive without the need for exotic HBM memory that is near-impossible to obtain in the country.