Defer cleanup until after initial build is done in release engineering