[Feature Request]: Unify the cache locations configurability by using `find-cache-dir` everywhere #22044