So just adding info here for future googlers.
There is an NI KB article on how to cleanup the cache here: https://knowledge.ni.com/KnowledgeArticleDetails?id=kA00Z0000019KdtSAE&l=en-US
In there it also mentions an ini token that eliminates cache creation completely: