Do you need a Knowledge Layer?

Vector databases are becoming infrastructure. What is a knowledge layer, do you need one, and what should you ask vendors before you buy?