Isn’t it fascinating to see how these discussions always tend toward dichotomy? If we push the logic of integration, we could even argue that the effectiveness of a gating network is sometimes conditioned by the quality of the textual embeddings generated upstream. Indeed, a concrete case where this is crucial would be predicting success for startups in very specific niche markets, like marine biotechnology in Iceland, where data scarcity makes semantic richness of textual descriptions absolutely essential for the gating network.