1) At a sung Mass (of any degree, I think) the Propers and the Ordinary take precedence over any other music -- so before we add the Vespers hymn, the rest should be chanted -- even if it's recto tono.
2) The singing of the Vespers Hymn would need to not unduly prolong the Mass. (If you keep the action of the Mass delayed because you're busy doing "extra" stuff, this is not proper, but a polyphonic ordinary doesn't violate this principle, because you're still singing the Mass.
3) Rationally (but I don't know if there's a decree to this effect) the Vespers hymn, whenever it is sung, would have to be proper to the season, at least. So, we couldn't sing the Vespers hymn for Paschaltide in Septuagesima, just to use a silly example.
4) Some people argue (and I tend to agree with them, at the cost of bushels of scorn heaped upon my head, because I remember reading an official document to this effect) that nothing in the vernacular belongs between the initial sign of the cross and the Last Gospel, at a sung Mass. Low Mass with hymns, which should be exceptional, if I recall correctly, allows vernacular hymns.
To participate in the discussions on Catholic church music, sign in or register as a forum member, The forum is a project of the Church Music Association of America.