This mixture is called
macaronic verse, and it's fairly common in Middle English lyrics and the other medieval European vernacular languages. All the examples I can think of are religious in some sense (
Timor mortis conturbat me comes to mine), but so much of medieval poetry is that. The Wiki page will probably introduce me to some new ones!