Here you go.

CPDL also has a list, with incipits. Still to do is the breaking up of long psalms like 119 (118) according to the various Latin psalters. These dont always correspond to the BOCP and I havnt checked that they even agree with each other.

What is the reason for the different numbers?

The traditional Catholic divisions between psalms, and how they are counted, is based on the Vetus Latina version (Jerome was kinda scared to tinker with the Psalms much, so the Latin psalms go way back), which is based on the Septuagint version, which is based on the pre-Masoretic Hebrew text. The line numbers are usually also different.

Jewish and Protestant Bibles go by the psalm divisions in the Masoretic Hebrew text, and they also often figure line numbers in a slightly different way. Most Catholic Bibles today are printed according to the Protestant system, which is a real pain in the butt if you're looking up older citations (or citations by our Pope, who often goes with the Catholic system in his homily stuff).

So there's a certain inherent messiness, but that's why Psalm citations should always be done in dual format if you're Catholic. This often is the case also with books like Daniel and Esther, since many Protestant-styled Bibles leave out juicy bits or print them at the end instead of in their place.

And of course the Latin division and naming of Biblical books wasn't the same, either (Latin counts 4 Books of Kings, which are smooshed together into 2 in modern Bibles). So there's all sorts of fun to be had, when looking for citations.