Back in the day, our organist at St. Mary's in Akron, Ohio used his "boom box" which had a cassette recorder built in. He would place it on the organ bench near the sanctuary and he taught his wife which buttons to push and how to flip the tape over and start recording again. Of course the choir sang from the choir loft.
I have used a couple of different models of Tascam handheld recorders and the built-in mics were very good. I upload the audio to my computer and use Audacity (free editing software) to edit it. When I want to share parts with the singers I post the audio to SoundCloud.com (also free up to a time limit), marking them "private" so that only those with a link can access them.
To participate in the discussions on Catholic church music, sign in or register as a forum member, The forum is a project of the Church Music Association of America.