I am pretty sure most of the bread collectors were not literate (although nearly all the Goodmen were! There was a lot more literacy, and a lot more books! than I had expected.) So they probably just knew and loved every single crumb so well that there was no risk of a mixup.

I am 100% sure you are right that they accused each other of faking though. :D