Towels

I have a pet peeve I just wanted to mention. I was reminded of it again today when I was washing towels. I keep purchasing nice quality handtowels for the guest bath and have been consistantly disappointed with them. They collect lint/bits of towel residue on the surface. I have no idea which towel is shedding but every time I wash towels I see them. Is it my towels, my washing machine? Arghhhh.