Parts too big and holes too small

I just changed my bit size down to 2.65mm and it seemed get the parts slightly closer too the right size, which is weird because i measured the bit and its exactly 3.18! ><