Yeah, just as Jeffe said, you can have both good printing quality and good milling ability if you use a drop table like I did on my first build (see here).
I was able to 3D print really well and also to mill wood and aluminum. I didn’t have great results with aluminum, but that was mostly due to my spindle motor which wan’t powerful enough (and my CAM skills that were bad).
I had two Z axis, I was using the long one for 3D printing and a super short one for milling.
The drop table wasn’t difficult to build at all, so I guess you should not be afraid to try it 