Your design should be totally workable if you don’t mind tearing up your spoilboard a bit, just set the CAM to overcut by enough to account for the variance in your table. It should be repeatable enough, though the resultant DOC variation does cause problems if you’re trying to go real fast.
I say get it cutting, see how it goes - you can always build a better table later. Possibly using the machine, though Ryan’s non CNC design is pretty slick: ~ $200 Full sized Lowrider table, Non-CNC Build