It should be called/enforced. These items are covered in my pre-meet with the teams, coaches and captains. In a dual/tri/quad, if I see a wrestler make a move towards the table, but not yet there, not ready, I'll tell him/her to stay by the bench and get whatever issue fixed (headgear snapped is the most common). Usually this happens only once as the coach catches wind of what I am getting after and makes sure his team is ready go.
Tournaments are a little bit of of a different animal. Often space is at a premium so the difference between the warm up area/bench and the table may be a step or two. So, common sense applies here but I do not let a wrestler come out on the mat unless he/she are ready. I'll just tell them to stand by the table and call them on the mat when they are good to go.
If there were two to three minute delays, I would address that with the coach in between matches and if not rectified, penalize accordingly. If its just because they lost track of what match was next, or sharing headgear, or its a tight space, then I will usually give the benefit of the doubt to the wrestler and address it with the coach. I'd much prefer the match is won or lost on the mat, but if it becomes egregious, then the penalties are there to help move things along.