Doing it in the morning is far more better than doing it at night because of the reason that you stated. The chances of doing the sweeping and cleaning at night is a bit slim too.
Exactly! Also, there is a chance of getting an unexpected visitor and it is going to look very disgusting when your whole house is not in the right order simply because you couldn't or didn't sweep the house and put things in place before you went to work. It is going to be an embarrassing experience.