I don't think that a manager can be termed incompetent if the management have not passed a vote of no confidence on him. I believe it is only the management after having evaluated his performance indicator and falling short then he can be termed as incompetent.