Well it's the same thing with me using the word argue. I don't mean it in a negative sense but I have to realize that others often do and choose my words carefully

.
At the same time, though, it REALLY pays to let go of your preconceptions and assumptions about things. You say you've never rested more than two minutes and you have no problems. BUT your assuming a lot. Unless you ever try other rest periods you'll never know the possiblilities. Also, even if way back when you rested longer and didn't need it...that has nothing to do with now.
Fatigue management and stress management is something that needs to go on within the workout not just outside of it. The kind of rest periods you take will dictate the kind of fatigue you carry out of the workout and your state of recovery.