With an unbound T, you can use anything for T. That includes classes like File and even Object. What would + mean for two File objects, or for two Object methods?
If you bound T to Number then it would be possible for Integer, Short, etc through auto(un)boxing. But what about BigDecimal or BigInteger? They don't support auto(un)boxing. And what about any custom Number subclass?