Fit conversations always go to the chest and the shoulders. But the measurement people get wrong most often is body length, and it is the one that decides whether a tee looks like it belongs to you.
There is a fairly narrow band where a hem works, and it is defined by landmarks on your body rather than by a number on a size chart.