I'd agree. I'm not sure how it will look though. I can only see it looking piecemeal.
I agree that you don't want the hodgepodge thrown together effect like Nebraska or A&M has. However, I think it would look better if you had it intentionally standing out by itself, rather than trying to integrate, or flow it into the lines of east or west side. So go ahead and put the other two video boards up in the corners, then for your second level, immediately start with seating, go up about half the height of the upper deck on the east side, and then cap it with lower priced club area, very similar to what Ole' Miss does. They've got two "upper" levels though as well as a sun shade.
In my mind what I have pictured doesn't look too bad, but I've never been much of an architect either.