Totally Agree! I prefer to mix with my hands on the faders instead of a mouse. As you say you can absolutely do great and awesome mixes in the box. But for me, using a mixer keeps me from using my eyes when I mix. Instead I listen more on whats coming out of my speakers. When I mix in the box, which I currently do, I have to tell myself to listen more to how it sounds.
So a mixer or at least a control surface for my DAW is quite high up on my investment list.