The whole point of the term "middle class" was to refer to very rich people. Modern use has somehow forgotten that.

But the idea of being "middle class" is that you aren't upper class (because you're lowborn), and you aren't lower class (because you're rich).