Maybe it's a goofy thought, and I haven't really looked closely at the inner door panels, but what about adding some sort of foam padding there and on the center console to reduce lateral hip movement during spirited driving?
Doesn't happen often, but I have slid around from time to time