Jim - I'm surprised you're able to get your foot out of the ZipFits without removing the liner from the shell. That's a pretty amazing feet (and one that's completely impossible with the internally leather-lined version of the ZipFits).
Since I've come to appreciate the benefits of a stiffer boot and have experienced first-hand what it has done for my skiing, I still contend that my first observation (boots either too big or too soft) should be strongly considered when assessing whether or not you're in the right shell.
I used to tell people that my Flexons were a glove-like fit. If that's still true then my Raptors are more akin to a vise-like grip - of course it's a vice with soft jaws though. The hold is so strong and the fit so tight that I cannot move my foot into a "bad" position while the boots are buckled no matter I try. My footbed still allows enough lateral movement so that I can pressure the walls of the shell though. I guess this is my attempt at describing what a really high performance fit should feel like. Of course I've never been in a true plug boot, but I can't imagine it feeling much different than what I'm in now - I'm lucky that me feet were pretty much designed for narrow race-lasted shells. They just drop in without any mods needed (thanks to the the pairing with the ZipFits).