Everyone has different foot anatomy. Some people have toes which descend in length from big toe to little toe. Others have a longer second toe. And the variations just go on and on. Unfortunately, Vibram only manufactures one general blueprint for their shoe shape, so if you don't have compatible foot anatomy, you're kinda SOL.
That being said, there's a little more the equation. You may not have worn them for long enough to adjust. Your foot musculature is shitty and atrophied if you have been wearing conventional shoes for a while, so it does take a couple of weeks to break your foot in to its new home.
Also, sizing is KEY. I wear a 43M. I bought a 44M online once figuring I'd be OK if it were just a little too big. WRONG. I wore them maybe twice before buying a 43M at a local running store. It sounds like yours are maybe too big. If you want to give these shoes another shot, you should head to a running store which carries them and have them fit you for them. They should fit rather snugly, almost just a liiiiitle tightly, and then they will stretch out to the perfect length over the next couple of weeks. I actually just got a new 43M pair of KSO Treks last week, and they're fitting perfectly already.
Oddly enough, I can put both of them on in about 5 seconds now, often hands-free. Quicker than a conventional shoe. It just takes practice and a little toe dexterity.
I think they look awesome!
And I don't run, either. When I'm cutting, though, I do HIIT sprints. I'd rather be muscular than withered I'll take lifting any day. But there's also unstudied but reasonable to assume potential benefits of wearing them during lifting. Studies show that wearing them enhances proprioception. If this extends to lifting (and why the hell wouldn't it?), then wearing these shoes will enhance form while lifting and economize the various kinetic chains of your lifts and potentially allow you to lift more. evrybdy win