Why PREFIX will never work (and what will)

INSTALL_BASE

        perl Makefile.PL INSTALL_BASE=~
        ...the usual...

Will work just like Module::Build's
So you can move all your previously installed modules over to their install_base locations and from that point on install using INSTALL_BASE/--install_base.