Move physical allocation namespace out of `virtual_` and up into `memory` #485