I got an adapter so I could run a normal 2280 SATA SSD in there, and I was able to install another copy of Linux and have that boot fine.

Apple Inc. "UEFI" just got some hair up its ass about automatically booting from the shipped hardware (booting manually after using some GRUB rescue disk also worked)