The best solution is to run Replicant on a compatible device.

Short of that, you can just load CyanogenMod or another AOSP-based ROM on most devices. It's entirely possible to use Android without the proprietary Google Apps bundle.