You can download apps and install from other locations without only getting from google play.
You can download apps from google play URLs through chrome on another device and sideload them to your ungoogled tablet.
https://apps.evozi.com/apk-downloader/
Not sure why you'd want to though as one of the plus points is being able to very easily restore or transfer to another device from the cloud as soon as you are logged in.
Some android tablets don't have google play on them at all which is worth watching out for with cheap chinese ones.
You can download and install a clean version of android with no google at all in the background
https://www.tomsguide.com/news/i-used-android-without-google-here-are-the-pros-and-cons