I needed to add ENVIO_API_TOKEN: ${ENVIO_API_TOKEN:-} to the indexer section of the compose file for the indexer to pick up the token. Otherwise I would get an error saying that I did not have an ENVIO_API_TOKEN.
Docker Engine version - 29.1.3
Envio - 3 alpha 14