Survey message printed to `stderr` even when `only_show_errors` is set to `true`

[jiasli]

I have the same problem here. When I use Azure CLI in an Azure DevOps Pipeline, the following text is written to Std Error:

Please let us know how we are doing: https://aka.ms/azureclihats
and let us know if you're interested in trying out our newest features: https://aka.ms/CLIUXstudy

although I set the environment variable AZURE_CORE_ONLY_SHOW_ERRORS to true.

This makes my pipeline job fail then. Also see microsoft/azure-pipelines-tasks#16840.

Originally posted by @svdHero in #16949 (comment)

[jiasli]

@svdHero, could you let us know which command that you run triggered this message?

[svdHero]

@jiasli Thank you for creating this new issue. I always thought it was az login, but that was a red herring. The guilty one actually is az --version which writes to StdError.

In Azure DevOps, this pipeline succeeds:

name: debugging
trigger: none
stages:
- stage: debugging
  variables:
    AZURE_CORE_ONLY_SHOW_ERRORS: true
  pool:
    vmImage: ubuntu-20.04
  jobs:
    - job: Run_Debugging
      steps:
        - task: AzureCLI@2
          inputs:
            azureSubscription: 'my-service-connection'
            scriptType: bash
            failOnStandardError: true
            scriptLocation: inlineScript
            inlineScript: |
              az account show

but this pipeline fails:

name: debugging
trigger: none
stages:
- stage: debugging
  variables:
    AZURE_CORE_ONLY_SHOW_ERRORS: true
  pool:
    vmImage: ubuntu-20.04
  jobs:
    - job: Run_Debugging
      steps:
        - task: AzureCLI@2
          inputs:
            azureSubscription: 'my-service-connection'
            scriptType: bash
            failOnStandardError: true
            scriptLocation: inlineScript
            inlineScript: |
              az --version

So for me the workaround is to just remove az --version. However, this still is a bug, or at least unexpected behaviour.

[svdHero]

@jiasli I have another guilty one. The lines

az keyvault network-rule add --name $vaultName --ip-address $currentIp
MY_SECRET=$(az keyvault secret show --vault-name $vaultName --name "my-secret" --query "value")
az keyvault network-rule remove --name $vaultName --ip-address $currentIp

Also write the following progress to StdErr:

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100    13  100    13    0     0     95      0 --:--:-- --:--:-- --:--:--    94
100    13  100    13    0     0     95      0 --:--:-- --:--:-- --:--:--    94

ignoring the AZURE_CORE_ONLY_SHOW_ERRORS flag.

Unfortunately I do not have any work-around for this. 😢 So any help would be much appreciated.

[svdHero]

@jiasli I have opened yet another issue for the latter problem. See #23801.