azure-cli depends on msrest, a library that has been deprecated and unmaintained for 4 years

[jeremycline]

Describe the bug

As of the latest release, azure-cli depends on msrest. This library was deprecated in 2022 since its functionality was provided by azure-identity and azure-core. It has not been updated since, obviously.

msrest no longer builds in Fedora with Python 3.15a5. As it is unmaintained, I plan to remove it from Fedora Linux. I would recommend azure-cli drop it as a dependency.

Related command

N/A

Errors

N/A

Issue script & Debug output

pip install azure-cli

Expected behavior

Don't depend on msrest.

Environment Summary

N/A

Additional context

No response

[yonzhan]

Thank you for opening this issue, we will look into it.

[jiasli]

pipdeptree reveals that msrest is widely used by many Azure Python SDKs:

> pipdeptree --reverse --packages msrest
msrest==0.7.1
├── azure-data-tables==12.4.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-data-tables==12.4.0]
├── azure-mgmt-advisor==9.0.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-advisor==9.0.0]
├── azure-mgmt-appcontainers==2.0.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-appcontainers==2.0.0]
├── azure-mgmt-applicationinsights==1.0.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-applicationinsights~=1.0.0]
├── azure-mgmt-batchai==7.0.0b1 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-batchai==7.0.0b1]
├── azure-mgmt-billing==6.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-billing==6.0.0]
├── azure-mgmt-botservice==2.0.0b3 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-botservice~=2.0.0b3]
├── azure-mgmt-cdn==12.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-cdn==12.0.0]
├── azure-mgmt-cognitiveservices==14.1.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-cognitiveservices~=14.1.0]
├── azure-mgmt-containerservice==40.2.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-containerservice~=40.2.0]
├── azure-mgmt-cosmosdb==9.9.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-cosmosdb==9.9.0]
├── azure-mgmt-datalake-store==1.1.0b1 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-datalake-store~=1.1.0b1]
├── azure-mgmt-datamigration==10.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-datamigration~=10.0.0]
├── azure-mgmt-eventgrid==10.2.0b2 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-eventgrid==10.2.0b2]
├── azure-mgmt-extendedlocation==1.0.0b2 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-extendedlocation==1.0.0b2]
├── azure-mgmt-hdinsight==9.1.0b2 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-hdinsight==9.1.0b2]
├── azure-mgmt-iotcentral==10.0.0b1 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-iotcentral~=10.0.0b1]
├── azure-mgmt-iothubprovisioningservices==1.1.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-iothubprovisioningservices==1.1.0]
├── azure-mgmt-loganalytics==13.0.0b4 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-loganalytics==13.0.0b4]
├── azure-mgmt-managementgroups==1.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-managementgroups~=1.0.0]
├── azure-mgmt-maps==2.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-maps~=2.0.0]
├── azure-mgmt-marketplaceordering==1.1.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-marketplaceordering==1.1.0]
├── azure-mgmt-media==9.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-media~=9.0]
├── azure-mgmt-policyinsights==1.1.0b4 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-policyinsights==1.1.0b4]
├── azure-mgmt-postgresqlflexibleservers==2.0.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-postgresqlflexibleservers==2.0.0]
├── azure-mgmt-privatedns==1.0.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-privatedns~=1.0.0]
├── azure-mgmt-search==9.0.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-search~=9.0]
├── azure-mgmt-sqlvirtualmachine==1.0.0b5 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-sqlvirtualmachine==1.0.0b5]
├── azure-mgmt-storage==24.0.0 [requires: msrest>=0.7.1]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-storage==24.0.0]
├── azure-mgmt-synapse==2.1.0b5 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-synapse==2.1.0b5]
├── azure-mgmt-trafficmanager==1.0.0 [requires: msrest>=0.6.21]
│   └── azure-cli==2.82.0 [requires: azure-mgmt-trafficmanager~=1.0.0]
├── azure-multiapi-storage==1.6.0 [requires: msrest>=0.6.18]
│   └── azdev==0.2.8 [requires: azure-multiapi-storage]
├── azure-synapse-accesscontrol==0.5.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-synapse-accesscontrol~=0.5.0]
├── azure-synapse-managedprivateendpoints==0.4.0 [requires: msrest>=0.5.0]
│   └── azure-cli==2.82.0 [requires: azure-synapse-managedprivateendpoints~=0.4.0]
└── azure-synapse-spark==0.7.0 [requires: msrest>=0.5.0]
    └── azure-cli==2.82.0 [requires: azure-synapse-spark~=0.7.0]

For example, the latest azure-mgmt-storage 24.0.0 still depends on msrest: https://github.com/Azure/azure-sdk-for-python/blob/bbc7bcd27ded6549056d1fac36ac00729a8c245c/sdk/storage/azure-mgmt-storage/pyproject.toml#L32

There are 2 steps to remove the msrest dependency:

1. All SDKs should remove msrest dependency. For example, azure-mgmt-eventgrid 10.5.0b1 no longer depends on msrest: https://github.com/Azure/azure-sdk-for-python/blob/bbc7bcd27ded6549056d1fac36ac00729a8c245c/sdk/eventgrid/azure-mgmt-eventgrid/setup.py#L75. The dependency was removed by Azure/azure-sdk-for-python@38ef11a
2. Azure CLI should bump all these SDKs to newer versions.