Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

backup: TestCloudBackupRestoreAzure failed #140748

Closed
cockroach-teamcity opened this issue Feb 7, 2025 · 1 comment
Closed

backup: TestCloudBackupRestoreAzure failed #140748

cockroach-teamcity opened this issue Feb 7, 2025 · 1 comment
Labels
A-disaster-recovery branch-release-25.1.0-rc Used to mark GA and release blockers and technical advisories for 25.1.0-rc C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Feb 7, 2025 •
edited by cockroach-jira-scripts
Loading

backup.TestCloudBackupRestoreAzure failed with artifacts on release-25.1.0-rc @ 839543761f65547a48b78c10af993545590bded5:

          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-07 23:12:59Z",
          "trace_id": "f7a81b37-91b3-496a-a698-65826cb10000",
          "correlation_id": "b1bf0d93-dbe4-4176-bf53-d1178d7cc118",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: f7a81b37-91b3-496a-a698-65826cb10000 Correlation ID: b1bf0d93-dbe4-4176-bf53-d1178d7cc118 Timestamp: 2025-02-07 23:12:59Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-07 23:12:59Z",
          "trace_id": "f7a81b37-91b3-496a-a698-65826cb10000",
          "correlation_id": "b1bf0d93-dbe4-4176-bf53-d1178d7cc118",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
    testutils.go:302: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_implicit/no_kms (1.28s)
=== RUN   TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_explicit
    backup_test.go:903: error scanning '&{0xc0069da480 <nil>}': pq: failed to encrypt data key for KMS scheme azure-kms: ClientSecretCredential authentication failed. FromClientSecret(): http call(https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token)(POST) error: reply status code was 401:
        {"error":"invalid_client","error_description":"AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: a4341c3c-d3de-468a-9ff2-805df5853b00 Correlation ID: fa498552-d0ee-4119-8835-8718bba025e3 Timestamp: 2025-02-07 23:12:49Z","error_codes":[7000222],"timestamp":"2025-02-07 23:12:49Z","trace_id":"a4341c3c-d3de-468a-9ff2-805df5853b00","correlation_id":"fa498552-d0ee-4119-8835-8718bba025e3","error_uri":"https://login.microsoftonline.com/error?code=7000222"}
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: a4341c3c-d3de-468a-9ff2-805df5853b00 Correlation ID: fa498552-d0ee-4119-8835-8718bba025e3 Timestamp: 2025-02-07 23:12:49Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-07 23:12:49Z",
          "trace_id": "a4341c3c-d3de-468a-9ff2-805df5853b00",
          "correlation_id": "fa498552-d0ee-4119-8835-8718bba025e3",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-secret
    testutils.go:302: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_explicit (3.47s)
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-47343
@cockroach-teamcity cockroach-teamcity added branch-release-25.1.0-rc Used to mark GA and release blockers and technical advisories for 25.1.0-rc C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery labels Feb 7, 2025
@cockroach-teamcity cockroach-teamcity mentioned this issue Feb 8, 2025
Closed
@cockroach-teamcity
Copy link
Member Author

backup.TestCloudBackupRestoreAzure failed with artifacts on release-25.1.0-rc @ e32dca763783603b41fc08dbc3cf40f2cc0c1ec8:

          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 28602126-d645-484d-b18b-e4ae23c40d00 Correlation ID: aced8e0a-558c-4bb9-953a-1a9c71888fee Timestamp: 2025-02-08 23:11:12Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 23:11:12Z",
          "trace_id": "28602126-d645-484d-b18b-e4ae23c40d00",
          "correlation_id": "aced8e0a-558c-4bb9-953a-1a9c71888fee",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 28602126-d645-484d-b18b-e4ae23c40d00 Correlation ID: aced8e0a-558c-4bb9-953a-1a9c71888fee Timestamp: 2025-02-08 23:11:12Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 23:11:12Z",
          "trace_id": "28602126-d645-484d-b18b-e4ae23c40d00",
          "correlation_id": "aced8e0a-558c-4bb9-953a-1a9c71888fee",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
    testutils.go:302: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_implicit (1.45s)
=== RUN   TestCloudBackupRestoreAzure/storage_auth_explicit/no_kms
    backup_test.go:903: error scanning '&{0xc012be9c20 <nil>}': pq: failed to create azure reader: ClientSecretCredential authentication failed. FromClientSecret(): http call(https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token)(POST) error: reply status code was 401:
        {"error":"invalid_client","error_description":"AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 6991a86c-be57-43d5-b349-6f29ede81100 Correlation ID: 1cfb17fd-2f90-4a84-b289-a1be8a873dc9 Timestamp: 2025-02-08 23:11:14Z","error_codes":[7000222],"timestamp":"2025-02-08 23:11:14Z","trace_id":"6991a86c-be57-43d5-b349-6f29ede81100","correlation_id":"1cfb17fd-2f90-4a84-b289-a1be8a873dc9","error_uri":"https://login.microsoftonline.com/error?code=7000222"}
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 6991a86c-be57-43d5-b349-6f29ede81100 Correlation ID: 1cfb17fd-2f90-4a84-b289-a1be8a873dc9 Timestamp: 2025-02-08 23:11:14Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 23:11:14Z",
          "trace_id": "6991a86c-be57-43d5-b349-6f29ede81100",
          "correlation_id": "1cfb17fd-2f90-4a84-b289-a1be8a873dc9",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-secret
    testutils.go:302: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_explicit/no_kms (1.21s)
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Feb 8, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-disaster-recovery branch-release-25.1.0-rc Used to mark GA and release blockers and technical advisories for 25.1.0-rc C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cockroach-teamcity @msbutler