Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bedrock: support grant access to models for FoundationModel #29855

Open
2 tasks
jlosito opened this issue Apr 16, 2024 · 4 comments
Open
2 tasks

bedrock: support grant access to models for FoundationModel #29855

jlosito opened this issue Apr 16, 2024 · 4 comments
Assignees
Labels
@aws-cdk/bedrock Related to @aws-cdk/bedrock effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2

Comments

@jlosito
Copy link

jlosito commented Apr 16, 2024

Describe the feature

I would like a programmatic way to grant access to Bedrock models.

Use Case

Before using a model, a user will need to grant access to the model. A user might want to do this programmatically within CDK.

Proposed Solution

Something along the lines of this. It could be a wrapper around a custom resource.

import * as bedrock from 'aws-cdk-lib/aws-bedrock';

bedrock.FoundationModel.grantModelAccess(this, 'model-access', {
    models: [bedrock.FoundationModelIdentifier.ANTHROPIC_CLAUDE_V2],
});

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change

CDK version used

2.137.0

Environment details (OS name and version, etc.)

macOS 14.4.1

@jlosito jlosito added feature-request A feature should be added or improved. needs-triage This issue or PR still needs to be triaged. labels Apr 16, 2024
@khushail khushail added investigating This issue is being investigated and/or work is in progress to resolve the issue. and removed needs-triage This issue or PR still needs to be triaged. labels Apr 16, 2024
@khushail khushail removed their assignment Apr 16, 2024
@pahud pahud self-assigned this Apr 16, 2024
@pahud pahud added the @aws-cdk/bedrock Related to @aws-cdk/bedrock label Apr 16, 2024
@pahud
Copy link
Contributor

pahud commented Apr 16, 2024

Yes, we should add that method here and implement it using custom resources. Making this a feature request. Please help us prioritize with 👍

@pahud pahud added the p1 label Apr 16, 2024
@pahud pahud changed the title bedrock: grant access to models bedrock: support grant access to models with FoundationModel L2 construct Apr 16, 2024
@pahud pahud added effort/medium Medium work item – several days of effort and removed investigating This issue is being investigated and/or work is in progress to resolve the issue. labels Apr 16, 2024
@pahud pahud changed the title bedrock: support grant access to models with FoundationModel L2 construct bedrock: support grant access to models for FoundationModel Apr 16, 2024
@pahud
Copy link
Contributor

pahud commented Apr 16, 2024

By the way, do you see any relevant SDK methods for this action? I am looking at this doc but I can't find relevant methods.

@jlosito
Copy link
Author

jlosito commented Apr 16, 2024

I personally did not. I too tried looking within the SDK docs, aws cli, and even the gen ai constructs library under awslabs. From what I could come across, it looked like the model access might be a marketplace subscription under the hood.

https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html

@TheRealAmazonKendra
Copy link
Contributor

Given that there are not SDK calls for this and that this is a brand new module, I don't actually believe that we should do this at this point. The service team just released their first set of resources two weeks ago and trying to build over that with custom resources is a little premature. If they then release official resources that enables this, we'll need to deprecate our custom resource and that will cause churn.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
@aws-cdk/bedrock Related to @aws-cdk/bedrock effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2
Projects
None yet
Development

No branches or pull requests

4 participants