AWS Lambda integration

[j2cunningham]

My company is an AWS shop that heavily uses Langchain. We had a requirement to be able to call AWS Bedrock models. For reasons that are not important here, I was not able to call directly to the AWS Bedrock API in Langchain. The 30 second timeout in API Gateway made the built-in calls from Langchain to API Gateway and then on to Bedrock less than ideal. What I did was take the customLLM class that inherits from the LLM class and have it call to an AWS Lambda and then the lambda takes the passed in prompt and calls the Bedrock API. This is working very well in a POC environment. My concern is that since this doesn't already exist, is there a reason that I should not be doing this? Is there a downside for this approach from a Langchain point of view? Thanks