Genai main additions#11325
Conversation
Small troubleshooting addition about Oracle datatypes
Updated the description for GenAI Commons to clarify its role as a base module and required dependency.
Updated OpenAI supported models
Bedrock: Updated model listings and added links for Converse and InvokeModel APIs.
Added 'Function calling' to the output capabilities for models supporting the Converse API.
Updated model names and added links for OpenAI and Mistral models and Google Gemini.
|
|
||
| For more details on limitations and supported model capabilities for the Bedrock Converse API used in the ChatCompletions operations, see [Supported models and model features](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html) in the AWS documentation. | ||
| | Support for providers including Anthropic Claude, DeepSeek, Meta, and OpenAI (OSS models). For all models supporting the Converse API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from Amazon Web Services (AWS). | Chat completions | text, document, image | text | Function calling | | ||
| | Native support for models by Cohere. For all models supporting the InvokeModel API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from AWS.| Embeddings | text | embeddings | | |
There was a problem hiding this comment.
Is it fine to update this description to something like "Models supported by Cohere, including Embed v4 and Embed English. For the full list of Cohere models, see Cohere in the AWS documentation."?
There was a problem hiding this comment.
No, because we can technically support different providers than Cohere, just not natively. Would it help to add something like 'For all OTHER models (...)'? (see next comment also)
| For more details on limitations and supported model capabilities for the Bedrock Converse API used in the ChatCompletions operations, see [Supported models and model features](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html) in the AWS documentation. | ||
| | Support for providers including Anthropic Claude, DeepSeek, Meta, and OpenAI (OSS models). For all models supporting the Converse API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from Amazon Web Services (AWS). | Chat completions | text, document, image | text | Function calling | | ||
| | Native support for models by Cohere. For all models supporting the InvokeModel API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from AWS.| Embeddings | text | embeddings | | | ||
| | Native support for Titan Image Generator G1 v2 (check availability for your region). For all models supporting the InvokeModel API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from AWS. | Image generation | text | image | | |
There was a problem hiding this comment.
Can this description be simplified to just "Titan Image Generator G1 v2"? Would Mendix need to change something for additional models to be supported, or is this list likely to expand due to changes on Bedrock's side?
There was a problem hiding this comment.
We natively support Titan only but because the connector supports the invoke API, developers can tweak the code to support other providers - and to find out which ones they can make supported they can check the documentation
Would something like 'For all 'other' models' help here, too? I do not think below text is optimal yet but this is what it comes down to:
'Native support for Titan Image Generator G1 v2 only (check availability for your region). For all other models supporting the InvokeModel API and therefor meeting the requirements to be supported after small customizations (...)'
Maybe for both Embeddings & Image generation we can add an asterisk after InvokeModel API and then it says below that this means they can be supported after some customizations?

List of supported models updated + one small text edit