Generative AI in OCI

tags :

Generative AI in OCI #

Release announcement blog, January 23, 2024 #

ref

Text generation and embeddings models #

• Cohere Command in 52-billion and 6-billion parameter sizes (the XL and light models)
• Meta llama2 70-billion parameter model

Token limit and size #

• 4096 tokens
• 1 token = 4 english characters maximum context length = 4096 * 4 = 16, 384 characters

Cohere models #

• Embed English and English Light V3 1024 vs 384 dimensions OpenSearch 2.8 version with Lucene engine supports max of 1024 vectors 👌🏽..

• Embed Multilingual and Multilingual Light V3

Subscription types #

On-demand #

pay only for what you are consuming.

Dedicated AI clusters #

pay per hour.

Cohere models #

Embedding #

ref

OCR of Images #

2024-02-07_14-13-36_screenshot.png #

Model Name Dimensions MTEB* BEIR** Performance Performance (higher is better) (higher is better) New Cohere Models embed-english-v3.0 1024 64.5 55.9 embed-english-light-3.0 384 62.0 52.0 embed-multilingual-v3.0 1024 64.0 54.6 embed-multilingual-light-V3.0 384 60.1 50.9 Previous Cohere Models embed-multilingua-wv2.0 768 58.5 47.1

OCR of Images #

2024-02-07_14-13-36_screenshot.png #

Model Name Dimensions MTEB* BEIR** Performance Performance (higher is better) (higher is better) New Cohere Models embed-english-v3.0 1024 64.5 55.9 embed-english-light-3.0 384 62.0 52.0 embed-multilingual-v3.0 1024 64.0 54.6 embed-multilingual-light-V3.0 384 60.1 50.9 Previous Cohere Models embed-multilingua-wv2.0 768 58.5 47.1