diff --git a/articles/ai-studio/toc.yml b/articles/ai-studio/toc.yml index 9c0c66439e..f3f1eb6faf 100644 --- a/articles/ai-studio/toc.yml +++ b/articles/ai-studio/toc.yml @@ -8,7 +8,7 @@ items: href: what-is-ai-studio.md - name: Azure AI Studio architecture href: concepts/architecture.md - - name: "AI Studio or AML: Which should I choose?" + - name: AI Studio versus AML studio href: /ai/ai-studio-experiences-overview?context=/azure/ai-studio/context/context - name: Region support href: reference/region-support.md @@ -65,16 +65,50 @@ items: - name: Create a project href: how-to/create-projects.md - name: Create and manage compute - href: how-to/create-manage-compute.md - - name: Connect to external resources + href: how-to/create-manage-compute.md + - name: Connect to services and resources + items: + - name: Connections overview + href: concepts/connections.md + - name: Create a connection + href: how-to/connections-add.md + - name: Create a connection using the Azure Machine Learning SDK + href: how-to/develop/connections-add-sdk.md + displayName: code + - name: Azure AI services connections items: - - name: Connections overview - href: concepts/connections.md - - name: Create a connection - href: how-to/connections-add.md - - name: Create a connection using the Azure Machine Learning SDK - href: how-to/develop/connections-add-sdk.md - displayName: code + - name: What are AI services? + href: ../ai-services/what-are-ai-services.md?context=/azure/ai-studio/context/context + displayName: cognitive + - name: Get started with AI services in AI Studio + href: ai-services/get-started.md + - name: Connect AI services in AI Studio + href: ai-services/connect-ai-services.md + - name: Azure OpenAI + items: + - name: Get started with Assistants and code interpreter in the playground + href: ../ai-services/openai/assistants-quickstart.md?context=/azure/ai-studio/context/context + - name: Analyze images and video with GPT-4 for Vision in the playground + href: quickstarts/multimodal-vision.md + - name: Use your image data with Azure OpenAI + href: how-to/data-image-add.md + displayName: vision, gpt, turbo + - name: Azure AI Content Safety + items: + - name: Content filtering + href: concepts/content-filtering.md + - name: Prevent input attacks with Prompt Shields + href: how-to/prompt-shields.md + - name: Detect groundedness in chat responses + href: how-to/groundedness.md + - name: Speech + items: + - name: Real-time speech to text + href: ../ai-services/speech-service/get-started-speech-to-text.md?context=/azure/ai-studio/context/context + - name: Pronunciation assessment + href: ../ai-services/speech-service/pronunciation-assessment-tool.md?context=/azure/ai-studio/context/context + - name: Hear and speak with chat in the playground + href: quickstarts/hear-speak-playground.md - name: Select and deploy AI models items: - name: Model catalog @@ -261,40 +295,6 @@ items: href: how-to/monitor-quality-safety.md - name: Troubleshoot deployments and monitoring href: how-to/troubleshoot-deploy-and-monitor.md - - name: Get started with Azure AI services - items: - - name: What are AI services? - href: ../ai-services/what-are-ai-services.md?context=/azure/ai-studio/context/context - displayName: cognitive - - name: Get started with AI services in AI Studio - href: ai-services/get-started.md - - name: Connect AI services in AI Studio - href: ai-services/connect-ai-services.md - - name: Azure OpenAI - items: - - name: Get started with Assistants and code interpreter in the playground - href: ../ai-services/openai/assistants-quickstart.md?context=/azure/ai-studio/context/context - - name: Analyze images and video with GPT-4 for Vision in the playground - href: quickstarts/multimodal-vision.md - - name: Use your image data with Azure OpenAI - href: how-to/data-image-add.md - displayName: vision, gpt, turbo - - name: Azure AI Content Safety - items: - - name: Content filtering - href: concepts/content-filtering.md - - name: Prevent input attacks with Prompt Shields - href: how-to/prompt-shields.md - - name: Detect groundedness in chat responses - href: how-to/groundedness.md - - name: Speech - items: - - name: Real-time speech to text - href: ../ai-services/speech-service/get-started-speech-to-text.md?context=/azure/ai-studio/context/context - - name: Pronunciation assessment - href: ../ai-services/speech-service/pronunciation-assessment-tool.md?context=/azure/ai-studio/context/context - - name: Hear and speak with chat in the playground - href: quickstarts/hear-speak-playground.md - name: Costs and quotas items: - name: Plan and manage costs diff --git a/articles/search/media/vector-search-index-size/deployment-details.png b/articles/search/media/vector-search-index-size/deployment-details.png index dabdf1bab2..96f0074b81 100644 Binary files a/articles/search/media/vector-search-index-size/deployment-details.png and b/articles/search/media/vector-search-index-size/deployment-details.png differ diff --git a/articles/search/media/vector-search-index-size/resource-group-deployments.png b/articles/search/media/vector-search-index-size/resource-group-deployments.png index 6f0925fdb3..578629545f 100644 Binary files a/articles/search/media/vector-search-index-size/resource-group-deployments.png and b/articles/search/media/vector-search-index-size/resource-group-deployments.png differ diff --git a/articles/search/search-create-service-portal.md b/articles/search/search-create-service-portal.md index 2d57b9d398..dba422ede9 100644 --- a/articles/search/search-create-service-portal.md +++ b/articles/search/search-create-service-portal.md @@ -11,7 +11,7 @@ ms.custom: - references_regions - build-2024 ms.topic: conceptual -ms.date: 08/22/2024 +ms.date: 09/19/2024 --- # Create an Azure AI Search service in the portal @@ -87,13 +87,13 @@ Service name requirements: ## Choose a region > [!IMPORTANT] -> Due to high demand, Azure AI Search is currently unavailable for new instances in West Europe. If you don't immediately need semantic ranker or skillsets, choose Sweden Central because it has the most data center capacity. Otherwise, North Europe is another option. Currently, there are also capacity constraints for Basic and Standard (S1) tiers within a given region. +> Due to high demand, Azure AI Search is currently unavailable for new instances in some regions. If you use multiple Azure services, putting all of them in the same region minimizes or voids bandwidth charges. There are no charges for data egress among same-region services. Generally, choose a region near you, unless the following considerations apply: -+ Your nearest region is capacity constrained. West Europe is at capacity and unavailable for new instances. Other regions are [at capacity for specific tiers](search-sku-tier.md#region-availability-by-tier). One advantage to using the Azure portal for resource setup is that it provides only those regions and tiers that are available. You can't select regions or tiers that are unavailable. ++ Your nearest region is capacity constrained. For example, West Europe is at capacity and unavailable for new instances. Other regions are [at capacity for specific tiers](search-sku-tier.md#region-availability-by-tier). One advantage to using the Azure portal for resource setup is that it provides only those regions and tiers that are available. + You want to use integrated data chunking and vectorization or built-in skills for AI enrichment. Azure OpenAI and Azure AI services multiservice accounts must be in the same region as Azure AI Search for integration purposes. [Choose a region](search-region-support.md) that provides all necessary resources. @@ -101,11 +101,11 @@ Generally, choose a region near you, unless the following considerations apply: Here's a checklist for choosing a region: -1. Is Azure AI Search available in a nearby region? Check the [supported regions list](search-region-support.md). Capacity-constrained regions are indicated in the footnotes. +1. Is Azure AI Search available in a nearby region? Check the [supported regions list](search-region-support.md). 1. Do you know which tier you want to use? Tiers are covered in the next step. Check [region availability by tier](search-sku-tier.md#region-availability-by-tier) to determine if you can create a search service at the desired tier in your region of choice. -1. Do you need [AI enrichment](cognitive-search-concept-intro.md) or [integrated data chunking and vectorization](vector-search-integrated-vectorization.md)? Verify that Azure OpenAI and Azure AI services are [offered in the same region](search-region-support.md) as Azure AI Search. +1. Do you need [AI enrichment](cognitive-search-concept-intro.md) or [integrated data chunking and vectorization](vector-search-integrated-vectorization.md)? Verify that Azure OpenAI and Azure AI multiservice are [offered in the same region](search-region-support.md) as Azure AI Search. Be aware that Azure AI Vision multimodal embeddings API, used for [integrated image vectorization](search-get-started-portal-image-search.md), must be accessed through an Azure AI multiservice account, but is available in a [smaller subset of regions](/azure/ai-services/computer-vision/overview-image-analysis#region-availability). diff --git a/articles/search/search-limits-quotas-capacity.md b/articles/search/search-limits-quotas-capacity.md index e3359abf92..b788e14732 100644 --- a/articles/search/search-limits-quotas-capacity.md +++ b/articles/search/search-limits-quotas-capacity.md @@ -8,7 +8,7 @@ author: HeidiSteen ms.author: heidist ms.service: cognitive-search ms.topic: conceptual -ms.date: 09/04/2024 +ms.date: 09/19/2024 ms.custom: - references_regions - build-2024 @@ -80,15 +80,7 @@ When estimating document size, remember to consider only those fields that add v When you index documents with vector fields, Azure AI Search constructs internal vector indexes using the algorithm parameters you provide. The size of these vector indexes is restricted by the memory reserved for vector search for your service's tier (or `SKU`). -The service enforces a vector index size quota **for every partition** in your search service. Each extra partition increases the available vector index size quota. This quota is a hard limit to ensure your service remains healthy, which means that further indexing attempts once the limit is exceeded results in failure. You can resume indexing once you free up available quota by either deleting some vector documents or by scaling up in partitions. - -Vector limits vary by service creation date and tier. - -+ To check the age of your search service or learn more about vector indexes, see [Vector index size and staying under limits](vector-search-index-size.md). - -+ To view the vector quota in effect for your search service, use [GET Service Statistics](/rest/api/searchservice/get-service-statistics/get-service-statistics), or check the **Properties** and **Usage** tabs for your search service in the Azure portal. - -#### Vector quota per partition (GB) +Vector limits vary by [service creation date](vector-search-index-size.md#how-to-check-service-creation-date) and [tier](search-sku-tier.md). For guidance on managing and maximizing vector storage, see [Vector index size and staying under limits](vector-search-index-size.md). This table shows the progression of vector quota increases in GB over time. The quota is per partition, so if you scale a new Standard (S1) service to 6 partitions, total vector quota is 35 multiplied by 6. @@ -96,37 +88,21 @@ This table shows the progression of vector quota increases in GB over time. The |-----------------------|------|---|----|----|----|----| |**Before July 1, 2023** 1 | 0.5 | 1 | 6 | 12 | 12 | 36 | | **July 1, 2023 through April 3, 2024** 2| 1 | 3 | 12 | 36 | 12 | 36 | -|**April 3, 2024 through May 17, 2024** 3 | 5 | 35 | 100 | 200 | 12 | 36 | -|**After May 17, 2024** 4 | 5 | 35 | 150 | 300 | 150 | 300 | +|**April 3, 2024 through May 17, 2024** 3 | **5** | **35** | **150** | **300** | 12 | 36 | +|**After May 17, 2024** 4 | 5 | 35 | 150 | 300 | **150** | **300** | 1 Initial vector limits during early preview. 2 Vector limits during the later preview period. Three regions didn't have the higher limits: Germany West Central, West India, Qatar Central. -3 Higher vector quota based on the larger partitions for supported tiers and regions. +3 Higher vector quota based on the larger partitions for supported tiers and regions. 4 Higher vector quota for more tiers and regions based on partition size updates. -#### Partition limits (GB) - -This table repeats [partition storage limits](#service-limits) for context. The table shows the progression of storage quota increases in GB over time. Vector quota is per partition, so the more significant increases in vector quota that occurred starting in April 2024 correspond to the increases in per-partition storage occuring at the same time. - -Higher capacity partitions were brought online starting in April 2024. - -| Service creation date |Basic | S1| S2 | S3/HD | L1 | L2 | -|-----------------------|------|---|----|----|----|----| -|**Before July 1, 2023** 1 | 2 | 25 | 100 | 200 | 1,024 | 2,048 | -|**July 1, 2023 through April 3, 2024** 2| 2 | 25 | 100 | 200 | 1,024 | 2,048 | -|**April 3, 2024 through May 17, 2024** 3 | 15 | 160 | 512 | 1,024 | 1,024 | 2,048 | -|**After May 17, 2024** 4 | 15 | 160 | 512 | 1,024 | 2,048 | 4,096 | - -1 Partition sizes during early preview. - -2 No change during the later preview period. - -3 Higher capacity storage for Basic, S1, S2, S3 in these regions. **Americas**: Brazil South​, Canada Central​, Canada East​​, East US​, East US 2, ​Central US​, North Central US​, South Central US​, West US​, West US 2​, West US 3​, West Central US. **Europe**: France Central​. Italy North​​, North Europe​​, Norway East, Poland Central​​, Switzerland North​, Sweden Central​, UK South​, UK West​. **Middle East**: UAE North. **Africa**: South Africa North. **Asia Pacific**: Australia East​, Australia Southeast​​, Central India, Jio India West​, East Asia, Southeast Asia​, Japan East, Japan West​, Korea Central, Korea South​. +The service enforces a vector index size quota **for every partition** in your search service. Each extra partition increases the available vector index size quota. This quota is a hard limit to ensure your service remains healthy, which means that further indexing attempts once the limit is exceeded results in failure. You can resume indexing once you free up available quota by either deleting some vector documents or by scaling up in partitions. -4 Higher capacity storage for more tiers and more regions. **Europe**: Germany North​, Germany West Central, Switzerland West​. **Azure Government**: Texas, Arizona, Virginia. **Africa**: South Africa North​. **Asia Pacific**: China North 3, China East 3. +> [!IMPORTANT] +> Higher vector limits are tied to larger partition sizes. Regions that run on older infrastructure are subject to the July-April limits. Review the [regions list](search-region-support.md) for status on partition storage limits. ## Indexer limits diff --git a/articles/search/search-region-support.md b/articles/search/search-region-support.md index 2a7638b692..8b9d237930 100644 --- a/articles/search/search-region-support.md +++ b/articles/search/search-region-support.md @@ -1,5 +1,5 @@ --- -title: Feature availability across clouds regions +title: Supported regions titleSuffix: Azure AI Search description: Shows supported regions and feature availability across regions for Azure AI Search. @@ -9,13 +9,13 @@ ms.author: heidist ms.service: cognitive-search ms.topic: conceptual ms.custom: references_regions -ms.date: 09/03/2024 +ms.date: 09/19/2024 --- -# Azure AI Search feature availability across cloud regions +# Azure AI Search regions list -This article identifies the cloud regions in which Azure AI Search is available. It also lists which premium features are available in each region. +This article identifies the cloud regions in which Azure AI Search is available. It also lists which premium features are available in each region. ## Features subject to regional availability @@ -57,24 +57,26 @@ You can create an Azure AI Search resource in any of the following Azure public | Canada East​​ ​ | | ✅ | | | East US​ | ✅ | ✅ | ✅ | | East US 2 ​ | ✅ | ✅ | ✅ | -| ​Central US​ 1​ | ✅ | ✅ | ✅ | +| ​Central US​​ 1 | ✅ | ✅ | ✅ | | North Central US​ ​ | ✅ | ✅ | | -| South Central US​ 1​ | ✅ | ✅ | ✅ | +| South Central US​ 2​ | ✅ | ✅ | ✅ | | West US​ ​ | ✅ | ✅ | | -| West US 2​ 1​ | ✅ | ✅ | ✅ | -| West US 3​ 1​ | ✅ | ✅ |✅ | +| West US 2​ ​ | ✅ | ✅ | ✅ | +| West US 3​ 2​ | ✅ | ✅ |✅ | | West Central US​ ​ | ✅ | ✅ | | -1 Currently, this region is at capacity for Basic and Standard (S1) tiers. Choose a higher tier or a different region. +1 This region has capacity, but some tiers are [not available](search-sku-tier.md#region-availability-by-tier). + +2 Currently, this region is at full capacity and not accepting new search services. ### Europe | Region | AI integration | Semantic ranking | Availability zones | |--|--|--|--| -| North Europe​​ 1| ✅ | ✅ | ✅ | -| West Europe​​ 2| ✅ | ✅ | ✅ | +| North Europe​​ | ✅ | ✅ | ✅ | +| West Europe​​ 1, 2| ✅ | ✅ | ✅ | | France Central​​ | ✅ | ✅ | ✅ | -| Germany West Central​ ​| ✅ | | ✅ | +| Germany West Central​ 2 ​| ✅ | | ✅ | | Italy North​​ | | | ✅ | | Norway East​​ | ✅ | | ✅ | | Poland Central​​ | | | | @@ -85,9 +87,9 @@ You can create an Azure AI Search resource in any of the following Azure public | UK South​ | ✅ | ✅ | ✅ | | UK West​ ​| | ✅ | | -1 Currently, this region is at capacity for Basic and Standard (S1) tiers. Choose a higher tier or a different region. +1 Currently, this region is at full capacity and not accepting new search services. -2 West Europe is at capacity for all tiers and isn't accepting any new search services. Additionally, the clusters used to run Azure AI Search don't have the [higher capacity partitions](search-limits-quotas-capacity.md#service-limits) that were brought online in April 2024. This means that search services deployed in this region have lower storage and computing capability. +2 This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits). ### Middle East @@ -97,15 +99,17 @@ You can create an Azure AI Search resource in any of the following Azure public | Qatar Central​ 1, 2 | | | ✅ | | UAE North​​ | ✅ | | ✅ | -1 Currently, this region is at capacity for Basic and Standard (S1) tiers. Choose a higher tier or a different region. +1 Currently, this region is at full capacity and not accepting new search services. -2 These regions run on older infrastructure that has lower capacity per partition at every tier. Choose a different region if you want [higher capacity](search-limits-quotas-capacity.md#service-limits). +2 This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits). ### Africa | Region | AI integration | Semantic ranking | Availability zones | |--|--|--|--| -| South Africa North​ | ✅ | | ✅ | +| South Africa North​ 1 | ✅ | | ✅ | + +1 This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits). ### Asia Pacific @@ -123,51 +127,37 @@ You can create an Azure AI Search resource in any of the following Azure public | Korea Central | ✅ | ✅ | ✅ | | Korea South​ ​ | | ✅ | | -1 Currently, this region is at capacity for Basic and Standard (S1) tiers. Choose a higher tier or a different region. +1 This region has capacity, but some tiers are [not available](search-sku-tier.md#region-availability-by-tier). -2 These regions run on older infrastructure that has lower capacity per partition at every tier. Choose a different region if you want [higher capacity](search-limits-quotas-capacity.md#service-limits). +2 This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits). ## Azure Government regions -All of these regions support [higher capacity tiers](search-limits-quotas-capacity.md#service-limits). - -None of these regions support Azure [role-based access for data plane operations](search-security-rbac.md). You must use key-based authentication for indexing and query workloads. - | Region | AI integration | Semantic ranking | Availability zones | |--|--|--|--| | Arizona | ✅ | ✅ | | | Texas | | | | -| Virginia | ✅ | ✅ | ✅ | +| Virginia 1 | ✅ | ✅ | ✅ | -## Azure operated by 21Vianet +1 Currently, this region is at full capacity and not accepting new search services. -You can install Azure AI Search in any of the following regions. If you need semantic ranking or AI enrichment, choose a region that provides the feature. +## Azure operated by 21Vianet | Region | AI integration | Semantic ranking | Availability zones | |--|--|--|--| -| China East 1 | | | | +| China East | | | | | China East 2 1 | ✅ | | | | China East 3 | | | | -| China North 1 | | | | +| China North | | | | | China North 2 1 | | | | | China North 3 | | ✅ | ✅ | -1 These regions run on older infrastructure that has lower capacity per partition at every tier. Choose a different region if you want [higher capacity](search-limits-quotas-capacity.md#service-limits). - - +1 This region runs on older infrastructure that has lower storage limits per partition at every tier. Choose a different region if you want [higher limits](search-limits-quotas-capacity.md#service-limits). ## See also - [Azure AI Studio region availability](/azure/ai-studio/reference/region-support) - [Azure OpenAI model region availability](/azure/ai-services/openai/concepts/models#model-summary-table-and-region-availability) +- [Azure AI Vision region list](/azure/ai-services/computer-vision/overview-image-analysis#region-availability) - [Availability zone region availability](/azure/reliability/availability-zones-service-support#azure-regions-with-availability-zone-support) - [Azure product by region page](https://azure.microsoft.com/explore/global-infrastructure/products-by-region/?products=search) \ No newline at end of file diff --git a/articles/search/search-sku-tier.md b/articles/search/search-sku-tier.md index 8a83d298b8..2218327b1e 100644 --- a/articles/search/search-sku-tier.md +++ b/articles/search/search-sku-tier.md @@ -8,7 +8,7 @@ author: HeidiSteen ms.author: heidist ms.service: cognitive-search ms.topic: conceptual -ms.date: 08/22/2024 +ms.date: 09/19/2024 --- @@ -53,7 +53,9 @@ You can find out more about the various tiers on the [pricing page](https://azur ## Region availability by tier -Currently, several regions are at capacity for Basic and Standard (S1) tiers and can't be used for new search services. If you use the Azure portal to create a search service, the portal excludes any region-tier combinations that aren't available. +The supported [regions list](search-region-support.md) provides the locations where Azure AI Search is offered. + +Currently, several regions are at capacity for specific tiers and can't be used for new search services. If you use the Azure portal to create a search service, the portal excludes any region-tier combinations that aren't available. | Region | Disabled tier (SKU) due to over-capacity | |--------|------------------------------------------| @@ -93,7 +95,7 @@ Tiers determine the maximum storage of the service itself, plus the maximum num Tier pricing includes details about per-partition storage that ranges from 15 GB for Basic, up to 2 TB for Storage Optimized (L2) tiers. Other hardware characteristics, such as speed of operations, latency, and transfer rates, aren't published, but tiers that are designed for specific solution architectures are built on hardware that has the features to support those scenarios. For more information about partitions, see [Estimate and manage capacity](search-capacity-planning.md) and [Reliability in Azure AI Search](search-reliability.md). > [!NOTE] -> Higher capacity partitions became available in selected regions starting in April 2024. A second wave of higher capacity partitions released in May 2024. If you're using an older search service, consider creating a new search service to benefit from more capacity at the same billing rate. For more information, see [Service limits](search-limits-quotas-capacity.md#service-limits) +> Higher capacity partitions became available in selected regions starting in April 2024. A second wave of higher capacity partitions released in May 2024. If you're using an older search service, consider creating a new search service to benefit from more capacity at the same billing rate. For more information, see [Service limits](search-limits-quotas-capacity.md#service-limits). To check the age of your search service, see [How to check service creation date](vector-search-index-size.md#how-to-check-service-creation-date). ## Billing rates diff --git a/articles/search/vector-search-index-size.md b/articles/search/vector-search-index-size.md index 750c6aff68..06009d5098 100644 --- a/articles/search/vector-search-index-size.md +++ b/articles/search/vector-search-index-size.md @@ -9,7 +9,7 @@ ms.service: cognitive-search ms.custom: - build-2024 ms.topic: conceptual -ms.date: 08/05/2024 +ms.date: 09/19/2024 --- # Vector index size and staying under limits