Connect Azure OpenAI Service to your custom SQL Server data

In this tutorial, we will lear how to connect your custom SQL Server data to Azure OpenAI. You need to have an active Azure subscription in order to proceed with this tutorial.

Create Azure Cognitive Search

Point your browser to https://portal.azure.com/. Enter 'search' in the search field at the top of the page, then click on "Cognitive Search" from the short list of services.

 

On the resulting "Azure AI services | Cognitive search" page, click on the Create button.

On the "Create a search service" page:

• choose a suitable subscription if you have more than one
• create a new resource group named openai-and-sql-server
• let the "Service name" be openai-and-sql-server-service-name
• let the location be a data center closer to where you are. In my case I chose "East US".
• leave the "Pricing tier" as Standard

Click on the blue "Review + create" button, then click on blue "Create" button. Once deployment is complete, click on the blue "Go to resource" button. This takes you to the page of the search resource that you just created.

Click on the blue Import button under "Connect your data".

On the import data page, let "Data Source" be Samples. Then click on realestate-us-sample.

Click on the blue "Next: Add cognitive skills (Optional)" button at the bottom of the page.

On the "Import data" page, click on the blue "Skip to: Customize target index" at the bottom of the page.

You will be taken to the "Customize target index" tab. Click on the blue "Next: Create an indexer" button at the bottom of the page.

In the "Create an indexer" tab, click on the blue Submit button.

In your main service page, click on indexers on the left side. Wait until the indexer you just created shows that it is successfully provisioned.

Click on Overview on the left-side menu, then click on the "Search explorer" link.

On the "Search explorer" page, we can query the database. The Index field is defaulted to the index that was just created. In the "Query string" field, enter search=condo, then click on the blue Search button.  You will see results for condos.

Azure OpenAI Service

We are now ready to connect this cognitive search service with OpenAI. Click on the Home link in the top left corner of the page.

In the filter field at the top, enter the word openai, then select Azure OpenAI.

Click on the "+ Create" link. 

Fill out the form parameters. I entered the data shown below.

Click on the blue Next button at the bottom of the page. Accept default values on the Network tab then click on blue Next button.

Also, accept default values on the Tags tab then click on blue Next button.

Click on the blue Create button when it appears at the bottom of tthe page.

Deployment takes some time. When it is complete, cclik on the blue "Go to resource" button.

Click on the Explore button.

Click on "Bring your own data".

We will need to create a deployment. Click on "Create new deployment".

Expand "Advanced options. Choose the gpt-35-turbo model, give the deployment a name (gpt-35-turbo-deploy), leave Default for "Content Filter". Click on the Create button.

On the "Data source" tab, choose as follows:

Select data source: Azure Cognitive Search
Subscription: {your azure subscription}

Azure Cognitive Search service: {the cognitive service you created earlier}

Azure Cognitive Search Index: {the cognitive search index that was created earlier.

Enable "I acknowledge that connecting to an Azure Cognitive Search account will incue usage too my account", then click on Next.

Choose all the fields for "Content data". 

Choose description for "Field name" and Title fields then click on Next.

Chooose Keyword for "Search type", then click oon Next.

Finally, click on the "Save and close" button on the "Review and finish" tab.

On the "Chat playground" page, the data source is automatically connected to the chat session.

Enter the following in the chat field: property in renton. Then, hit ENTER on your keyboard.

A response similar to the following will appear:

Conclusion

We were able to link Azure OpenAI with custom data and generate output through ChatGPT chat. The data source, of course, can be any enterprise relational data.