Bing search key and 'PermissionDenied' error

Decyborg · November 12, 2020, 9:16pm

Hi folks,

So it looks like things have been changed by Microsoft since this course began and some of the things on Lesson 2 no longer work/are not the same anymore. It took me a while to figure out and the information is scattered so I thought it might be useful to do a single post with the info, that might save some time to the other folks (at least until it breaks again).

First to get your key:
Make an azure account - https://azure.microsoft.com/en-us/free/cognitive-services/
You will need a phone number and a credit card

Follow these steps to create a bing resource - Create Bing Search Services Resource - Bing Search Services | Microsoft Learn

After that you should be able to see your keys here:

Now unfortunately is not over yet, seems like Microsoft is restructuring their services and the URL changed:

I’ve created an issue on the fastbook github since I have no idea on how to update and test the libraries on the jupyter notebooks:

github.com/fastai/fastbook

Bing image search API changing causes issues on search_images_bing 'PermissionDenied'

opened 08:45PM - 12 Nov 20 UTC

closed 06:42PM - 29 Nov 20 UTC

decyborg

Hi folks, I'm currently working my way through lesson 2 of the book and I'm f…acing an issue while trying to download the images. Apparently Microsoft is reestructuring their bing API and keeping it out of their cognitive services, they've also changed the URL to use for the query: https://docs.microsoft.com/en-us/azure/cognitive-services/Bing-Image-Search/overview > Bing Search APIs are moving from Cognitive Services to Bing Search Services. Starting October 30, 2020, any new instances of Bing Search need to be provisioned following the process documented here. Bing Search APIs provisioned using Cognitive Services will be supported for the next three years or until the end of your Enterprise Agreement, whichever happens first. For migration instructions, see Bing Search Services. Seems like they are changing from what the code is currently using: 51 client = api('https://api.cognitive.microsoft.com', auth(key)) To: https://api.bing.microsoft.com/v7.0/search I'm just getting started with Jupyter notebooks and I'm trying to figure out how to update the library gradient is using, to try and fix this issue, but in the meantime I thought I might report it, seems like a workaround has already been found in the forums: https://forums.fast.ai/t/02-production-permissiondenied-error/65823/28 Cheers!

But luckily someone has implemented a workaround here:

So follow the steps to do a local definition of search_images_bing and that should do it. The official microsoft docs are here as well:

github.com

Azure-Samples/cognitive-services-REST-api-samples/blob/master/python/Search/BingWebSearchv7.py

#Copyright (c) Microsoft Corporation. All rights reserved.
#Licensed under the MIT License.

# -*- coding: utf-8 -*-

import json
import os 
from pprint import pprint
import requests

# Add your Bing Search V7 subscription key and endpoint to your environment variables.
subscription_key = os.environ['BING_SEARCH_V7_SUBSCRIPTION_KEY']
endpoint = os.environ['BING_SEARCH_V7_ENDPOINT'] + "/bing/v7.0/search"

# Query term(s) to search for. 
query = "Microsoft Cognitive Services"

# Construct a request
mkt = 'en-US'
params = { 'q': query, 'mkt': mkt }

This file has been truncated. show original

Note: Another issue I had was while running
dest = ‘images/grizzly.jpg’
download_url(ims[0], dest)

→ 167 with open(dest, ‘wb’) as f:
168 nbytes = 0
169 if show_progress: pbar = progress_bar(range(file_size), leave=False, parent=pbar)

FileNotFoundError: [Errno 2] No such file or directory: ‘images/grizzly.jpg’

On the clean directory there is no images folder, so simply create one from the terminal or from python. (open terminal, cd fastbook, cd clean , mkdir images)

Hope this helps!

VickGrego · November 12, 2020, 9:45pm

Thanks for posting it!

Additionally, we might want to comment out the line

#hide
ims = ['http://3.bp.blogspot.com/-S1scRCkI3vY/UHzV2kucsPI/AAAAAAAAA-k/YQ5UzHEm9Ss/s1600/Grizzly%2BBear%2BWildlife.jpg']

As it replaces everything we downloaded before