Duckduckgo search not working

Part 1 2022
21

For anyone running into this, until the fix in the linked github issue is resolved:
The docs indicate that beginning May 12 2023 older duckduckgo versions will not work. I thought the update (-U) flag in !pip install -Uqq duckduckgo_search would pull the latest version but either it didn’t for some reason or a regression was introduced in a later version.
At any rate, explicitly asking for a version worked for me:

!pip install -Uqq duckduckgo_search==2.9.4

2 Likes
22

Looks like the fix has been committed. Release v3.0.1 · deedy5/duckduckgo_search · GitHub

2 Likes
23

I got {“code”:“DeploymentFailed”,“target”:“/subscriptions/03eef13f-3f60-4106-9c3c-ec622619d84c/resourceGroups/searchforfastaicourse/providers/Microsoft.Resources/deployments/Microsoft.BingSearch-20230518084223”,“message”:“At least one resource deployment operation failed. Please list deployment operations for details. Please see Deployment history - Azure Resource Manager | Microsoft Learn for usage details.”,“details”:[{“code”:“InsufficientQuota”,“message”:“Insufficient Quota”}]}
eve though I chose free tier

24

Yes! It has been fixed and everything works fine for me and hopefully for all you too. Thanks to all who participated and replied. Let’s go!!

25

I seem to get this error when doing !pip install -Uqq duckduckgo_search==2.9.4

Screenshot 2023-05-23 at 1.16.45 pm
Screenshot 2023-05-23 at 1.16.45 pm1898×924 112 KB

Is there something I’m doing wrong?

26

what changes did you make to the code?

27

maybe remove one of the =
=2.9.4 instead of ==2.9.4 or even don’t specify version at all

28

Thanks a lot Iain - this is the only working solutions for me for now.

I just needed to change slightly the definition of the function:

def search_images(term, max_images=30):
    print(f"Searching for ‘{term}’")
     return search_images_ddg(term, max_images)

The function search_images_ddg expects max_n instead of max_images:
    def search_images_ddg(key,max_n=200)

1 Like
29

Hey, I’ve just tried doing the same thing and I get the following error:

TypeError: search_images_ddg() got an unexpected keyword argument ‘max_n’

Although I see that in the definition of search_images_ddg I see it expects max_n. Very weird. Any ideas how to fix this?

30

OK it now seems to work with max_images instead of max_n for some reason, for anyone having the same issue.

31

@jsk123 , @rosh-eth and others who are running into this issue, I struggled with it as well and finally found that importing fastbook and using ‘search_images_ddg’ is what got everything to work in the end.

I’ve documented what I did in a kaggle notebook in the hope that it can help others get through this. I found this issue quite frustrating until I finally got it to work.

1 Like
32

Thanks for your time putting this up. This is exactly what worked for me, and the only method that worked for me essentially. Cheers!

33

Thanks, this was the only solution that worked for me (or at least first one – I’ll stop digging now :laughing:)

What did not work:

  • Upgrading duckduckgo_search to >= 2.9.4, even 3.3.0 failed with HTTP 403 forbidden, although the same URL worked when used within the browser. Might be the User-Agent header that is used in fastai’s util function.
  • Fixing the deprecation warning and using DDGS(), same error in request library call.
  • Restarting the kernel because some caching apparently prevented the usage of the updated/changed library, so using a working library version might still fail (but no version of plain duckduckgo_search fixed my problem).

So thanks again, @maitland :slight_smile:

PS: I did not have to fiddle with the parameter names, max_images worked just fine.

PPS: This is equivalent to what @cmondorf did in his kaggle notebook linked above.

34

This post was flagged by the community and is temporarily hidden.