Lesson 1 official topic

Arthur · January 3, 2024, 8:06pm

I also had an issue with urlopen not working with DDGS, but I got past it, feel free to have a look here:

adobelis/fastai_pdlc_notes/blob/main/FastAI-PDLC-01.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "5314b6ac-e5d8-4763-be27-25a2b5fc5b6f",
   "metadata": {},
   "outputs": [],
   "source": [
    "from duckduckgo_search import DDGS\n",
    "\n",
    "birds = []\n",
    "with DDGS() as ddgs:\n",
    "    keywords = 'bird photos'\n",
    "    ddgs_images_gen = ddgs.images(\n",
    "      keywords,\n",
    "      region=\"wt-wt\",\n",
    "      safesearch=\"off\",\n",
    "      size=None,\n",
    "      type_image=None,\n",

This file has been truncated. show original

Basically, I rewrote download_images to use the Python Requests library, an update to urllib.

However, further down, I had to address the urllib issue directly. I had to create an unverified SSL context:

import ssl
ssl._create_default_https_context = ssl._create_unverified_context

Note: this may entail some security issues, but I’m not sure what exactly. I know I can make HTTPS calls with the Python Requests library just fine, not sure why urllib verification was not working. But the code that calls urllib is too deep in the fastai code to work around, and all it is doing is grabbing the resnet18 weights from PyTorch Hub, so if you trust your local network and domain server I think it’s ok.