Howto: installation on Windows

Part 1 (2018)
103

I think the idea of rebooting the remote machine is simply an act to restart the instance. If you’re running it on Windows I don’t imagine that you literally need to restart the PC. A mere restart of the conda instance will work I assume.

104

Hi,

I’m trying to get the NLP notebook in lesson 4 (dl1/lesson4-imdb.ipynb) to work but got

Can’t find model ‘en’.

I found the post about installing spacy and then downloading en (results below).

However, it results in the error

Creating a shortcut link for ‘en’ didn’t work

Can someone let me know if there’s a simple fix for this in Windows?

(fastai) C:\Local\fastai\fastai>python -m spacy download en
Collecting https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-2.0.0/en_core_web_sm-2.0.0.tar.gz
Downloading https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-2.0.0/en_core_web_sm-2.0.0.tar.gz (37.4MB)
100% |████████████████████████████████| 37.4MB 51.1MB/s
Requirement already satisfied: spacy>=2.0.0a18 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from en-core-web-sm==2.0.0)
Requirement already satisfied: numpy>=1.7 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: murmurhash<0.29,>=0.28 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: cymem<1.32,>=1.30 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: preshed<2.0.0,>=1.0.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: thinc<6.11.0,>=6.10.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: plac<1.0.0,>=0.9.6 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: six in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: pathlib in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: ujson>=1.35 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: dill<0.3,>=0.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: regex==2017.4.5 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: ftfy<5.0.0,>=4.4.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: msgpack-python in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: msgpack-numpy==0.4.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: wrapt in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: tqdm<5.0.0,>=4.10.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: cytoolz<0.9,>=0.8 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: termcolor in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: pyreadline>=1.7.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from dill<0.3,>=0.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: idna<2.7,>=2.5 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: html5lib in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: wcwidth in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: toolz>=0.8.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from cytoolz<0.9,>=0.8->thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: webencodings in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Installing collected packages: en-core-web-sm
Running setup.py install for en-core-web-sm … done
Successfully installed en-core-web-sm-2.0.0

Error: Couldn't link model to 'en'
Creating a symlink in spacy/data failed. Make sure you have the required
permissions and try re-running the command as admin, or use a
virtualenv. You can still import the model as a module and call its
load() method, or create the symlink manually.

C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\en_core_web_sm
-->
C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\spacy\data\en


Download successful
Creating a shortcut link for 'en' didn't work (maybe you don't have
admin permissions?), but you can still load the model via its full
package name:

nlp = spacy.load('en_core_web_sm')
105

when you ran this, were you running as an administrator?

1 Like
106

Thanks, Brad. That was the problem.

107

I get this error when I execute below lines in notebook (Windows)

from fastai.transforms import *
from fastai.conv_learner import *
from fastai.model import *
from fastai.dataset import *
from fastai.sgdr import *
from fastai.plots import *

`C:\Program Files\Anaconda3\envs\fastai\lib\site-packages\torch_init_.py in ()
74 pass
75
—> 76 from torch._C import *
77
78 all += [name for name in dir(_C)

ImportError: DLL load failed: The specified module could not be found.`

C:\Users\wecando>conda info
active environment : None
user config file : C:\Users\wecando.condarc
populated config files : C:\Users\wecando.condarc
conda version : 4.4.10
conda-build version : not installed
python version : 3.6.0.final.0
base environment : C:\Program Files\Anaconda3 (read only)
channel URLs : https://conda.anaconda.org/anaconda-fusion/win-64
https://conda.anaconda.org/anaconda-fusion/noarch
https://repo.continuum.io/pkgs/main/win-64
https://repo.continuum.io/pkgs/main/noarch
https://repo.continuum.io/pkgs/free/win-64
https://repo.continuum.io/pkgs/free/noarch
https://repo.continuum.io/pkgs/r/win-64
https://repo.continuum.io/pkgs/r/noarch
https://repo.continuum.io/pkgs/pro/win-64
https://repo.continuum.io/pkgs/pro/noarch
https://repo.continuum.io/pkgs/msys2/win-64
https://repo.continuum.io/pkgs/msys2/noarch
package cache : C:\Program Files\Anaconda3\pkgs
C:\Users\wecando\AppData\Local\conda\conda\pkgs
envs directories : C:\Users\wecando\AppData\Local\conda\conda\envs
C:\Program Files\Anaconda3\envs
C:\Users\wecando.conda\envs
platform : win-64
user-agent : conda/4.4.10 requests/2.12.4 CPython/3.6.0 Windows/10 Windows/10.0.16299

What I am missing?

1 Like
108

When doing step 4 conda env update, I get the error

Using Anaconda API: https://api.anaconda.org
Fetching package metadata ...............
Solving package specifications: .
NoPackagesFoundError: Packages missing in current win-64 channels:
  - spacy
  - expat
  - libxml2
  - pexpect
  - xz

Running

  • Windows 10 (64 bit)
  • Python 3.6.2 :: Continuum Analytics, Inc.
  • conda 4.2.9
  • Nvidia 1080

What went wrong?

109

Thanks @Brad_S. I re-did everything but skipped the following two lines. Then, it works.

del fastai
mklink /d fastai ..\..\fastai
110

Under the following directory, C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\ to create symbolic link as below:

mklink /d en_core_web_sm C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\spacy\data\en

1 Like
111

Side note: It is recommended to add the Jupyter Notebook Extensions, especially Gist-it and Collapsible Headings. Finally, I can replicate the whole environment in Windows. :smile:

2 Likes
112

After installing with conda on my notebotebook, I had the same problem.

torch.cuda.is_available() and torch._C._cuda_isDriverSufficient() both return False.

After spending a lot of time diagnosing, I believe it could be related to the Nvidia driver

cuda9 was released not long ago, and it requires a quite newer version of Nvidia driver. Upgrading the driver works for me.

113

HI Team,

I have download all the required components in my Ubuntu Server 16.04 (CPU). I am able to start the jupyter notebook, i have resolved all the NoModule errors which i encountered till now, but this error “sklearn_pandas” refuses to go away.

Any help regarding this?

> ---------------------------------------------------------------------------
> ModuleNotFoundError                       Traceback (most recent call last)
> <ipython-input-2-c51a52575a56> in <module>()
>       1 # This file contains all the main external libs we'll use
> ----> 2 from fastai.imports import *
> 
> ~/fastai/courses/dl1/fastai/imports.py in <module>()
>       3 import random, pandas as pd, pickle, sys, itertools, string, sys, re, datetime, time, shutil
>       4 import seaborn as sns, matplotlib
> ----> 5 import IPython, graphviz, sklearn_pandas, sklearn, warnings
>       6 from abc import abstractmethod
>       7 from glob import glob, iglob
> 
> ModuleNotFoundError: No module named 'sklearn_pandas'

Thanks,
George.

114 
pip install sklearn-pandas
115

I tried it long ago but after restarting the jupyter notebook, it did not work.

image
image.png1144×196 32.3 KB

116

Are you using an environment or something?

117

what do you mean by using an environment? I am very new to this python, so please bear with me if i am asking some basic questions.

118

Actually the fast.ai package uses the python 3.6

Head over to the configuration forum thread or its available in GitHub or reashma’s blog…

119

I have installed the latest anaconda which has the latest version of python i.e 3.6 and have also updated anaconda.
I have downloaded the components using the URL as specified in the video.

120

So now everything should work then…

121

No Aditya, It is not working. Is there a requirement to restart server?

122

I don’t have acquaintence with Ubuntu servers but the process should remain the same as it is for a Ubuntu…
Now since you have installed Anaconda, jupyter notebook and other relevant dependences, and also had set up the system path variables etc
Then what’s the bash giving
For
which python?

It should probably now use the Anaconda’s shipped python