I think the idea of rebooting the remote machine is simply an act to restart the instance. If you’re running it on Windows I don’t imagine that you literally need to restart the PC. A mere restart of the conda instance will work I assume.
Hi,
I’m trying to get the NLP notebook in lesson 4 (dl1/lesson4-imdb.ipynb) to work but got
Can’t find model ‘en’.
I found the post about installing spacy and then downloading en (results below).
However, it results in the error
Creating a shortcut link for ‘en’ didn’t work
Can someone let me know if there’s a simple fix for this in Windows?
(fastai) C:\Local\fastai\fastai>python -m spacy download en
Collecting https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-2.0.0/en_core_web_sm-2.0.0.tar.gz
Downloading https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-2.0.0/en_core_web_sm-2.0.0.tar.gz (37.4MB)
100% |████████████████████████████████| 37.4MB 51.1MB/s
Requirement already satisfied: spacy>=2.0.0a18 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from en-core-web-sm==2.0.0)
Requirement already satisfied: numpy>=1.7 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: murmurhash<0.29,>=0.28 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: cymem<1.32,>=1.30 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: preshed<2.0.0,>=1.0.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: thinc<6.11.0,>=6.10.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: plac<1.0.0,>=0.9.6 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: six in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: pathlib in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: ujson>=1.35 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: dill<0.3,>=0.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: regex==2017.4.5 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: ftfy<5.0.0,>=4.4.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: msgpack-python in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: msgpack-numpy==0.4.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: wrapt in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: tqdm<5.0.0,>=4.10.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: cytoolz<0.9,>=0.8 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: termcolor in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: pyreadline>=1.7.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from dill<0.3,>=0.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: idna<2.7,>=2.5 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: html5lib in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: wcwidth in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: toolz>=0.8.0 in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from cytoolz<0.9,>=0.8->thinc<6.11.0,>=6.10.1->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Requirement already satisfied: webencodings in c:\users\rh_la\appdata\local\conda\conda\envs\fastai\lib\site-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy>=2.0.0a18->en-core-web-sm==2.0.0)
Installing collected packages: en-core-web-sm
Running setup.py install for en-core-web-sm … done
Successfully installed en-core-web-sm-2.0.0
Error: Couldn't link model to 'en'
Creating a symlink in spacy/data failed. Make sure you have the required
permissions and try re-running the command as admin, or use a
virtualenv. You can still import the model as a module and call its
load() method, or create the symlink manually.
C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\en_core_web_sm
-->
C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\spacy\data\en
Download successful
Creating a shortcut link for 'en' didn't work (maybe you don't have
admin permissions?), but you can still load the model via its full
package name:
nlp = spacy.load('en_core_web_sm')
when you ran this, were you running as an administrator?
Thanks, Brad. That was the problem.
I get this error when I execute below lines in notebook (Windows)
from fastai.transforms import *
from fastai.conv_learner import *
from fastai.model import *
from fastai.dataset import *
from fastai.sgdr import *
from fastai.plots import *
`C:\Program Files\Anaconda3\envs\fastai\lib\site-packages\torch_init_.py in ()
74 pass
75
—> 76 from torch._C import *
77
78 all += [name for name in dir(_C)
ImportError: DLL load failed: The specified module could not be found.`
C:\Users\wecando>conda info
active environment : None
user config file : C:\Users\wecando.condarc
populated config files : C:\Users\wecando.condarc
conda version : 4.4.10
conda-build version : not installed
python version : 3.6.0.final.0
base environment : C:\Program Files\Anaconda3 (read only)
channel URLs : https://conda.anaconda.org/anaconda-fusion/win-64
https://conda.anaconda.org/anaconda-fusion/noarch
https://repo.continuum.io/pkgs/main/win-64
https://repo.continuum.io/pkgs/main/noarch
https://repo.continuum.io/pkgs/free/win-64
https://repo.continuum.io/pkgs/free/noarch
https://repo.continuum.io/pkgs/r/win-64
https://repo.continuum.io/pkgs/r/noarch
https://repo.continuum.io/pkgs/pro/win-64
https://repo.continuum.io/pkgs/pro/noarch
https://repo.continuum.io/pkgs/msys2/win-64
https://repo.continuum.io/pkgs/msys2/noarch
package cache : C:\Program Files\Anaconda3\pkgs
C:\Users\wecando\AppData\Local\conda\conda\pkgs
envs directories : C:\Users\wecando\AppData\Local\conda\conda\envs
C:\Program Files\Anaconda3\envs
C:\Users\wecando.conda\envs
platform : win-64
user-agent : conda/4.4.10 requests/2.12.4 CPython/3.6.0 Windows/10 Windows/10.0.16299
What I am missing?
When doing step 4 conda env update
, I get the error
Using Anaconda API: https://api.anaconda.org
Fetching package metadata ...............
Solving package specifications: .
NoPackagesFoundError: Packages missing in current win-64 channels:
- spacy
- expat
- libxml2
- pexpect
- xz
Running
- Windows 10 (64 bit)
- Python 3.6.2 :: Continuum Analytics, Inc.
- conda 4.2.9
- Nvidia 1080
What went wrong?
Thanks @Brad_S. I re-did everything but skipped the following two lines. Then, it works.
del fastai
mklink /d fastai ..\..\fastai
Under the following directory, C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\
to create symbolic link as below:
mklink /d en_core_web_sm C:\Users\rh_la\AppData\Local\conda\conda\envs\fastai\lib\site-packages\spacy\data\en
Side note: It is recommended to add the Jupyter Notebook Extensions, especially Gist-it
and Collapsible Headings
. Finally, I can replicate the whole environment in Windows.
After installing with conda on my notebotebook, I had the same problem.
torch.cuda.is_available()
and torch._C._cuda_isDriverSufficient()
both return False.
After spending a lot of time diagnosing, I believe it could be related to the Nvidia driver
cuda9 was released not long ago, and it requires a quite newer version of Nvidia driver. Upgrading the driver works for me.
HI Team,
I have download all the required components in my Ubuntu Server 16.04 (CPU). I am able to start the jupyter notebook, i have resolved all the NoModule errors which i encountered till now, but this error “sklearn_pandas” refuses to go away.
Any help regarding this?
> ---------------------------------------------------------------------------
> ModuleNotFoundError Traceback (most recent call last)
> <ipython-input-2-c51a52575a56> in <module>()
> 1 # This file contains all the main external libs we'll use
> ----> 2 from fastai.imports import *
>
> ~/fastai/courses/dl1/fastai/imports.py in <module>()
> 3 import random, pandas as pd, pickle, sys, itertools, string, sys, re, datetime, time, shutil
> 4 import seaborn as sns, matplotlib
> ----> 5 import IPython, graphviz, sklearn_pandas, sklearn, warnings
> 6 from abc import abstractmethod
> 7 from glob import glob, iglob
>
> ModuleNotFoundError: No module named 'sklearn_pandas'
Thanks,
George.
pip install sklearn-pandas
Are you using an environment or something?
what do you mean by using an environment? I am very new to this python, so please bear with me if i am asking some basic questions.
Actually the fast.ai package uses the python 3.6
Head over to the configuration forum thread or its available in GitHub or reashma’s blog…
I have installed the latest anaconda which has the latest version of python i.e 3.6 and have also updated anaconda.
I have downloaded the components using the URL as specified in the video.
So now everything should work then…
No Aditya, It is not working. Is there a requirement to restart server?
I don’t have acquaintence with Ubuntu servers but the process should remain the same as it is for a Ubuntu…
Now since you have installed Anaconda, jupyter notebook and other relevant dependences, and also had set up the system path variables etc
Then what’s the bash giving
For
which python
?
It should probably now use the Anaconda’s shipped python