This is an API question for v 1.0.30.
Yesterday I trained up on cuda a language model on a custom corpus and saved. Today I loaded and used predict but it gave error. How do I move my hidden tensor to the cuda?
I already tried running these lines one at a time but none solved it, and searched forums and blogs and docs:
learner.load(name='red_model_2018jan_5layer') #,device='cuda') #learner.gpu() #learner.model.cuda() #learner.model = learner.model.cuda() #learner.model.to('cuda') #learner = learner.model.to('cuda') #learner.model = learner.model.to('cuda') #learner.d # no learner.device() learner.model.cuda() #docstring: Moves all model parameters and buffers to the GPU. #learner.to_fp16() learner.predict(text='news', n_words=5) #RuntimeError: Input and hidden tensors are not at the same device, found input tensor at cuda:0 and hidden tensor at cpu
I was unable to find answer. It’s probably there I just can’t find it.