Lr_find() with ImageClassifierData.from_array

I’m attempting to do the Digits Kaggle challenge as a first data set and I think I have created the ImageClassifier correctly but I’m getting an error when I come to run the learning rate finder.

The training data set is given as a csv file where each row in the csv has a label as the first column specifying what the number is and then the next 783 columns are a pixel grayscale value of an image of the handwritten digit. The images are 28 x 28 but given as a single row.

Given that I don’t have a folder of images, I am trying to use the ImageClassifierData.from_arrays. I have created 4 ndarrays: train_vals, train_Y, valid_vals and valid_Y, where train_vals is (33600, 28, 28), train_Y is (33600,), valid_vals is (8400, 28, 28) and valid_Y is (8400,).

I can create Python Images from the 28 x 28 arrays using Image.fromarray(img_data.astype(np.uint8)) where img_data is the (28, 28) ndarray and can see each of the handwritten digits.

I have defined a function to get the data:

def get_data(sz, bs):
    tfms = tfms_from_model(arch, sz, aug_tfms=transforms_basic, max_zoom=1.1)
    return ImageClassifierData.from_arrays(PATH, trn=(train_imgs, train_Y), val=(valid_imgs, valid_Y), 
                                           bs=bs, tfms=tfms)

I’m using resnet34 with sz=28 and bs=64 and I’m creating the learn object as:

learn = ConvLearner.pretrained(arch, data)

However, when I run learn.lr_find() I get the following error:

~/fastai/courses/dl1/fastai/transforms.py in transform(self, x, y)
    223 
    224     def transform(self, x, y=None):
--> 225         x = self.do_transform(x,False)
    226         return (x, self.do_transform(y,True)) if y is not None else x
    227 

~/fastai/courses/dl1/fastai/transforms.py in do_transform(self, x, is_y)
    383     def do_transform(self, x, is_y):
    384         if is_y: return scale_min(x, self.store.new_sz_y, cv2.INTER_NEAREST)
--> 385         else   : return scale_min(x, self.store.new_sz,   cv2.INTER_AREA   )
    386 
    387 

~/fastai/courses/dl1/fastai/transforms.py in scale_min(im, targ, interpolation)
     13     ratio = targ/min(r,c)
     14     sz = (scale_to(c, ratio, targ), scale_to(r, ratio, targ))
---> 15     return cv2.resize(im, sz, interpolation=interpolation)
     16 
     17 def zoom_cv(x,z):

error: /io/opencv/modules/imgproc/src/imgwarp.cpp:3361: error: (-215) func != 0 in function resize

I saw in another post that it might be because the resize is expecting Images so I tried converting my 28 x 28 ndarrays to Images, which forced me to change my train_vals into a list of Images but the ImageClassifierData.from_arrays won’t take a list as the dataset.

I’m very new to this so I’m not quite sure which direction to go from here.

UPDATE:

I realized one of my problems was that resnet is expecting RGB images and the digits only have the one grayscale channel, so I was able to add an extra axis (42000, 28, 28, 1) and then broadcast_to (42000, 28, 28, 3) to turn the images into 3 channels (albeit duplicating the monochrome channel 3X). I can now run the lr_find() successfully so long as I don’t use data_augmentation or zooming, which is a bit of a bummer. I would love to know a way to get aug working with ndarray images.

UPDATE:

After doing a fit with differential learning rates [lr/9, lr/3, lr] I managed to get it to 0.993. Its not bad but not in the the top 50 but its without any augmentation so I wonder how the results would be with data augmentation and TTA.