How to use BCEWithLogitsLossFlat in lesson1-pets.ipynb

fastai fastai dev
1

Is it possible or does it make sense to use BCEWithLogitsLossFlat in the lesson1-pets notebook to build a model which can make “reasonable” predictions on images which don’t contain one of the training classes. That is a model which when presented with a new breed of dog/cat should generate low “probabilities” for all classes in the way Jeremy described in Lesson 9.

I have tried using MultiCategoryBlock

path = untar_data(URLs.PETS)
path_img = path/'images'
fnames = get_image_files(path_img)
pat = r'\\([^\\]+)_\d+.jpg$'
label_func = RegexLabeller(pat)
seed = 2
valid_pct=0.2
item_tfms=RandomResizedCrop(460, min_scale=0.75)
b =64
num_workers=0
batch_tfms=[*aug_transforms(size=224, max_warp=0), Normalize(*imagenet_stats)]
dblock = DataBlock(blocks=(ImageBlock, MultiCategoryBlock()),
                   splitter=RandomSplitter(valid_pct, seed=seed),
                   get_y=label_func)
dbunch = DataBunch.from_dblock(dblock, fnames, path=path, item_tfms=item_tfms,b=b,num_workers=num_workers,
                              batch_tfms=batch_tfms)

but the resulting labels

dbunch.valid_ds.vocab

are generated from the first letter of each class.

Do I have to use a dataframe?

2 Likes
2

MultiCategoryBlock expect a list of labels, so you have to change your label_func slightly to return something like [“cat”] (and not “cat”).

3 Likes
3

Thank you, what an easy fix, working nicely with both RegexLabeller() and parent_label().

4

Maybe someone help how to improve parent_label() for this task?
I’m really don’t know how to get [‘cat’] from parent_label function.

5

One way would be to copy the definition of parent_label(), rename it (to for example parent_labeler) with the changes suggested by sgugger ( [Path(o).parent.name] instead of Path(o).parent.name)

 def parent_labeler(o, **kwargs):
     "Label `item` with the parent folder name."
     return [Path(o).parent.name]

and pass that to DataBlock

dblock = DataBlock(blocks=(ImageBlock, MultiCategoryBlock()),
                   splitter=RandomSplitter(valid_pct, seed=seed),
                   get_y=parent_labeler)
2 Likes
6

A better way would be to do what muellerzr does in this notebook using pipeline, repeated below.

def multi_l(l): return [l]

pets_multi = DataBlock(blocks=(ImageBlock, MultiCategoryBlock),
                 get_items=get_image_files,
                 splitter=RandomSplitter(),
                 get_y=Pipeline([RegexLabeller(pat = r'/([^/]+)_\d+.jpg$'), multi_l]),
                 item_tfms=RandomResizedCrop(460, min_scale=0.75),
                 batch_tfms=[*aug_transforms(size=224, max_warp=0), Normalize.from_stats(*imagenet_stats)])
1 Like
7

Secrets out, you’re the reason I realized I could do this in the first place :wink: (I have this post bookmarked)

2 Likes