Resize but no crop (or flip)

[keijik]

I am trying to figure out how to load an image data bunch with resizing but no crop or any flips.

A similar question has been asked in fastai users https://forums.fast.ai/t/resize-instead-of-crop/28680 and I don’t see an answer where cropping is omitted. Apologies for duplicate - I am hoping there are more people looking at V3 forums right now.

I’ve tried various things like:

• Custom get_transform() with no flip
• Editing the result of get_transform and removing the Crop transforms
• Using no transforms

Having no Crop transforms (or no transforms) results in PyTorch data loader errors with tensor size mismatches.

Do I have to manually resize the images and then use no transforms? I can do that but hoping for an easier way.

Thanks!

[jeremy (Jeremy Howard)]

What are you looking to do instead of crop? Pad? Or squish?

[keijik]

Thanks for quick response @jeremy!

I am trying to classify charts and the right edge of the chart is especially important for this exercise. So the primary goal is to not crop the right edge (and also no flips). Otherwise, some skew & rotate is OK.

[arunoda (Arunoda Susiripala)]

I assume this is the default behavior:

Is it possible to do crops like these:

[keijik]

I tried to find a way to do crop with padding with the transform parameters but wasn’t successful.

I ultimately did something along the lines of @arunoda and it worked great (with white padding which works just fine for my application)

magick mogrify -resize 224x224 -background white -gravity center -extent 224x224 foo.png

[jeremy (Jeremy Howard)]

@arunoda

Is it possible to do crops like these:

https://docs.fast.ai/vision.transform.html#Data-augmentation

[keijik]

I tried exactly that - do_crop=False, padding_mode='zeros' in ImageDataBunch.from_folder along with get_transforms(do_flip=False, max_zoom=1) but I got errors in PyTorch dataloader.

So I went with native imagemagick resize with padding.

[jeremy (Jeremy Howard)]

@keijik

but I got errors in PyTorch dataloader

Without seeing your error I can’t really help - sorry. But remember the docs are all runnable jupyter notebooks so you can try it out yourself there.

[keijik]

Thanks @jeremy, this is what I get

/anaconda/envs/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py in _process_next_batch(self, batch)
656 self._put_indices()
657 if isinstance(batch, ExceptionWrapper):
–> 658 raise batch.exc_type(batch.exc_msg)
659 return batch
660

RuntimeError: Traceback (most recent call last):
File “/anaconda/envs/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py”, line 138, in _worker_loop
samples = collate_fn([dataset[i] for i in batch_indices])
File “/anaconda/envs/py36/lib/python3.6/site-packages/fastai/torch_core.py”, line 91, in data_collate
return torch.utils.data.dataloader.default_collate(to_data(batch))
File “/anaconda/envs/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py”, line 232, in default_collate
return [default_collate(samples) for samples in transposed]
File “/anaconda/envs/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py”, line 232, in
return [default_collate(samples) for samples in transposed]
File “/anaconda/envs/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py”, line 209, in default_collate
return torch.stack(batch, 0, out=out)
RuntimeError: invalid argument 0: Sizes of tensors must match except in dimension 0. Got 353 and 356 in dimension 3 at /opt/conda/conda-bld/pytorch-nightly_1540496378087/work/aten/src/TH/generic/THTensorMoreMath.cpp:1317

[arunoda (Arunoda Susiripala)]

Oh interesting.I’ll have a look this.

[jeremy (Jeremy Howard)]

@keijik

Thanks @jeremy, this is what I get

Sorry I should have been more specific. We need your code as well. Here’s some tips to save you some time next time:

How to ask for help

Before asking for help, please search the forums. Click the magnifying glass in the top right. Try a few different searches if you don’t find anything right away. When you ask for help, you have a lot of context about your problem that the person you’re asking doesn’t know (and the answer depends on that context). By following these guidelines, others will be able to more quickly and effectively help you. Be sure to include: Tell us what steps you’ve tried to fix the problem yourself, what …

[marcmuc (Marc P. Rostock)]

If you only want resize and no transforms (i.e. you already have squared images but want to train on smaller size) you have to use a little trick to make that work. Not sure this is the best way, maybe someone has a better way?

Developer chat

Resize-Issue? if I use DataBunch.fromsomething(), the size=xx parameter is completely ignored unless I have transformations specified. So how would I get simple resizing of my images without other transforms? This may be by design (http://docs.fast.ai/vision.image.html#Be-smart-and-efficient) but it is very unintuitive as an api. If I can pass a size kwarg to the DataBunch method, this should not depend on the user also specifying some transformations I think. Suggestion: if “size” is present…

Basically you have to create a dummy tranform that does nothing in order for the size parameter to work.

[keijik]

Per other thread, @sgugger has added a resize_method parameter that helps with this.

Thanks @jeremy and @sgugger!

[alonsosilva]

Yes, the resize_method should do the trick.

data = (ImageList.from_folder(path)
.split_by_folder()
.label_from_folder()
.add_test_folder()
.transform(get_transforms(), size=64, resize_method=ResizeMethod.SQUISH)
.databunch())

[rajanlagah]

@alonsosilva

resize_method=ResizeMethod.SQUISH

def get_data(bs,size):
    data = (src.label_from_func(lambda x: f'{path_to_good_images}/{x.name}')
           .transform(get_transforms(max_zoom=1.), size=size, resize_method=ResizeMethod.SQUISH,tfm_y=True)
           .databunch(bs=bs).normalize(imagenet_stats, do_y=True))

    data.c = 3
    return data
data_gen = get_data(bs,size)
data_gen.show_batch(4)

data_gen.show_batch(4) is showing orignal image as distorted too and i want to stop the flip w.r.t y-axis.

this is output (right side is target image)

BUT

This is actual target image ( which should appear at right ) what i am doing wrong ?

[fanbyprinciple]

Data augmentation in computer vision | fastai

for fastai v4.