when creating a fastai2.data.core.DataLoaders object with the fastai2.data.block.DataBlock.dataloaders method, the first parameter is a list of source objects. In my case this is a list of custom wrapper objects, that basically wrap around the path of the image and some other stuff.
When the dataloaders get created, the objects in the dataset do not contain a reference to these source objects any more, as far as I have noticed.
During predictions I want to save the predictions in these custom data wrapper objects. So far the only way that I see to map between the dataset objects from the dataloaders and the original source objects is, that they are in the same order. I feel a bit uncomfortable with only relying on that.
Is there some reference I haven’t found or has someone come up with a better way to tackle this?
Here is my code calling the data block api for better understanding:
data = fastai2.data.block.DataBlock(
get_x=lambda x: x.path,
get_y=lambda x: x.classification_labels,
splitter=fastai2.data.transforms.FuncSplitter(lambda x: x.is_valid),
item_tfms = fastai2.vision.augment.Resize(final_size),
dls = data.dataloaders(object_manager.objects, bs=bs)
The “object_manager.objects” simply wrap around preextracted tiles from whole-slide images with some additional information. [https://github.com/FAU-DLM/wsi_processing_pipeline/blob/master/preprocessing/objects.py#L19]
Thanks a lot in advance!