Read data from different directories

fastai
4

Like Kevin said, it’s hard to know if which splitter to use without knowing what the complete folder structure looks like. You can write your own custom functions for the get_items and splitter DataBlock params. Hopefully this helps.

#function for get_items parameter - This should give you the same result as Kevin's partial function.  I have not used the get_image_files function in passing in a list of folders before, so I don't know whether that works without looking it up.
def get_my_files(x):
    return get_image_files('./MyFolder/TrainingSet') + get_image_files('./MyFolder/ValidationSet') 

#Custom Splitter - there are probably better/more efficient ways to write this, but hopefully this leads you in the right direction.
def FileSplitter():
    "Split `items` depending on the value of `mask`."
    def _func(pth_in):
        in_valid = False
        if 'ValidationSet' in str(pth_in):
            in_valid = True
        return in_valid
    def _inner(o, **kwargs): return FuncSplitter(_func)(o)
    return _inner
#splitter=FileSplitter(),
1 Like