Personally believe that effective, full use / attention to the characteristics of the data set, in order to better play the methodology. But it is not that the method itself (deep learning model) is not important. The unique features of the data set and the model built should be complementary.
Are you referring to 3D data from a CT or 2D slices from a CT scan?