Hello I did a thing after first lesson. Nothing too much impressive, but small and potential useful if polished. The problem in game development (another hobby of mine) I encountered some time ago is organizing and sorting through vast library of assets. There are multiple levels of the problems, e.g., you can be searching for 3d models of a car or a model of a tree or a good texture of some type. I choose to focus in lesson 1 challenge on the sub-problem of texture classification. E.g., when designing a level one have to find good textures for grass, hills, roads, etc… And it would be helpful if a machine did the tedious job of browsing through my library of images and return me only the ones that I’m searching for.
I have quite a big texture library myself (only the part that I already manually classified is more than 16G of images), but I started “from scratch”, i.e., by creating a new library of textures from google images . That task was tedious to say a bit. The resulting dataset is 20 classes, 4723 images. The classes are: bark, cliff, cobblestone, cracked-soil, forest-leaves, forest-needles, grass-dead, grass-green, ice, moss, mud, path, pebbles, plank, red-bricks, roof, sand, snow, white-bricks, yellow-bricks. I cleaned it up a bit, but still the dataset is quite noisy. Here are some example images:
Limiting myself just to more-or-less what was shown in the first lecture I got error rate of 0.157295. This is using vgg19_bn model architecture (after unfreezing the weights). For first attempt on 20-class classification problem I think it’s pretty nice result. The errors I get shows limitations of such approach and highlight some problems in the dataset:
With the most confused classes being:
[(‘snow’, ‘ice’, 16),
(‘ice’, ‘snow’, 12),
(‘mud’, ‘sand’, 10),
(‘moss’, ‘grass-green’, 9),
(‘bark’, ‘plank’, 6),
(‘forest-leaves’, ‘moss’, 6),
(‘mud’, ‘cracked-soil’, 6),
(‘pebbles’, ‘forest-leaves’, 5)]
Was fun playing around with this
Edit: managed to reduce error rate to 0.11 after applying some of the stuff I learned in lesson 2