Deep Learning and SVG (vector graphics)

Deep Learning
1

Hi everyone,

I am looking for people smarter than me to bounce off a few ideas around applying Deep Learning to SVG (vector graphics).

  • I have spent multiple years of my life collecting and curating a massive(!) dataset
  • I am not a complete idiot myself (multiple degrees, incl. a PhD) but still feel too dumb for the problem at hand
  • I am aware of most academic papers in the area but have not found what I need

Happy to discuss this further on a dedicated discord server.
Just ping me here or send me a message if you’re interested.

Cheers

2

You probably have thought of this and rejected the idea for some reason, but my first thought would be to introduce a conversion from your SVG image into a small size (say 68 x 68 or 126 x 126) bitmap image which you can serve into your model using all the technology build with CNN and maybe also benefit from some transfer learning.

This conversion can be included into a customized pipeline using a library converting svg to bitmap.

3

Hi Etienne,

Thank you so much for responding.

Yes, your idea makes perfect sense and was my first step. But this is insufficient for what I am aiming for. I actually need the model to be end-to-end (SVG to SVG), for a number of reasons, e.g.:

(a) The performance of tools for converting bitmaps to SVGs is very poor. Even Deep Learning powered ones. This is especially true if the PNGs have been generated without having the goal of subsequent vectorisation (to SVGs) in mind.

(b) I want the composition of the SVG to be considered, as a graph of layers, groups, elements.

I am aware of DeepSVG and Im2Vec.

Happy to discuss in detail on a separate discord if you are interested.

4

Wow, I am curious how many SVG images you have collected. And how do you convert them into uniformed representations?