I have been working on improving a loss function to account for hierarchies in the data. I seem to be getting promising results so far, and I would like to publish a paper. I do not come from an academic or research background, and have no idea how the whole process works. A few questions I have are:
Where can I search to see if someone else has done what I am doing or similar before (both for research and proper citation as well as to ensure I am not just re-inventing a previously published paper)? I am only familiar with ArXiv, but are there other key places I should be checking? Is it important to show what I am doing in math notation, or can python code and explanations suffice? How do I know that this is a good general idea vs something that happens to work in the small datasets I am testing it on? Should I focus on 1 dataset for a first paper, then if it works well across many datasets write a follow up - or should I start with a wide scope if possible? Are there any resources that can help guide me through the paper-writing process?
Also - For someone who has gone through this process I am open to any level of engagement you desire ranging from solely answering this forum post, to answering questions on a call, to advising, to co-authoring (assuming this turns out to be paper-worthy).