This is such a great topic – I wanted to share a real world example of trying to do data science ethically. I got asked to build a candidate recommendation engine at work about a year ago, and it immediately set off some red flags so I posted here and started reviewing some of the great resources around here.
It’s been a major uphill battle with the business / product team to avoid bias, negative feedback loops, etc. It is REALLY hard to explain to business stakeholders that machine learning doesn’t just fix everything, and that you still need people. It took months of back and forth, but we eventually decided to abandon the recommendation engine and refocus the product to give some tools to help humans review candidates, rather than trying to automate everything.
Original post here: