A cautionary tale about humans creating biased AI models
https://techcrunch.com/2016/09/11/a-cautionary-tale-about-humans-creating-biased-ai-models/?ncid=rss&utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+Techcrunch+%28TechCrunch%29
Natural language models need annotations that teach the models
the sentiment of a tweet, for example, or that a string of
words is a question about the status of an online purchase.
Before a computer can know or "see" these things itself, it
must be shown many confident positive and negative examples
(aka ground truth or gold standard data). And you can only get
that certainty from the right human annotators. So what
happens when you don't consider carefully who is annotating
the data? What happens when you don't account for the
differing preferences, tendencies and biases among varying
humans? We ran a fun experiment to find out.
- - -
--Lauren--
Care About Science and Tech? Our Job One: STOP TRUMP:
https://vortex.com/stop-trump
- - -
Lauren Weinstein ([email protected]): https://www.vortex.com/lauren
Lauren's Blog: https://lauren.vortex.com
Founder: Network Neutrality Squad: https://www.nnsquad.org
PRIVACY Forum: https://www.vortex.com/privacy-info
Co-Founder: People For Internet Responsibility: https://www.pfir.org/pfir-info
Member: ACM Committee on Computers and Public Policy
Google+: https://google.com/+LaurenWeinstein
Twitter: https://twitter.com/laurenweinstein
Tel: +1 (818) 225-2800
I have consulted to Google, but I am not currently
doing so -- my opinions expressed here are mine alone.
- - -
The correct term is "Internet" NOT "internet" -- please don't
fall into the trap of using the latter. It's just plain wrong!
_______________________________________________
pfir mailing list
https://lists.pfir.org/mailman/listinfo/pfir