y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#crowdsourcing News & Analysis

4 articles tagged with #crowdsourcing. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles
AINeutralarXiv – CS AI · Jun 106/10
🧠

CleanPatrick: A Benchmark for Image Data Cleaning

CleanPatrick introduces the first large-scale benchmark for image data cleaning, built on a dermatology dataset with nearly 500,000 human annotations identifying data quality issues like duplicates, off-topic samples, and label errors. The benchmark formalizes data cleaning as a ranking task and evaluates existing detection methods, revealing that self-supervised models excel at near-duplicate detection while traditional anomaly detectors remain competitive for constrained review scenarios.

AIBearisharXiv – CS AI · May 76/10
🧠

Beyond Seeing Is Believing: On Crowdsourced Detection of Audiovisual Deepfakes

Researchers conducted crowdsourcing studies to evaluate human ability to detect audiovisual deepfakes, finding that while crowd workers rarely misidentify authentic videos as manipulated, they miss many actual manipulations and struggle significantly with identifying manipulation types. The study reveals that crowdsourcing can serve as a scalable screening mechanism for authenticity verification, but reliable modality attribution remains unresolved.

AIBullishTechCrunch – AI · Mar 45/103
🧠

One startup’s pitch to provide more reliable AI answers: crowdsource the chatbots

CollectivIQ is a startup that aims to improve AI answer accuracy by aggregating responses from multiple AI models including ChatGPT, Gemini, Claude, and Grok simultaneously. The company's approach involves crowdsourcing chatbot responses to provide users with more reliable information by comparing outputs from up to 10 different AI models.

AIBearishMIT News – AI · Feb 96/107
🧠

Study: Platforms that rank the latest LLMs can be unreliable

A new study reveals that online platforms ranking large language models (LLMs) can produce unreliable results, with rankings significantly changing when just a small portion of crowdsourced data is removed. This highlights potential vulnerabilities in how AI model performance is evaluated and compared publicly.