NewsBytes
    Hindi Tamil Telugu
    More
    In the news
    Narendra Modi
    Amit Shah
    Box Office Collection
    Bharatiya Janata Party (BJP)
    OTT releases
    Hindi Tamil Telugu
    NewsBytes
    User Placeholder

    Hi,

    Logout

    India
    Business
    World
    Politics
    Sports
    Technology
    Entertainment
    Auto
    Lifestyle
    Inspirational
    Career
    Bengaluru
    Delhi
    Mumbai

    Download Android App

    Follow us on
    • Facebook
    • Twitter
    • Linkedin
    Home / News / Technology News / AI tools are turning smarter and covertly racist, says study
    Summarize
    Next Article
    AI tools are turning smarter and covertly racist, says study
    Speakers of African American Vernacular English are facing discrimination

    AI tools are turning smarter and covertly racist, says study

    By Dwaipayan Roy
    Mar 18, 2024
    12:22 pm

    What's the story

    A recent investigation has revealed that widely used artificial intelligence tools, including OpenAI's ChatGPT and Google's Gemini, display covert racism.

    The study, conducted by a team of linguistics and technology experts, and published in the open-access research archive arXiv, shows these AI models harbor racial biases against speakers of African American Vernacular English (AAVE).

    Given these technologies' frequent use in tasks like job applicant screening, this raises serious concerns about potential discrimination.

    Worrying

    AAVE speakers face bias from AI models

    The research involved prompting the AI models to evaluate the intelligence and job suitability of AAVE speakers, compared to those using standard American English.

    The results showed that these models were more prone to label AAVE speakers as "stupid" or "lazy," assigning them lower-paying jobs.

    Moreover, the researchers discovered that these AI tools could potentially disadvantage job applicants who code-switch between AAVE and standard American English.

    Future

    Potential influence of AI models on legal decisions

    The study also exposed the troubling potential for bias in legal scenarios.

    The AI models were found to be more inclined to suggest death penalties for hypothetical criminal defendants who utilized AAVE in their court statements.

    While it's currently improbable that such technology would be employed to make decisions pertaining to criminal convictions, the researchers warn about the unpredictable future uses of these AI tools.

    Presently, AI models are already aiding with administrative tasks in the US legal system.

    Insights

    Rising demand for regulation amid increasing AI usage

    Prominent figures like Timnit Gebru, the former co-leader of Google's ethical artificial intelligence team, have been calling for federal regulation on large language model usage.

    The escalating deployment of AI across various sectors and its potential for covert racism, highlight the pressing need for such regulation.

    The wider generative AI market is expected to evolve into a $1.3 trillion industry by 2032, making it even more vital to address these issues promptly.

    Facts

    Recent events spotlight flaws in AI models

    Google's Gemini recently came under fire for its image generation tool, which inaccurately portrayed various historical figures as people of color.

    This incident ignited conversations about the necessity for transparency and diversity in AI development to tackle biases and algorithmic flaws.

    The researchers contend that while ethical guidelines or "guardrails" have been established, they merely instruct these models to be more subtle about their biases, without resolving the root problem.

    Findings

    Experts push for prudent use of AI technologies

    AI ethics researcher Avijit Ghosh proposes that limiting the usage of such technologies in sensitive areas, is a crucial initial step toward addressing the issue.

    He compares this to preventing racist individuals from handling hiring and recruitment processes.

    This viewpoint is echoed by an increasing number of AI experts who fear potential damage if technological progress continues to outstrip federal regulation, underlining the importance of prudent and regulated use of AI technologies.

    Facebook
    Whatsapp
    Twitter
    Linkedin
    Related News
    Latest
    Google
    Artificial Intelligence and Machine Learning
    OpenAI

    Latest

    Netflix to stream iconic 'Pokémon' series from June 1 Hulu
    'Jurassic World Rebirth': All we know about horrifying mutant dinosaurs Mahershala Ali
    IPL 2025, LSG defeat GT: How the Impact Players fared Indian Premier League (IPL)
    William O'Rourke's 3-fer helps LSG to victory over GT: Stats Gujarat Titans

    Google

    Google TV rolls out redesigned homescreen for convenience of users Google TV
    Google faces $2.3bn lawsuit from European media groups: Here's why Europe
    Adobe's new AI tool can generate audio using text prompts Adobe
    Free Fire MAX codes for March 1: How to redeem Garena Free Fire MAX

    Artificial Intelligence and Machine Learning

    AMD faces US roadblock in AI chip sales to China AMD
    Ex-Google engineer accused of stealing AI secrets for Chinese firm Google
    Google's Gemini introduces text modification feature for fine-tuning responses Google
    Anthropic's Claude 3 AI claims to be alive, fears death Google

    OpenAI

    OpenAI's GPT-4 recommends using nukes in Stanford University's wargame simulations Artificial Intelligence and Machine Learning
    Man finds wife on Tinder using AI for matches Artificial Intelligence and Machine Learning
    OpenAI hits revenue milestone of $2 billion: What's next? Sam Altman
    Meet Goody-2: The 'most responsible' AI chatbot redefining ethical boundaries Artificial Intelligence and Machine Learning
    Indian Premier League (IPL) Celebrity Hollywood Bollywood UEFA Champions League Tennis Football Smartphones Cryptocurrency Upcoming Movies Premier League Cricket News Latest automobiles Latest Cars Upcoming Cars Latest Bikes Upcoming Tablets
    About Us Privacy Policy Terms & Conditions Contact Us Ethical Conduct Grievance Redressal News News Archive Topics Archive Download DevBytes Find Cricket Statistics
    Follow us on
    Facebook Twitter Linkedin
    All rights reserved © NewsBytes 2025