Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

Are bots now an epidemic problem with HITS?

Discussion in 'MTurk Help & Resources' started by user9430961, Nov 9, 2018.

  1. user9430961

    user9430961
    Expand Collapse
    New Member

    Joined:
    Apr 30, 2018
    Messages:
    7
    Likes:
    0
    When I first started as a Turker back in April 2018, I had no problem getting and working HITS, yet over the past 3 or so months, I would guess about 25% of my HITS now require me to check off that I am a “human” or use CAPTCHA or have some form of puzzle type check to ensure that I am a human and not a bot completing a survey.

    Yet I was just wondering, is there now an epidemic problem with Amazon Turkers using a form of bot system to complete HITS?

    I have now done over a 1,000 HITS, yet with as many attention checks that I have found with a good percentage of my HITS, I can not image that someone has come up with a bot to do these various random type HITS, with the chance of the bot not being able to get pass the attention check(s) and the strong chance to the HIT being rejected.

    Yet I would guess that these bots seldom make mistakes and can out smart the attention check(s), so that the HITS that the bots complete do not make enough mistakes to get enough rejections to close/suspend an account with too many rejections.

    In my case, I take my HITS seriously, and strive to never get a rejection. “To me”, NOT getting a rejection is more important than whatever the HIT pays :) "To me", working a HIT is kinda like a game for me, where working the HIT and NOT getting a rejection is the fun that comes from working HITS and getting paid in the process for not getting a rejection. :)
     
  2. TSolo315

    TSolo315
    Expand Collapse
    SnapNCrackle

    • Moderator
    Joined:
    Jan 12, 2016
    Messages:
    3,062
    Likes:
    10,380
    A researcher noticed a pattern regarding junk responses he was getting: https://www.reddit.com/r/mturk/comments/95yy96/data_contamination/

    Made the assumption it was a bot issue and scared other researchers into adding bot prevention measures to their surveys,

    Turns out it was really foreign workers using VPNs just inputting nonsense: https://blog.turkprime.com/after-th...h-data-collection-on-mturk-and-how-to-stop-it

    So no, bots are not an epidemic. Making a bot to fill out surveys without looking like a bot would be very difficult and more trouble than it would be worth.
     
    Collapse Signature Expand Signature
  3. user9430961

    user9430961
    Expand Collapse
    New Member

    Joined:
    Apr 30, 2018
    Messages:
    7
    Likes:
    0
    TSolo315, thank you so very much for shedding light on this issue. OMG! :wideyed: Up until I read those articles (via the 2 links you provided), I had no idea that is what had happened.

    Thanks again. :happy: