Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

New Hit: Segment and label the objects in this image (Tool fixed)

Discussion in 'Requesters' started by James Hennessey, Aug 6, 2018.

  1. James Hennessey

    James Hennessey
    Expand Collapse
    New Member

    • Requester
    Joined:
    Aug 2, 2018
    Messages:
    5
    Likes:
    0
    Hello!

    I'm new to MTurk as a requester and looking to get some MTurk workers to pick up my hits. I'm still trying to improve my image annotation tool and work out our best to balance reward and worker qualifications.

    This is my hit, please search "Segment and label the objects in this image (Tool fixed)"

    Title: Segment and label the objects in this image (Tool fixed)
    Description: Please look at this image, outline any objects that belong to one of our target object classed and select the object's class.
    Reward: 0.08
    Assignment Duration: 1 hour
    Auto Approval Delay: 2 days
    Qualification 1: user must have > 75% approval rate
    Qualification 2: user must have submitted > 500 assignment

    I had a mistake when first posting and so only attempt the job with (Tool Fixed) in the title. I can't work out how to delete the previous one as I over wrote one of the files with HIT ids ...noob.

    Any feedback much appreciated - thanks!
     
  2. A6_Foul_Out

    A6_Foul_Out
    Expand Collapse
    TV Reviewing Meme Panda

    • HIT Poster
    • Contributor
    Joined:
    Aug 17, 2016
    Messages:
    11,396
    Likes:
    21,253
    You're using the wrong qual on your hits and nobody can currently accept them:

    [​IMG]

    "Hit Submission Rate" isn't what you're looking to use.

    You probably meant to use "Total Hits approved is greater than 500"
     
    Collapse Signature Expand Signature
    LoveMuppet and MarkC like this.
  3. James Hennessey

    James Hennessey
    Expand Collapse
    New Member

    • Requester
    Joined:
    Aug 2, 2018
    Messages:
    5
    Likes:
    0
    Thank you! I have updated the qualification and you should be able to do it now. Thanks! :)
     
  4. James Hennessey

    James Hennessey
    Expand Collapse
    New Member

    • Requester
    Joined:
    Aug 2, 2018
    Messages:
    5
    Likes:
    0
    A bunch of new image annotation HITS posted. We testing with annotating a whole image for $0.80 or single polygon annotations for $0.01. Feedback appreciated!
     
  5. A6_Foul_Out

    A6_Foul_Out
    Expand Collapse
    TV Reviewing Meme Panda

    • HIT Poster
    • Contributor
    Joined:
    Aug 17, 2016
    Messages:
    11,396
    Likes:
    21,253
    TLDR: Mechanical Turk forums are typically for American workers who expect American wages. It's clear that your task is either not in need of American workers or you're not willing to pay american wages. These forums aren't the best place to reach the type of workers you're looking for.

    https://turkerview.com/requesters/?id=A1TXARRSMZ2JC9

    $1.80 / hour
    00:00:20 / completion time

     
    Collapse Signature Expand Signature
  6. James Hennessey

    James Hennessey
    Expand Collapse
    New Member

    • Requester
    Joined:
    Aug 2, 2018
    Messages:
    5
    Likes:
    0
    Thansk for the feedback. We're still experimenting with the different options and trying to work out the best way to get our data annotated. I'll post again on our next iteration to see if we do any better.