Looking for insights from Worker perspective on my HITs as a Requester

ispajic

New Member
Requester
Joined
Dec 9, 2019
Messages
2
Reaction score
0
Points
1
Age
40
Gender
Male
Hi,

I'm new to mTurk and our project is focused on helping indie TV/film producers get insights from audiences. In order to make it cost-efficient for them, we are testing algorithms that look for viewers with high prediction abilities on what the larger population is going to thing. Therefore we have HITs at https://worker.mturk.com/requesters/ASNC1PPLCS4YR/projects?ref=w_pl_prvw but need your feedback on what might need improvements.

Qualifications: certain age groups, UK based, hasn't participated in this HIT before
Duration: according to reports so far, 20-25 minutes
Fees: since I'm running on a limited budget, I'm testing between 2.8-3 $ right now
In case you see multiple HITs on the account, that's because we're trying to decrease the MTurk fees and leave more space for worker fees.

What's your opinion on the HIT?

Thank you,

Ivan
 

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
these are primarily US based forums, so I'm not too sure how many UK residents are around here to be perfectly honest.

My 10 second reading of the instructions sounded like I could hit the drop-off button to stop the video, does that mean you don't need to finish watching it? I could see how that would be easily exploited.

20 minutes for $3 seems extremely marginal at best, but I wonder if them not getting done is the UK location qualifier.

but if you're not having problems w/data collection it seems like you're fine
 
Last edited:
  • Like
Reactions: Sancho88

ispajic

New Member
Requester
Joined
Dec 9, 2019
Messages
2
Reaction score
0
Points
1
Age
40
Gender
Male
Hi, thank you for the input.
Ah, OK, the button doesn't actually stop it, only captures the intent. So that could use rewording then...

What would, in your opinion, be a more fit reward?

UK seems to be second or third biggest on mTurk's list but I do seem to have hard time finding a UK based forum and perhaps the UK mTurkers aren't as frequent as Amazon claims...
 

A6_Foul_Out

I only use Organic TurkerView reviews
Contributor
HIT Poster
Joined
Aug 17, 2016
Messages
11,754
Reaction score
21,657
Points
1,538
Location
CT's Attic
Gender
Male
and perhaps the UK mTurkers
so you're required to complete a qualification test as well, I wonder if removing that will help you get responses.

Non-US turkers are (probably) much less likely to know how to find these types of qualification tests and are less likely to know the HIT exists. Perhaps adding those questions to the hit itself and removing the qualification test would make it easier for those workers to find the HIT.

There's also TurkPrime and Positly, services that help manage academics running HITs and would be able to give a more realistic expectation on the size of the UK workbase on turk

https://www.cloudresearch.com/products/turkprime-mturk-toolkit/
https://www.positly.com/

As for time, I think expanding on it and saying: "you will be required to watch X minutes of video" would give a better understanding of how well the task pays.

If you are hard locked to watching 15 minutes of video at 1x speed, that's different than a 7 minute clip with survey questions after it.
 

jan

Moderator
Moderator
Joined
Jan 12, 2016
Messages
25,793
Reaction score
49,502
Points
1,463
Gender
Female
so you're required to complete a qualification test as well, I wonder if removing that will help you get responses.

Non-US turkers are (probably) much less likely to know how to find these types of qualification tests and are less likely to know the HIT exists. Perhaps adding those questions to the hit itself and removing the qualification test would make it easier for those workers to find the HIT.

There's also TurkPrime and Positly, services that help manage academics running HITs and would be able to give a more realistic expectation on the size of the UK workbase on turk

https://www.cloudresearch.com/products/turkprime-mturk-toolkit/
https://www.positly.com/

As for time, I think expanding on it and saying: "you will be required to watch X minutes of video" would give a better understanding of how well the task pays.

If you are hard locked to watching 15 minutes of video at 1x speed, that's different than a 7 minute clip with survey questions after it.
Can UK turkers cash out -with cash? I thought they were still restricted to gift cards (making it much more difficult)?
 

Lumius

Active Member
Joined
Dec 8, 2019
Messages
509
Reaction score
1,101
Points
393
Age
33
Gender
Male
There's also many Mturkers who use Prolific as well, which pays in GBP for UK individuals, and is much more popular with the EU crowd.

It may work better for targeting a purely UK crowd.
I @ispajic
 
  • Like
Reactions: ispajic