03/26 - Tumbling Dice Tuesday

Status
Not open for further replies.

Kennedy

Well-Known Member
Contributor
Joined
Jun 18, 2018
Messages
5,694
Reaction score
19,139
Points
1,013
Age
46
Gender
Female
Kennedy @Kennedy can you share the extra instructions? I don't know if that's allowed. I've done a few of them, but they make me sweat as I'm not 100% sure of what they are after.
Thanks for working on our task. Most of your annotations are good. However we also noticed that for most of your questions, without looking at the contexts, human can still select the correct answers among all the choices. We hope you can improve your annotations by providing more chanllenging incorrect answers. Ideally, without looking at the contexts, most of the correct and incorrect answers should be possibly correct to your question. We will keep publishing more batches under both Alexandria and Xlab Research accounts and hope you can do it better! Thanks.
 

Freda Brown

Member
Joined
Mar 2, 2017
Messages
190
Reaction score
404
Points
313
Age
84
Location
California
Gender
Female
Title: Qualifying HIT (Sign up for subsequent HITs)(~ 60 minutes) | Accept
Requester: SurveyComet [A3NC2P2SPK9QQ] Contact
TV: [Hrly=$19.07] [Pay=Good] [Approval=~24 hrs] [Comm=Excellent] [Rej=1] [Blk=0]
TO: [Pay=4.17] [Fast=4.70] [Comm=4.17] [Fair=4.79] [Reviews=533] [ToS=1]
TO2: No Reviews
Reward: 10.00
Duration: 4:00:00
Available: 34
Description: This HIT will qualify you to work on upcoming HITs to pre-test problems that will be used in problem-solving research studies.
Qualifications: Inc: [19-137023] Exists ; Exc: [137612-137023] DoesNotExist ; Location In US
[tr][td]
HIT exported from Mturk Suite v2.6.8
[/td][/tr]
[tr][td][/td][/tr]

I really liked this one. It's great if you like puzzles. They said it would take an hour, but I don't think it actually was that long.
 

lolkatB

Well-Known Member
Contributor
Joined
Jan 6, 2018
Messages
2,459
Reaction score
5,314
Points
838
Age
51
Gender
Female
Thanks for working on our task. Most of your annotations are good. However we also noticed that for most of your questions, without looking at the contexts, human can still select the correct answers among all the choices. We hope you can improve your annotations by providing more chanllenging incorrect answers. Ideally, without looking at the contexts, most of the correct and incorrect answers should be possibly correct to your question. We will keep publishing more batches under both Alexandria and Xlab Research accounts and hope you can do it better! Thanks.
Thanks, I think. I think my real problem with the examples. But I might give them another go. Meep. Maybe after I get soft-banned from computer vision turks traces.
 

cb456

Let's do some hits!
Mentor
Contributor
Joined
Jul 25, 2017
Messages
5,983
Reaction score
15,962
Points
1,013
Gender
Male
Title: Web of Cash | Accept
Requester: MPRG for Rationality Enhancement [AWNXYKVIXKW0B] Contact
TV: [Hrly=$11.19] [Pay=Good] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: [Pay=1.00] [Fast=1.00] [Comm=1.00] [Fair=1.00] [Reviews=3] [ToS=0]
TO2: [Hrly=10.54] [Pen=0.04] [Res=1.00] [Rec=50] [Rej=0] [ToS=0] [Brk=1]
Reward: 0.50
Duration: 1:00:00
Available: 1
Description: Earn money by navigating through a spider web in this psychology experiment.
Qualifications: Not available from queue exports.
[tr][td]
HIT exported from Mturk Suite v2.6.8
[/td][/tr]
[tr][td]
web of returns[/td][/tr]
 
  • Like
Reactions: thismegan

lolkatB

Well-Known Member
Contributor
Joined
Jan 6, 2018
Messages
2,459
Reaction score
5,314
Points
838
Age
51
Gender
Female
Title: Qualification for Real Estate Image Location Classification (version 2), 2 cents in main HIT! | Accept
Requester: Gregory Aponte [A1759LVR8D91KE] Contact
TV: [Hrly=$15.91] [Pay=Generous] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: No Reviews
TO2: [Hrly=6.00] [Pen=3.00] [Res=null] [Rec=50] [Rej=0] [ToS=0] [Brk=0]
Reward: 0.01
Duration: 5:00
Available: 89
Description: Pick the best description of the location of the image. You must do at least *15* of these HITs with a high level of accuracy to get qualified, and re-qualify if you were qualified for version 1.
Qualifications: None
[tr][td]
HIT exported from Mturk Suite v2.6.8
[/td][/tr]
[tr][td]
this?[/td][/tr]
 

sarcasta

sleepy kitshark
Joined
Feb 22, 2019
Messages
747
Reaction score
1,785
Points
393
Gender
Female
Nevermind, found it:
Title: Qualification for Real Estate Image Location Classification (version 2), 2 cents in main HIT! | Accept
Requester: Gregory Aponte [A1759LVR8D91KE] Contact
TV: [Hrly=$15.91] [Pay=Generous] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: No Reviews
TO2: No Reviews
Reward: 0.01
Duration: 5:00
Available: 89
Description: Pick the best description of the location of the image. You must do at least *15* of these HITs with a high level of accuracy to get qualified, and re-qualify if you were qualified for version 1.
Qualifications: None
 
  • Like
Reactions: Merovign

sarcasta

sleepy kitshark
Joined
Feb 22, 2019
Messages
747
Reaction score
1,785
Points
393
Gender
Female
I was only able to catch three earlier.
 

DatJersey

Well-Known Member
Joined
Feb 8, 2017
Messages
1,429
Reaction score
1,945
Points
363
Gender
Male
Title: [~3-4 minutes study, $0.5] Name 8 groups and rate them on a scale(~ 3 minutes) | PANDA
Requester: SocialCognitionResearchCologne [A3S0F56AR2HR2U] (TO)
TO Ratings:
★★★★ 4.23 Communicativity
★★★★ 4.08 Generosity
★★★★ 4.43 Fairness
★★★★ 4.53 Promptness
Number of Reviews: 161 | TOS Flags: 23
Submit a new TO review
Description: You will be asked to name 8 groups and rate them on a scale
Time: 5340
HITs Available: 1
Reward: $0.50
Qualifications: Total approved HITs GreaterThanOrEqualTo 100;HIT approval rate (%) GreaterThanOrEqualTo 99;Location In US
3:45
 
  • Like
Reactions: TotalBabe

TotalBabe

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 12, 2016
Messages
6,574
Reaction score
20,571
Points
1,213
Gender
Female
Under 2 mins.

Title: Short decision-making task | Accept
Requester: John Duffy [A3R7D4DVT90GPZ] Contact
TV: [Hrly=$51.43] [Pay=Generous] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: No Reviews
TO2: No Reviews
Reward: 0.50
Duration: 10:00
Available: 1
Description: Complete a short decision-making task as part of an experiment for the University of California, Irvine.
Qualifications: Location EqualTo US
 

TotalBabe

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 12, 2016
Messages
6,574
Reaction score
20,571
Points
1,213
Gender
Female
~2 mins.

Title: Answer a 5 minute survey on your haircuts | Accept
Requester: Jill Poppe [A2V9MDXEQKZ576] Contact
TV: [Hrly=$16.50] [Pay=Generous] [Approval=Unrated] [Comm=Unrated] [Rej=0] [Blk=0]
TO: No Reviews
TO2: No Reviews
Reward: 0.50
Duration: 10:00
Available: 1
Description: Tell us about when, where, how often, and how expensive your haircuts are
Qualifications: HIT approval rate (%) GreaterThan 95; Location EqualTo US
 

ChristopherASA

Well-Known Member
Contributor
Joined
Feb 18, 2016
Messages
11,716
Reaction score
23,143
Points
1,238
Age
76
Location
Wish it were Seattle,but it isn't. :(
Gender
Male
Under 2 mins.

Title: Short decision-making task | Accept
Requester: John Duffy [A3R7D4DVT90GPZ] Contact
TV: [Hrly=$51.43] [Pay=Generous] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: No Reviews
TO2: No Reviews
Reward: 0.50
Duration: 10:00
Available: 1
Description: Complete a short decision-making task as part of an experiment for the University of California, Irvine.
Qualifications: Location EqualTo US
Did it look to you like this HIT had some kind of "coding/formatting" problem?
 

TotalBabe

Well-Known Member
Contributor
Crowd Pleaser
Joined
Jan 12, 2016
Messages
6,574
Reaction score
20,571
Points
1,213
Gender
Female
Did it look to you like this HIT had some kind of "coding/formatting" problem?
It wouldn't load at first and had some sort of problem, but after about 10 seconds, it loaded fine. I was able to fill it out and submit it with no problems, then.
 
  • Like
Reactions: ChristopherASA
Status
Not open for further replies.