Rep Present Annotating reasons in German Amazon reviews

UKP-Lab

New Member
Requester
Joined
Dec 4, 2016
Messages
7
Reaction score
1
Points
3
Age
34
Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.
 
  • Like
Reactions: clickhappier

electrolyte

The Ghost of MTurk Past
Contributor
Joined
Jan 10, 2016
Messages
19,184
Reaction score
45,978
Points
1,313
Title: Meinungen in Produktbewertungen identifizieren. | PANDA
Requester: Maria Sukhareva, TU Darmstadt [A3TC8ETMZEPR0K] (TO)
TO Ratings:

☢☢☢☢☢ 1.25 Communicativity
☢☢☢☢☢ 2.90 Generosity
☢☢☢☢☢ 4.50 Fairness
☢☢☢☢☢ 2.00 Promptness
Number of Reviews: 16
(Submit a new TO rating for this requester)

Description: Identifizieren Sie die allgemeine Meinung einer Produktbewertung. Fließendes Deutsch erforderlich! (Fluent German is required for this task!)
Time: 15 minutes
Hits Available: 4
Reward: $0.12
Qualifications: HIT approval rate (%) is not less than 95; Location is US
 

RippedWarrior

New Member
Joined
Jan 20, 2016
Messages
7
Reaction score
6
Points
3
Age
49
Gender
Male
Dear Turkers,

we are the UKP-Lab of the Technical University Darmstadt in Germany and currently we run a study regarding Amazon reviews on Mechanical Turk.

Participants need to label the general opinion an Amazon reviewer states in his or her review. The reviews are usually about 10 to 20 lines long, and they are all in German, so fluent knowledge of German is required for the task.

We estimate one HIT to take one minute and pay 0.12$ per hit.

You can find the hits at https://www.mturk.com/mturk/preview?groupId=39393HGTI5QMIY6JHIT1M5IIGWJEOF

Thanks.
I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!
 

electrolyte

The Ghost of MTurk Past
Contributor
Joined
Jan 10, 2016
Messages
19,184
Reaction score
45,978
Points
1,313
I find it curious that you've excluded workers from Germany from completing this task. Anyway, good luck with your project!
Hmm, I wonder if that was accidental? UKP-Lab @UKP-Lab, if you remove the "Location is US" qualification from your HIT, you will allow workers from any country to access your HIT. Is it mandatory for your project that you only use American workers?
 

UKP-Lab

New Member
Requester
Joined
Dec 4, 2016
Messages
7
Reaction score
1
Points
3
Age
34
Thanks for the feedback. You both are right, including workers from more countries definitely makes sense for this task. We will rework the qualifications in the next few days to allow more workers to complete this task.
 

UKP-Lab

New Member
Requester
Joined
Dec 4, 2016
Messages
7
Reaction score
1
Points
3
Age
34
I find it curious that you've excluded workers from Germany from completing this task.
The problem is that the command-line tools that Amazon provides to requesters do not permit the creation of HITs that are limited to workers in a set of countries—you can either set the HITs to be available to workers in any country, or set a single country. We decided to restrict our HITs by country because some workers were submitting work even though they obviously couldn't speak German. We chose the US because Amazon no longer allows sign-ups from Germany, whereas there are a lot of fluent German speakers living in the US.

We have since worked around Amazon's one-country limitation by using a different tool to configure our HITs.
 

electrolyte

The Ghost of MTurk Past
Contributor
Joined
Jan 10, 2016
Messages
19,184
Reaction score
45,978
Points
1,313

electrolyte

The Ghost of MTurk Past
Contributor
Joined
Jan 10, 2016
Messages
19,184
Reaction score
45,978
Points
1,313
More German-language HITs here. These ones pay a bit more (15¢/assignment) than previously (12¢/assignment): https://www.mturk.com/mturk/preview?groupId=3WOK1A2U0JBEFRVPQ8FCEPVV7761DY
Title: Meinungen in Rezensionen identifizieren | PANDA
Worker: Preview | Accept | Requester
Requester: Tristan Miller, TU Darmstadt [A3TC8ETMZEPR0K] (Contact)
TO 1: [Pay: 3.09] [Fast: 2.00] [Comm: 1.25] [Fair: 4.56] [Reviews: 18] [ToS: 0]
TO 2:
Not Available
Description: Identifizieren Sie Argumente für oder gegen die Meinung des Rezensenten über ein Produkt. Fließendes Deutsch erforderlich! (Fluent German is required for this task!)
Time: 15 minutes
HITs Available: 953
Reward: $0.15
Qualifications: Location is one of: AT, CH, DE, LI, LU, US; HIT approval rate (%) is not less than 95;