• Skip to main content
  • Skip to secondary menu
  • Skip to footer

hitmotize.com

Optimize Your Turk Game




  • Home
  • Qualification Tests
  • Qualification HITs
  • The Skinny
  • mTurk Lingo
  • About

Qualification Tests

This table is sortable. The default setting is to show the newest tests on the top.

Note: we cannot vouch for all these requesters. Please pay close attention to any information in the notes column of each entry.

Do you have more to add to this list?  Any changes?  Leave a comment below or join TurkerNation’s Slack Workspace and easily add quals to the Quals Channel.

Here is a list of Requesters for whom we do not post qual tests because of their rejection record:

  • Bright Machines
  • Andreas Vlachos
  • Hanna Diggins
  • D Labs
  • Joseph Dario
  • John Smith
  • nlp_super
  • Q OCR
wdt_ID Date Added to Hitmo Requester Test Qualifications Needed Wait to Retake HIT Title HIT Description Notes
4 01/28/2019 vainu Company references qualification test Company references qualification test GreaterThanOrEqualTo 80 1 day Find the references page of a given website Visit the website given below. Find a link of their references page
6 01/30/2019 CHAI Group Emotion Labelling Test Short Audio EqualTo 100 8 hours Labelling emotion of short (~25s) audio clip Listen to ~25s audio clip and answer multiple choice questions. Earn up to 9.25 dollars per hour! Please listen to audio at 1x speed.
7 01/31/2019 Michael Woytowitz HeadshotQualification HeadshotQualification Exists 1 day Find Professional Headshots Using Provided Information Your task is to find headshots and copy and paste the image url. We've made an effort to make completing the HIT as seamless as possible but are open to any and all feedback
8 02/01/2019 Robert West Text Comprehension Questionnaire Text Comprehension Questionnaire GreaterThan 5 7 days Label Statements about Short Texts (~7.5 MINS) -> DO AT MOST 24 HITS Given several statements, and a series of short texts, decide whether the texts are in accordance to the statements. Please do at most 24 hits.
9 02/02/2019 Robert West Nutrition Questionnaire 10 hours
10 02/03/2019 Mike Ross Sentence Expansion Qualification Level 3 Level3SentenceExpansion GreaterThanOrEqualTo 70 3rd party site Sentence Rewrite https://docs.google.com/document/d/e/2PACX-1vRqW_2fuL41KgfRqRWDO3LB_F9P2SBdz3yClDL6xxkRI2Sux56z6gFNrD5y06R0V4GaJJH6lKJn4UZP/pub
11 02/04/2019 Hamish Brocklebank Choosing sentiment, emotion and topic for short text (video comment) Once you start, you won’t be allowed to retake this test. Choose sentiment, emotion and topic for short text Choose sentiment, emotion and topic for short text
12 02/05/2019 Ian Stewart Reading comprehension test//Examen de comprensión lectora 1 minute
13 02/06/2019 Carnegie Mellon Social Computing Group Parenting Topics Training Once you start, you won’t be allowed to retake this test.
14 02/07/2019 Vladimir Product Category Detection Quiz 2 hours
15 02/08/2019 S365 News title sentiment qualification 2 hours
16 02/09/2019 Research Tasks v_2-Qualified Workers Once you start, you won’t be allowed to retake this test.
17 02/10/2019 Vered Shwartz Relationship between News Headline Relationship between News Headline GreaterThanOrEqualTo 83 1 minute Relationship between News Headlines Annotating the relationships between two news headlines
18 02/11/2019 Vered Shwartz News Headline Relationships 1 minute
19 02/12/2019 Suggestic, Inc. Menu Items Annotation 5 minutes
20 02/13/2019 Martin Schmitt Familiarity with typed placeholders and inference 20 minutes
21 02/14/2019 Fred Vollmer Image Landmark Selection 1 hour
22 02/15/2019 Friedrich Fraundorfer Semantic Drone Dataset Labeling Qualification v1 Less than 1 minute
23 02/16/2019 BIU NLP What's Missing - test2 Once you start, you won’t be allowed to retake this test.
24 02/17/2019 Nathan Stevenson Financial entity recognition accuracy test 10 minutes Answer Verification | Accept
25 02/18/2019 QA Test Chat about a story -- v4
26 02/19/2019 Vered Shwartz Sentence Relation Labelling 10 minutes
27 02/20/2019 Dsys Mturk Image Content Moderation 1 minute
28 02/21/2019 Matt Garner ShopHero Grocery Product Image Transcription Qualification v1 1 day
29 02/22/2019 Enlearn SubtractionTest
31 02/23/2019 Tae Soo Kim Cataract Surgery Qualification 1 minute
33 02/24/2019 Johannes Daxenberger Argument Similarity BWS usually >50% correct is enough 1 day
34 02/25/2019 ROC-NLP-Research Story Completion 20 1 hour
35 02/26/2019 f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 Reputation_Polarity_v3 Unknown - Note: *For Masters 6 hours
36 02/27/2019 YCharts YCharts Excel Qualification Ensures that you are able to open and read Microsoft Excel files with the extension .xlsb 1 day
37 02/28/2019 Brand Research Dept. Brand Recognition Qualification Quiz You must pass at least 18/20 to work on HITs. 1 day
38 03/01/2019 Flow Mturk Parking Sign Transcription 30 minutes Transcribe Parking Signs This requester is known to reject at times. He sometimes reverses.
39 03/02/2019 Thor Russell FIQ Summary Assessor L1 SpeakingAssessor is greater than 9 2 minutes Check the ID Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs.
40 03/03/2019 Marc O'Relius Sentiment Qualification Once you start, you won’t be allowed to retake this test.
41 03/04/2019 Shaojin Ding American English Accent Pretest American English Accent Pretest GreaterThanOrEqualTo 3, Finished taslp20 MOS unseen DoesNotExist Once you start, you won’t be allowed to retake this test. Audio Quality Test In this test, you will evaluate the acoustic quality of 85 short human speech segments. Each speech segment is about 4 seconds. The estimated time of finish the task is 12 mins. Old TO shows rejections do at your own risk.
42 05/05/2019 Image Matcher 1.0 Eagle Eye
43 03/06/2019 The Theater Lab DA1.0- Theater Lab responder 3 days
44 03/07/2019 amt_qcri Political Proficiency Test Political Proficiency Test EqualTo 20 Less than 1 minute Analysing Political Leaning of News Articles Analyse the political leaning of the news article based on the headline and text of the article
45 03/08/2019 Prateek Singhal Qualification Test for question/para mapping Qualification Test for question/para mapping EqualTo 100 Once you start, you won’t be allowed to retake this test. Map the following question to the paragraph/content where the answer to the question may lie. Please review the following content to figure out where the answer to the posted question may reside
46 03/08/2019 rybn  play chess test play chess test EqualTo 100 Once you start, you won’t be allowed to retake this test. Play the next move in chess game!!!  A chessgame HIT that requires a certain score from a qualification test to accept. You must play the next move.
47 09/02/2019 CASOS Department Can you label a tweet's relationship with a another tweet (v2) Can you label a tweet's relationship with a another tweet (v2)? Exists 4 days Label whether reply tweet agree or disagree with target tweet
48 03/10/2019 Bunny Inc. [audio] Audio sample quality assurance - Audio wave [audio] Audio sample quality assurance - Audio wave Exists Once you start, you won’t be allowed to retake this test. [audio] Audio sample quality assurance #29555 - Audio wave VoiceBunny is a crowdsourced service to get professional voice over recordings. The objective of these tasks is to check whether the audio samples submitted by voice actors meet the quality criteria of VoiceBunny.
49 03/11/2019 Crowdsurf Support Qualified to work on Transcription Tasks Qualified to work on Transcription Tasks is not less than 900 Once you start, you won’t be allowed to retake this test. Transcribe up to 35 Seconds of Media to Text - Earn up to $0.17 per HIT!! Transcribe up to 35 seconds of Media into text. Reward amount is variable based on media length. Additional reward amounts will be paid as a bonus.
50 03/12/2019 Mattia Samory Linguistic pattern detection qualification Once you start, you won’t be allowed to retake this test.
51 03/13/2019 f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 External_Entity_Qualification 70% accuracy to pass 6 hours
52 03/14/2019 CU Learning Lab Qualification for HIT: What do you think of these foods Once you start, you won’t be allowed to retake this test.
53 03/15/2019 UserBob Reviewer UserBob has scores for different level reviewers. This qualification is used to indicate your reviewer level. As you complete shorter reviews for UserBob your reviewer level will be increased allowing you to accept HITs for longer reviews. 1 minute UserBob posts various HITS UserBob HITS are to review a website or app
54 03/16/2019 Yandex Inc Relevance evaluation Relevance evaluation is 3 20 minutes Relevance of URLs for queries (15 tasks) We will give you pairs - query and URL (also you will have screenshot of that URL to help you). That are real queries from search systems and real sites. You need to understand is this site contains relevant or useful information for this request or not.
55 03/17/2019 RealCME Family health screening survey Once you start, you won’t be allowed to retake this test.
56 05/25/2020 Maze maze_age_12 Maze wants to know your age to check if you fit with the targeted audience 7 days Small usability task & feedback on a website/app prototype. (~33 minute) You will see small screenshots from an app or a website and you have small challenges to execute. Earn ~$0.20 per minute Requester sometimes rejects - Various HITs use this qual which was originally added 3/18/2019
58 03/19/2019 shreya ImageCategorizeQualification_new Once you start, you won’t be allowed to retake this test. This test appears to have been removed
59 03/20/2019 Jing Chen Demographics 5 minutes
60 03/21/2019 Amazon Mechanical Turk Adult Content Qualification Qualification to work on hits containing adult content.
61 03/22/2019 Cardcow Data Entry for Postcards Data Entry for Postcards is 1 10 minutes Enter Detailed Information for a Postcard Please view the image contained in this HIT and enter appropriate data
62 03/23/2019 AudioKite Certify that you enjoy listening to music in 7 different genre categories. 100 Less than 1 minute
63 03/24/2019 Bunny Inc. [audio] Audio sample quality assurance - Normalization Once you start, you won’t be allowed to retake this test.
64 03/25/2019 Yilin Zheng Image annotation - watch the video first Once you start, you won’t be allowed to retake this test.
65 03/26/2019 iRobot Corp. TermsAndConditions 1 Once you start, you won’t be allowed to retake this test.
66 03/27/2019 Bunny Inc. [audio] Audio sample quality assurance - Age and gender Once you start, you won’t be allowed to retake this test.
68 03/28/2019 PickFu PickFu NDA
69 03/29/2019 Fynn Gerken Financial Experience Investment Experience EqualTo 100 Once you start, you won’t be allowed to retake this test. Investment experiment (~10 mins $$ BONUS UP TO 75 CENTS ) This is an academic investment experiment (~10 mins). Task involves viewing material and answering related questions. Three very short qualification questions. Flat rate: $0.50. Bonus: up to $0.75 (3 comprehension questions- $0.25 per correct answer).
70 03/30/2019 BEAM Study Qualification 1 Once you start, you won’t be allowed to retake this test.
71 03/31/2019 Hamish Brocklebank Choosing sentiment, emotion and topic for short text Once you start, you won’t be allowed to retake this test. Choose sentiment, emotion and topic for short text Choose sentiment, emotion and topic for short text
72 05/25/2020 Maze maze_gender_12 Maze wants to know your gender to check if you fit with the targeted audience for various HITs 7 days Small usability task & feedback on a website/app prototype. (~33 minute) You will see small screenshots from an app or a website and you have small challenges to execute. Earn ~$0.20 per minute Sometimes rejects - Various HITs use this qual which was originally added 04/01/2019
73 04/02/2019 Abhijeet Sangwan Text Analysis Qualification This qualification will give workers access to Review Analysis hits. Less than 1 minute
74 04/03/2019 Paul May consent Once you start, you won’t be allowed to retake this test.
75 04/04/2019 Postech Database Laboratory SQL Ability SQL Ability EqualTo 100 12 hours Natural Language to SQL Translation You will be asked to make corresponding MySQL query for the given Natural Language question. It is required to know MySQL query language.
76 04/05/2019 Amazon Requester Inc. - EviMultimedia Image Quality Ratebility 15 days
77 04/06/2019 IWS Photo moderation - evaluate a photo (some adult content) Total approved HITs GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 85; Photo moderation - evaluate a photo (some adult content) EqualTo 100; Adult Content Qualification Exists You will have to wait almost 5 years if you wish to retake this test. Answer questions about a photo [May include adult content - discretion advised] Answer 1-10 questions about a photo. May include adult content. Ongoing project for a major website.
78 04/07/2019 amturk xCapture v1.5 1 hour
79 04/08/2019 Amazon Requester Inc. - A9 Data Validation Category Validation Qualification
80 04/09/2019 Robert West Cardio Questionnaire 10 hours
81 04/10/2019 John Williamson Consent Once you start, you won’t be allowed to retake this test.
82 04/11/2019 DataAnalysis paulriv-fitment-qualtest Less than a minute
83 04/12/2019 J & B's Research TBI Qualification Once you start, you won’t be allowed to retake this test.
84 04/13/2019 Yibo Zhang Investment Knowledge and Experience Finance and Accounting Knowledge is not less than 70 4 months Investor Behavior 2019 Participants in this HIT will play the role of investors This test has a 5 minute timer.
85 04/14/2019 vainu Company business ID finder Company business ID finder test is not less than 100 1 day Find the Entity number of a company In this HIT, your task is to find a entity number for a company name by searching it from the search engine provided by task.
86 04/15/2019 vainu Need Correct Link to Test Find personal names from business news and earn a Qualification (Computer required) In this HIT, the task is to identify and highlight any personal names from a series of short business news articles. After finishing, we will automatically score your submission from 0 to 100 based on how accurately you have found the correct entities fro
87 04/16/2019 vainu Need Correct Link to Test Find location names from business news and earn a Qualification In this HIT, the task is to identify and highlight any location names from a series of short business news articles
88 04/17/2019 vainu Need Correct Link to Test Vainu Job Title Name Annotations is not less than 80 Find job title names from business news and earn a Qualification (Computer required) Your task is to find and highlight all job title names from short business news articles. Please note, that a qualification is required to work on these HITs.
89 04/18/2019 vainu PDF extraction qualification test (BS) PDF extraction qualification test (BS) is not less than 80 1 day Find financial values from PDFs (BS) Find financial values from attached pdf document
90 04/19/2019 vainu Need Correct Link to Test PDF extraction qualification test (IS) is not less than 80 1 day Find financial values from PDFs (IS) Find financial values from attached pdf document
91 04/20/2019 Mango Languages Short Spanish Proficiency Test Short Spanish Proficiency Test is 100 Once you start, you won’t be allowed to retake this test. Select the best translation in Spanish for a given word in English. The task is to select one or more out of three possible translations in Spanish for a common word in English. If none of the proposed translations is acceptable, you are asked to provide a suitable translation.
92 04/21/2019 Noah QualificationA QualificationA GreaterThanOrEqualTo 80 17 minutes Teaching a bot to modify the world Imagine you are teaching a bot to modify the world. Requester has many accounts and has been known to reject
93 04/22/2019 Foxtrot Foxtrot English Expert Foxtrot English Expert GreaterThanOrEqualTo 2 Once you start, you won’t be allowed to retake this test. Copy Edit English Text Correct all spelling, grammar, and style errors in some English text
94 04/23/2019 Granola Transcriptions ingredients ingredients Exists Transcribe ingredient text from an image Write the ingredient text from the given images in the appropriate fields
95 04/24/2019 Hamish Brocklebank Choosing sentiment, emotion and topic for short text (tweets minified) Choosing sentiment, emotion and topic for short text (tweets minified) GreaterThan 50 Once you start, you won't be able to repeat this test. Choose sentiment, emotion and topic for short text Choose sentiment, emotion and topic for short text Qualifications: Location In AU, GB, IE, IL, IN, NL, NZ, PL, US, ZA; Choosing sentiment, emotion and topic for short text (tweets minified) GreaterThan 50; Total approved HITs GreaterThan 100; HIT approval rate (%) GreaterThan 90
96 04/25/2019 Briefcam Mechanical Turk truck_tests_capacity truck_tests_capacity GreaterThan 16 Once you start, you won’t be allowed to retake this test. Rich Classification Tagging Tag each sequence with the appropriate class
97 04/26/2019 EdiRequester MainTaskQualification MainTaskQualification EqualTo 100 5 minutes What and where is the object? Describe the object and its location on the picture.
98 04/27/2019 Sébastien Drouyer Vehicle qualification test Vehicle qualification test GreaterThan 90 Once you start, you won’t be allowed to retake this test. Vehicle annotations on satellite images - NEW Help us spot where vehicles are on satellite images
99 04/28/2019 MTurk Answer Elicitation Answer Verification Test 3 Answer Verification Test 3 GreaterThan 22 4 days Rate the quality of an answer based on the provided question
100 04/29/2019 mturk-sandbox IT Topic Classification IT Topic Classification EqualTo 100 2 days Categorize the purpose of information technology posts Categorize short text documents related to IT research, production comparison and problem resolution
101 04/30/2019 Ruoyu Jia Missing word qualify test Missing word qualify test GreaterThan 75 Once you start, you won’t be allowed to retake this test. Rate the Pronunciation of Short English Sentence Recordings Rate the Pronunciation of Short English Sentence Recordings. For more details, check out the preview.
102 05/01/2019 Aakanksha Linguistic Reasoning Test Linguistic Reasoning Test EqualTo 100 Once you start, you won’t be allowed to retake this test. Label relation between sentences We will give you a pair of sentences. You will need to determine whether one sentence can be concluded to be true from the other.
103 05/02/2019 vainu Company careers pages finder test Company careers pages finder test GreaterThanOrEqualTo 100 1 day Find a careers page from a company website In this HIT, your task is to find a company careers page from a website of a company.
104 05/03/2019 vainu Company websites (SWE) Company websites (SWE) GreaterThanOrEqualTo 80 1 day Is the given website a homepage of a company or an organization? Visit the website given below. Is it a homepage of a company or an organization?
105 05/04/2019 Noah Qualification 4A Qualification 4A is not less than 80 17 minutes Teaching a bot to modify the world Imagine you are teaching a bot to modify the world. Requester has many accounts and has been known to reject
106 05/05/2019 salathegroup Instructional quiz for tracing food items Once you start, you won’t be allowed to retake this test. Trace the food items in an image Select food category and trace a path around each food item in this image
109 05/08/2019 BIU NLP 'Writing and answering questions on a sentence' test score (%) Writing and answering questions on a sentence' test score (%) is not less than 90 2 minutes Write question-answer pairs about a word Given a sentence containing a single highlighted word, Your goals are: (1) write questions about that word which are answerable by the sentence and (2) mark their respective answers in the sentence.
110 05/09/2019 Enlearn AddFractions3 AddFractions2 is not one of: 0, 1, 2, 3, 4, 5, 6, 7 AddFractions3 is greater than 0 Once you start, you won’t be allowed to retake this test. Learn how to solve math problems involving fractions. Work through math problems using our learning website
111 05/10/2019 Benjamin Tan Screening qualification to perform annotation tasks. (NOTE: You can take the pre-screening test here before you take the qualification test: https://goo.gl/forms/qJUkBzc6joDbENMt2) Screening qualification to perform annotation tasks. 1 minute This qualifies you for various types of HITS from this Requester. This qualifies you for various types of HITS from this Requester.
112 05/11/2019 Thor Russell SpeakingAssessor 2 minutes
113 05/12/2019 vainu Vainu Entity Annotations Qualification Vainu Entity Annotations Qualification is not less than 90 5 days Find organization, personal, location and job title names in business news articles Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs.
114 05/13/2019 vainu Company references qualification test Company references qualification test is not less than 80 1 day Find the references page of a given website Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs.
116 05/14/2019 Enlearn AddFractions4 AddFractions4 is greater than 0 Once you start, you won’t be allowed to retake this test. Learn how to solve math problems involving fractions. Work through math problems using our learning website.
119 05/15/2019 Yohan Jo Pre-task for Criticism Annotation Pre-task for Criticism Annotation GreaterThanOrEqualTo 22 Once you start, you won’t be allowed to retake this test. Criticism Annotation Read argumentative dialogues and annotate criticisms. Fun for workers who love argumentation and critical thinking! Workers must be aged 18 or older, fluent in English (native or bilingual), and pursuing/having a Bachelor's degree.
120 05/16/2019 Yohan Jo Pre-task for Counterexample Annotation Pre-task for Counterexample Annotation GreaterThan 97 Once you start, you won’t be allowed to retake this test. Counterexample Annotation Read argumentative dialogues and annotate counterexamples. Fun for workers who love argumentation and critical thinking! Workers must be aged 18 or older, fluent in English (native or bilingual), and pursuing/having a Bachelor's degree.
121 05/17/2019 Darina Benikova Comparison Specificity Comparison Specificity GreaterThanOrEqualTo 40 10 minutes
122 05/18/2019 Noah Turk Product Similarity Qualification Product Similarity Qualification is 5, Masters is Granted 3 hours Check if two web pages describe the same product Given 2 URLs and images decide if two web pages describe the same product Requester has many accounts and has been known to reject
123 05/19/2019 Vered Shwartz Phrasal Verbs Phrasal Verbs is 100 1 minute Phrasal Verbs In this task you will be given a sentence with a highlighted span, and asked to identify the (phrasal) verb in the span
124 05/20/2019 FA-Turkmaster Pre-Screened (copy editing) 1 Once you start, you won’t be allowed to retake this test. Copy Editing This Qualification has been deactivated You cannot request this Qualification because its Author has deactivated it.
125 05/21/2019 Gemma Boleda DataProtectionv0.1 100 2 min Name objects in images Name the object in the red box with the first name that comes to mind Timer set to 25 seconds. Read it all, close the window and start over after 2 minutes.
126 05/22/2019 shreya ImageCategorizeQualification 80 Once you start, you won't be able to retake this test Categorize each image and describe in words This task include images of indoor and outdoor scenes and they have to be categorized in their respective classes Categorize rooms in houses
127 05/23/2019 Kazuhiro Ota QT Passed Workers 100 5 minutes Judge the quality of video descriptions Review two video clips and an associated video description and judge the quality of the description. Also need Adult Qualification
128 05/24/2019 UKP Lab, TU Darmstadt Argument Similarity BWS Argument Similarity BWS GreaterThanOrEqualTo 50; Total approved HITs GreaterThanOrEqualTo 1000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 98 1 Day Argument Similarity
129 05/25/2019 GSV Urban Data Lab GSV Trash Single Image Survey Qualifications: GSV Trash Single Image Survey GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 90; Location EqualTo US less than a minute GSV Trash Single Image Determine whether the streetview image contains trash
130 05/28/2019 Hamish Brocklebank Choosing sentiment and emotion for comments in Spanish Location is one of: AR, BO, CL, CO, CR, DO, EC, ES, GQ, GT, HN, MX, NI, PA, PE, PR, PY, SV, US, UY, VE HIT approval rate is greater than 90 Total approved HITs is greater than 100 Choosing sentiment and emotion for comments in Spanish is greater than 50 Once you start, you won’t be allowed to retake this test 1 min: Choose sentiment and emotion for short text in Spanish 1 min: Choose sentiment and emotion for short text in Spanish
132 06/01/2019 MLDataLabeler BoundingBoxTestScore BoundingBoxTestScore is not less than 84 You will have to wait 1 day if you wish to retake this test Bounding Box Tasks Bounding Box Tasks After this test is completed/passed, you MUST do the accompanying qualification HIT. It may not always be available.
133 06/03/2019 MLDataLabeler SemSegTestScore SemSegTestScore is not less than 84 You will have to wait 1 day if you wish to retake this test Semantic Segmentation Semantic Segmentation Tasks You have to do a hit after this test to get the qualification for Segmentation Tasks
134 06/12/2019 Hamish Brocklebank Choosing sentiment and emotion for an opinion Location In AU, GB, IE, IL, IN, NL, NZ, PL, US, ZA; Total approved HITs GreaterThan 100; HIT approval rate (%) GreaterThan 90; Choosing sentiment and emotion for an opinion GreaterThan 50 Once you start, you won’t be allowed to retake this test. Choose sentiment and emotion for short text 1 min: Choose sentiment and emotion for short text
135 06/29/2019 Brex Business Categorization Test Business Categorization Test is not less than 100 2 minute Identify this business Instructions: https://www.dropbox.com/s/nragfkasaos7483/Instructions.pdf?dl=0
136 08/09/2019 MLDataLabeler NamedEntityRecognitionTestScore NamedEntityRecognitionTestScore is not less than 80 1 day Qualifying HIT for Named Entity Recognition Tasks Qualifying HIT for Named Entity Recognition Tasks
137 08/11/2019 vainu Vainu Entity Annotations Qualification 2 Vainu Entity Annotations Qualification 2 is not less than 100 6 hours Find organization, personal, location and job title names in business news articles (Computer required) Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs You also need this qualification to do these hits: Vainu Complete Name Annotations qualification for excellent workers is not less than 90
138 08/11/2019 Yihan Lu Java related knowledge test Java related knowledge test is not less than 60 30 minutes Explain each line of code in a Java file Write brief explanation for the line in the given java code.
139 08/11/2019 Vivien Language Qualification Test Language Qualification Test is 100 Once you start, you won’t be allowed to retake this test. Answer a survey about similar sounding words Answer questions about your language background and Generate similar sounding words
140 08/11/2019 EdiRequester Summary evaluation qualification Summary evaluation qualification is not less than 7 Once you start, you won’t be allowed to retake this test. Summary evaluation This task it about evaluation of system generated summaries for reviews. Masters Required
144 10/04/2019 MIT Lincoln Laboratory Labeling Qualification Not sure at this time 10 minutes Not sure at this time 15c to tag a picture for disaster damage
145 10/17/2019 Mattia Samory Sexism Detective Location is US, HIT approval rate (%) is not less than 99, Sexism Detective is not less than 80, Total approved HITs is greater than 10000 1 Day That's sexist! Identify different types of sexism Tell us whether a sentence is sexist or not, and help us understand why is it sexist Requester can be contacted at TurkerNation Slack
146 11/22/2019 Ai2 Israel Missing Verbs Missing Verbs equalto 100 Total approved HITs is greater than 5000, HIT approval rate (%) is greater than 97 1 min Missing Verbs Given a question, write down the steps that should be taken in order to return its answer. Requester is a member of Turker Nation
147 12/27/2019 Ai2 Israel Grammatical Sentences2 HIT Approval not less than 99, Location one of: AU, CA, GB, US, Grammatical Sentences2 is 100 No retakes Is This Sentence Grammatical? You'll be given sentences and have to decide whether or not they are grammatical. Requester is a member of TurkerNation
148 05/26/2020 Jade Yu Native English Speaker Qualification Test (01) Native English Speaker Qualification Test (01) EqualTo 100 Once you start, you won’t be allowed to retake this test. Symmetry of English Sentences Rate degrees of symmetry for sentence pairs
149 01/07/2020 Supernova Trend Validation Test Trend Validation Test GreaterThanOrEqualTo 70 Once you start, you won’t be allowed to retake this test. Trend Validation Following are some tweets that were extracted from a set of tweets. Each set of keywords come with a few tweets. Validate if the keywords together are any kind of current trends Rejections reported earlier, have since been reversed.
150 01/07/2020 new-admin atEvent Transcription Qualification HIT approval rate (%) GreaterThan 70; atEvent Transcription Qualification EqualTo 100 You will have to wait 1 minute if you wish to retake this test. Business Card Reader Transcribe the text contained in the Business Card.
151 01/08/2020 Caleb Cyberbullying detection score Cyberbullying detection score GreaterThanOrEqualTo 80; Bot list DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 500; HIT approval rate (%) GreaterThanOrEqualTo 98; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Identifying cyberbullying on Twitter (WARNING: This HIT may contain adult content. Worker discretion is advised.) You can help identify cyberbullying and non-cyberbullying cases on Twitter by classifying tweets according to 5 important criteria
152 01/14/2020 MPI Dept of Perceiving Systems Consent agreement for Can you mimic the pose? version 2 Consent agreement for Can you mimic the pose? version 2 EqualTo 100 Once you start, you won’t be allowed to retake this test. Can you mimic the pose Mixed TO, proceed with caution
154 01/14/2020 Ai2 Israel Consecutive Sentences - Entailment Total approved HITs GreaterThanOrEqualTo 5000; HIT approval rate (%) GreaterThanOrEqualTo 99; Location In AU, CA, GB, US, Consecutive Sentences - Entailment equal to 100 Once you start, you won’t be allowed to retake this test. Answer a question about two sentences Given you know that the first sentence is true, is the second sentence also true? Requester is a member of Turker Nation
156 01/17/2020 Brex Business Identification Test Total approved HITs GreaterThan 200; Business Identification Test GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 95 You will have to wait 5 minutes if you wish to retake this test. Identify this business (12 cent bonus for matched answer!) Based on the information provided, determine the correct name of the business / merchant and its website. (12 cent bonus if your answer matches another independent worker's!)
157 01/24/2020 Kyle Harris Get Data from a PDF and the Web Location In AO, AS, AU, BD, CA, FJ, GB, GI, JM, KY, MP, NZ, PK, TO, TT, US; Total approved HITs GreaterThanOrEqualTo 700; Get Data from a PDF and the Web GreaterThanOrEqualTo 70; HIT approval rate (%) GreaterThanOrEqualTo 98 Once you start, you won’t be allowed to retake this test. Review legal complaint for contact information. Review the given pdf file containing a legal complaint and collect the information as requested. Some information requires some searching the internet.
158 01/24/2020 RPI facs AU1 (Inner Brow Raiser) BP4D+ Onset AU1 (Inner Brow Raiser) BP4D+ Onset is greater than 7 You will have to wait 1 minute if you wish to retake this test. Not known Not known
159 01/24/2020 Ai2 Israel Consecutive Sentences - Entailment, flip Total approved HITs GreaterThanOrEqualTo 5000; Location In AU, CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99; Consecutive Sentences - Entailment, flip EqualTo 100 Once you start, you won’t be allowed to retake this test. Answer a question about two sentences Given you know that the first sentence is true, is the second sentence also true? Requester posts on TN
160 01/24/2020 Reef Diver Reef Classfication - Qualification Test (QUT)623 Reef Classfication - Qualification Test (QUT)623 GreaterThanOrEqualTo 60 1 minute Coral Reef Image Classification Identify coral reef features on photos from the Great Barrier Reef. (15 points per image … Est 1 min) Quote from Requester, "FYI Assignments are rejected when they get very poor accuracy regardless of the Worker history and eventually this could happen to anyone. We are mindful of this and hoping to limit the number of rejections in the future."
161 01/24/2020 RealCME Health discussion screening survey Health discussion screening survey GreaterThanOrEqualTo 70; Health presentation participant DoesNotExist ; Location EqualTo US Once you start, you won’t be allowed to retake this test. A health coach presentation and assessment For this HIT, qualified workers will complete a 15 to 30 minute coaching activity about their health. Please enter the code provided at the end of the survey to submit.
162 01/24/2020 Northeastern U. DataVis Studies SQL qualification test SQL qualification test GreaterThanOrEqualTo 66; Worker attempted/completed Understanding SQL Queries -- $5.20 to $16.47 with bonuses HIT previously DoesNotExist ; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US Once you start, you won’t be allowed to retake this test. Understanding SQL Queries -- $5.20 to $16.47 with bonuses
163 01/27/2020 BIU NLP Paraphrases alignment Paraphrases alignment EqualTo 100; Total approved HITs GreaterThanOrEqualTo 1000; HIT approval rate (%) GreaterThanOrEqualTo 90 Once you start, you won’t be allowed to retake this test Annotate alignment between predicate paraphrases Annotate whether two predicates are entailment or not
164 01/27/2020 vainu Find social media company page links for a company Total approved HITs GreaterThanOrEqualTo 100; Find the Facebook page of the company blacklist DoesNotExist ; Find social media company page links for a company GreaterThanOrEqualTo 95; HIT approval rate (%) GreaterThanOrEqualTo 90 1 Day Find the Facebook page of the company Find the Facebook page of the company by googling with the company name
165 01/27/2020 vainu Company websites (SWE) 190114 Total approved HITs GreaterThanOrEqualTo 100; What kind of website is this? 9ad0fc812a614879b383fbb1b5e9c88f blacklist DoesNotExist ; Company websites (SWE) 190114 GreaterThanOrEqualTo 99; HIT approval rate (%) GreaterThanOrEqualTo 90 1 Day What kind of website is this? In this HIT, your task is to determine what category does a website belong to.
166 01/27/2020 komachi_lab Architecture HIT approval rate (%) GreaterThan 80; Architecture EqualTo 100; Location EqualTo US 7 days Determine if sentences require reference. Step1: Read a sentence. /Step2: Think about whether you can trust informations of sentence. /Step3: Evaluate the degree that can be trusted by 1 to 4.
167 05/16/2022 Varieties of Egalitarianism VoE_en_United Kingdom Location In GB, IE; VoE_en_United Kingdom GreaterThanOrEqualTo 70; VoE_performance NotIn 1 No retakes Statements about inequality, social justice and equal treatment Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? This is the test for the UK, but also accessible to those located in Ireland. Separate test also available for Ireland. (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned.
169 01/27/2020 Allen NLP narrativeqa Total approved HITs GreaterThanOrEqualTo 5000; narrativeqa Exists ; Location In CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99 Once you start, you won’t be allowed to retake this test. Judge whether two answers are the same Read a short paragraph, and determine whether two answers are equal with respect to a question.
170 01/28/2020 David Elling Word Rating Task Qualification HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Word Rating Task Qualification Exists ; Location EqualTo US; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Rate offensiveness of words Go through a list of 10 words and for each one, rate how offensive it is on a scale of 1 (not offensive at all) to 10 (highly offensive)
172 01/31/2020 Supernova Grammar Check Not known 2 hours Not known not known Some HITs rejected and later reversed. Proceed with caution
174 02/10/2020 Patrik Jonell Demographic qualification Demographic qualification Exists ; Total approved HITs GreaterThan 10000; HIT approval rate (%) GreaterThan 98; Has done this or similar HIT DoesNotExist ; qualification: 3236663131 Exists Once you start, you won’t be allowed to retake this test. Experiment Rating virtual character gesticulation
175 02/11/2020 FA-Turkmaster Pre-Screened (copy editing) Copy Editor DoesNotExist ; Pre-Screened (copy editing) GreaterThanOrEqualTo 80; Location EqualTo US; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Copy Editing Screener This HIT is used to screen for potential future copy editing HITs at a higher reward. Edit several answers to questions correcting spelling, grammar, casing, punctuation, etc. Adult Content Qualification (See 03/21/2019 in this table)
176 02/11/2020 FA-Turkmaster Screened (opened packaging) Screened (opened packaging) GreaterThanOrEqualTo 80; Location EqualTo US; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Product Photo Verification (WARNING: This HIT may contain adult content. Worker discretion is advised.) BATCH: 850458 Answer 2 questions about a given photo. Adult Content Qualification (See 03/21/2019 in this table)
177 02/11/2020 Matt Garner ShopHero Grocery Product Image Transcription Qualification v1 ShopHero Grocery Product Image Transcription Qualification v1 GreaterThanOrEqualTo 1; Location NotEqualTo IN; HIT approval rate (%) GreaterThanOrEqualTo 95 You will have to wait 1 day if you wish to retake this test. Transcribe Product Details from Product Image Update product brand, name, and package size from product image
178 02/11/2020 Alexa Shopping NLP Research ShoppingDialogDataUsageAcknowledgement Total approved HITs GreaterThanOrEqualTo 100; ShoppingDialogMaxHITsPerWorker DoesNotExist ; ShoppingDialogDataUsageAcknowledgement GreaterThanOrEqualTo 0; HIT approval rate (%) GreaterThanOrEqualTo 80; Location EqualTo US Once you start, you won’t be allowed to retake this test. Shopping Dialog 1_1 Teach a conversational agent to find better products with your voice.
179 02/15/2020 Michael Mayfield Grammar Test Grammar Test GreaterThanOrEqualTo 80 Once you start, you won’t be allowed to retake this test. Correct this sentence Correct the sentence as necessary.
180 02/17/2020 CEL CEL Qualification Total approved HITs >= 100, CEL Qualification EqualTo 100, HIT approval rate (%) >= 98, Location EqualTo US, Once you start, you won’t be allowed to retake this test. Academic psychology study Women (~5-10 minutes) This study has a prescreening qualification test that should take less than 30 seconds.
181 02/21/2020 Servify US Image filtering QR1 Image filtering QR1 GreaterThanOrEqualTo 90; Total approved HITs GreaterThanOrEqualTo 10000; HIT approval rate (%) GreaterThanOrEqualTo 99 5 minutes Batch 1/4. Front Panel Image filter The given image is of the Front Panel of a smartphone. Do you see any cracks? Choose 'Yes' if it has cracks. Else, choose 'No'. Requester is a member of TurkerNation
182 02/23/2020 AudioKite Likes Pop / Dance Likes Pop / Dance GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a pop song and answer a survey about it. A musician or label is seeking feedback on a pop song from people in the United States who enjoy pop music. Listen to the song for at least 30 seconds and answer a survey about it.
183 02/23/2020 AudioKite LIKESJAZZ LIKESJAZZ GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a jazz-blues song and answer a survey about it. A musician or label is seeking feedback on a jazz-blues song from people in the United States who enjoy jazz-blues music. Listen to the song for at least 30 seconds and answer a survey about it.
184 02/25/2020 AudioKite Likes Hip Hop / Rap / R&B Likes Hip Hop / Rap / R&B GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a hiphop-rap song and answer a survey about it. A musician or label is seeking feedback on a hiphop-rap song from people in the United States who enjoy hiphop-rap music. Listen to the song for at least 30 seconds and answer a survey about it.
185 02/25/2020 AudioKite Genre Category: Instrumental Genre Category: Instrumental GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a instrumental song and answer a survey about it. A musician or label is seeking feedback on a instrumental song from people in the United States who enjoy instrumental music. Listen to the song for at least 30 seconds and answer a survey about it.
186 02/25/2020 AudioKite Likes Folk Music Likes Folk Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a folk song and answer a survey about it. A musician or label is seeking feedback on a folk song from people in the United States who enjoy folk music. Listen to the song for at least 30 seconds and answer a survey about it.
187 03/01/2020 AudioKite Likes Country Music Likes Country Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a country song and answer a survey about it. A musician or label is seeking feedback on a country song from people in the United States who enjoy country music. Listen to the song for at least 30 seconds and answer a survey about it.
188 03/01/2020 AudioKite Likes Electronic / Avant-Garde Likes Electronic / Avant-Garde GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a electronic song and answer a survey about it. Listen to a electronic song and answer a survey about it.
189 03/01/2020 AudioKite Genre Category: Other Genre Category: Other GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US less than a minute Listen to a other song and answer a survey about it. A musician or label is seeking feedback on a other song from people in the United States who enjoy other music. Listen to the song for at least 30 seconds and answer a survey about it.
190 03/01/2020 justin cechmanek Bounding Boxes Around Holes Once you start, you won’t be allowed to retake this test. Draw bounding boxes tightly around screw and bolt holes in PCBs Draw bounding boxes tightly around screw and bolt holes in printed circuit boards (PCBs) Proceed with caution, appears to have affiliation with Bright Machines. However, has not shown rejections yet, so they might be turning over a new leaf.
191 03/07/2020 Virginia Tech Cloud Interpretation Group Tree Canopy Classification Qualification Not known Not known Photo interpretation of tree canopy using dot grid We will test the use of crowdsourced photo interpretations of canopy cover to validate national products. Crowd-workers will interpret percent TCC using a 100-dot-grid overlain on 1-meter NAIP imagery. Requester is a member of Turker Nation.
192 03/23/2020 Guanlong american_accent_pretest_2020 Participated in Mel audio quality test 2020 DoesNotExist ; american_accent_pretest_2020 EqualTo 3; Location EqualTo US Once you start, you won’t be allowed to retake this test. Rate audio quality of speech recordings [~15min to finish; fast-approval] Please rate the audio quality of the given sound clips following the instructions in the HIT. Worry-free submission -- automatically checks for unfinished questions before submitting! Fast approval. Good reviews from previous participants.
193 03/23/2020 UKP Lab, TU Darmstadt (aka Tilman Beck) Argument Annotation Qualification (real) Not known Once you start, you won’t be allowed to retake this test Rating arguments for given topics Not known
194 03/23/2020 komachi_lab https://worker.mturk.com/qualifications/3EZ90CUA4SQ9SEB29ZY4EW3RWY3WIF Enginnering Enginnering EqualTo 100; HIT approval rate (%) GreaterThan 80; Location EqualTo US You will have to wait 7 days if you wish to retake this test. Determine if sentences require reference. Step1: Read a sentence. /Step2: Think about whether you can trust informations of sentence. /Step3: Evaluate the degree that can be trusted by 1 to 4.
195 03/28/2020 Whooosreading.org Identify which sentence contains the most text detail Identify which sentence contains the most text detail GreaterThanOrEqualTo 80 Once you start, you won’t be allowed to retake this test. Pick the most detailed sentence The following sentences were pulled from responses to some open-ended questions about a book. Please read each pair of sentence and select the one that gives the most factual information about the book. You need this qual to take the qual HITs. Please note that rejections were reported in the past but he seems to be better now.
196 04/18/2020 Ai2 Israel sentence similarities Total approved HITs is equal or greater than 5000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location is one of AU, CA, GB, US, sentence similarities is 100 Once you start, you won’t be allowed to retake this test. Answer questions about two similar sentences you will be presented with multiple Yes/No questions, based on two similar sentences Requester posts and answers questions at TurkerNation.
197 05/04/2020 AudioKite Genre Category Children's Genre Category: Children's GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, You will have to wait less than a minute if you wish to retake this test. Listen to a childrens song and answer a survey about it
198 05/04/2020 AudioKite Likes Hard Rock / Heavy Metal Music Likes Hard Rock / Heavy Metal Music GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, You will have to wait less than a minute if you wish to retake this test. Listen to a hard-rock song and answer a survey about it
199 05/04/2020 AudioKite Likes EDM / Dance Music Likes EDM / Dance Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US You will have to wait less than a minute if you wish to retake this test. Listen to a edm-dance song and answer a survey about it
200 05/05/2020 AudioKite Likes Indie / Rock / Alternative Likes Indie / Rock / Alternative GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, less than a minute Listen to a indie-alternative song and answer a survey about it A musician or label is seeking feedback on a indie-alternative song from people in the United States who enjoy indie-alternative music.
201 05/05/2020 Plancky Public Data Test Masters Exists, Public Data Test GreaterThan 100 Once you start, you won’t be allowed to retake this test. Does the business have any arcade games on premises? Choose the appropriate category that best suits the company. Use any text, reviews, photos, etc.
202 05/05/2020 EX Research Test task #1 Test task #2 GreaterThanOrEqualTo 10, Test task #3 GreaterThanOrEqualTo 10, Test task #1 GreaterThanOrEqualTo 10, Once you start, you won’t be allowed to retake this test. Find the correct LinkedIn profile of an Attorney This is an easy task. It should take you less than 5 minutes. But it requires you to have a LinkedIn account (sign up is free at www.linkedin.com) and it requires you to pay attention to details. Requires you to have a LinkedIn account
203 05/08/2020 COG Annotations Cone Q Medical Test Cone Q Medical Test GreaterThanOrEqualTo 2 , HIT approval rate (%) GreaterThanOrEqualTo 75, Medical Image Hand Key-point Annotations (~7-8 minutes) Please proceed only if you are comfortable viewing images from an operating room. You will be task with placing bounding boxes and markers on joints of hands in single images. Submit after annotating frame.
204 05/08/2020 Aristo Verify the plausibility of the middle sentence Location In AUGBUS, Total approved HITs GreaterThanOrEqualTo 10000, Verify the plausibility of the middle sentence GreaterThanOrEqualTo about 6 hours Verify the plausibility of the middle sentence (pilot 2) n this HIT, you will be shown a short 3-sentence story. The task requires you to mark if the middle sentence is correct.
205 05/08/2020 DanielHendrycks Utiliarianism Qualification Round Utiliarianism Qualification Round GreaterThanOrEqualTo 31 1 day Write scenarios then rank them by how enjoyable they are. Write scenarios of varying degrees of pleasantness. Then rank these four scenarios by how enjoyable they are to the person in the scenarios.
206 05/08/2020 Fritz&Hammer Crowdsourcing Simple Breach Global Soft Block DoesNotExist, Simple Breach GreaterThanOrEqualTo 79 Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location EqualTo US, Adult Content Qualification EqualTo 1 about 1 month Does a document describe a data security breach? Read a document and determine whether it describes a data security incident (expected duration ~1 minute, no adult content) Requires Adult Content Qualification (See 03/21/2019 in this table)
207 05/08/2020 PFT Language ES Language ES GreaterThanOrEqualTo 100 5 minutes [Español] Clasificar una frase generada por el usuario [Español] Clasifique una oración generada por el usuario dependiendo de si la intención que expresa es la misma que otras oraciones de ejemplo.
208 05/08/2020 PFT Language EN Location EqualTo ES, Language EN GreaterThanOrEqualTo 100 5 minutes [Español] Clasificar una frase generada por el usuario [Español] Clasifique una oración generada por el usuario dependiendo de si la intención que expresa es la misma que otras oraciones de ejemplo.
209 05/08/2020 Anurag Das American accent test American accent test EqualTo 100 accent test batch 1 DoesNotExist Once you start, you won’t be allowed to retake this test. Test on voice and/or accent similarity Please rate the similarity of the voice/accent of the sounds in each pair
210 05/08/2020 AudioKite Genre Category: Punk Genre Category: Punk GreaterThanOrEqualTo 1 less than a minute Listen to a punk song and answer a survey about it. A musician or label is seeking feedback on a punk song from people in the United States who enjoy punk music. Listen to the song for at least 30 seconds and answer a survey about it. The qualification test is to confirm you enjoy listening to the designated genre.
211 05/08/2020 GMM Benchmark Image Label Qualification Test Faces Dataset Evaluated DoesNotExist, Image Label Qualification Test GreaterThan 64 Once you start, you won’t be allowed to retake this test. Determine whether the images are real or fake Decide whether each image is real or a computer generated fake. Workers will be given a $0.02 bonus for each correct answer.
212 05/08/2020 AudioKite Likes R&B Music Likes R&B Music GreaterThanOrEqualTo 1 less than a minute Listen to a randb song and answer a survey about it. A musician or label is seeking feedback on a randb song from people in the United States who enjoy randb music. Listen to the song for at least 30 seconds and answer a survey about it.
213 05/08/2020 PFT Language DE Language DE GreaterThanOrEqualTo 100 Location EqualTo DE, Language EN 5 minutes [Deutsch] Formulieren Sie Sätze mit Ihren eigenen Worten um [Deutsch] Formulieren Sie Sätze mit Ihren eigenen Worten um
214 05/08/2020 PFT Language IT Language IT GreaterThanOrEqualTo 100 Location EqualTo IT, Language EN GreaterThanOrEqualTo 100 5 minutes [Italiano] Riformulate le frasi con parole vostre [Italiano] Riformulate le frasi con le vostre parole
215 05/08/2020 MLDataLabeler NamedEntityRecognitionTestScore NamedEntityRecognitionTestScore GreaterThanOrEqualTo 80 NamedEntityRecognitionSeparateQualHIT GreaterThanOrEqualTo 80, 9f9cab21-bb6b-4f3b-8f76-533778e3f752 DoesNotExist, WorkersBlockedDueToPoorWorkQuality DoesNotExist 1 day Select and label short bits of text Select parts of the text that correspond to the available categories
216 05/08/2020 vainu Find the website of a given company Total approved HITs GreaterThanOrEqualTo 100, Find the website of a company 7efa4e36178f4103876303ed072537a0 blacklist DoesNotExist, Find the website of a given company GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90 1 day Find the website of a company Search this company from google and find out
217 05/14/2020 Hot Shop English Tier 1 Total approved HITs GreaterThan 1000, English Tier 1 Exists Once you start, you won’t be allowed to retake this test. Write 60 words product description from images and title (good english required) Write a product description which describes the features and benefits of the given product to a customer. Used to reject, made a qual to reduce rejections. You'll need good English grammar and attention to detail. Also a rejection cushion would be good
218 05/21/2020 DanielHendrycks Obligations Qualification Type Obligations Qualification Type GreaterThanOrEqualTo 31, Location In CAGBUS, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 499 You will have to wait 1 day if you wish to retake this test. Write Requests and Reasonable or Unreasonable Excuses Write a reasonable request or command. Then write reasonable and unreasonable excuses
219 05/14/2020 DanielHendrycks Virtue/Vice Qual Location In CAGBUS, Virtue/Vice Qual GreaterThanOrEqualTo 41, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 499 You will have to wait 5 days if you wish to retake this test. Write Scenarios Demonstrating Different Virtues and Vices Write scenarios that each demonstrate a different character trait/virtue/vice.
220 05/14/2020 Jared Johansen Convert text into robot instructions test Convert text into robot instructions test (Golden Level) DoesNotExist, Convert text into robot instructions test EqualTo 100, Total approved HITs GreaterThan 1000, Location In AUCAGBUS, HIT approval rate (%) GreaterThan 90 Once you start, you won’t be allowed to retake this test. Interpret directions into robot commands You are given a set of directions. Answer some questions about it and convert them into robot commands.
221 05/14/2020 AudioKite Likes World Music Likes World Music GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US You will have to wait less than a minute if you wish to retake this test. Listen to a world song and answer a survey about it. A musician or label is seeking feedback on a world song from people in the United States who enjoy world music. Listen to the song for at least 30 seconds and answer a survey about it.
222 05/14/2020 gmk34 DelibotOnboardingTest DelibotOnboardingTest GreaterThanOrEqualTo 100, Location In AU CA GB IE US, DelibotDONE DoesNotExist, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 Once you start, you won’t be allowed to retake this test. Chat and solve a problem! [up to 1.5$ BONUS for completing every step] (~10-15 mins) You will be part of a small-group chat between 3 people, where you will try solving a simple puzzle. Warning on TO regarding technical difficulty.
223 05/14/2020 Jared Johansen Convert text into robot instructions test v2 Convert text into robot instructions test (Golden Level) DoesNotExist, Total approved HITs GreaterThan 100, Location In AU CA GB US, Convert text into robot instructions test v2 EqualTo 100, HIT approval rate (%) GreaterThan 90 Once you start, you won’t be allowed to retake this test. Interpret directions into robot commands You are given a set of directions. Answer some questions about it and convert them into robot commands.
224 05/14/2020 AudioKite Genre Category: Christian Genre Category: Christian GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US :heavy_plus_sign: 1 You will have to wait less than a minute if you wish to retake this test. Listen to a christian song and answer a survey about it A musician or label is seeking feedback on a christian song from people in the United States who enjoy christian music. Listen to the song for at least 30 seconds and answer a survey about it.
225 05/14/2020 SG AMT ContentDisclaimer ContentDisclaimer GreaterThanOrEqualTo 100 You will have to wait less than a minute if you wish to retake this test. QUALIFICATION TASK - What emotion do you hear in this audio? Listen to short (~2sec) audio clips and choose from a list of emotions. This is the unpaid qualification task, it takes around 5 minutes and is required for working on paid HITs
226 05/14/2020 Ria TookCovid19Test TookQuizOnCOVID19 DoesNotExist, TookCovid19Test Exists Once you start, you won’t be allowed to retake this test. Collaborative Fact Checking Fact checking of statements about COVID-19 and image identification
227 05/25/2020 Brandon Consent_Agreement Consent_Agreement EqualTo 1, Masters Exists, Adult Content Qualification EqualTo 1 You will have to wait less than a minute if you wish to retake this test. Semantic Similarity of Documents Classification of documents based on the sentiment of the text. Requires Masters and the Adult Content Qualification (See 03/21/2019 in this table)
228 05/25/2020 DanielHendrycks Desert Task Qualification Type. Location In CA GB US, HIT approval rate (%) GreaterThan 97, Desert Task Qualification Type. GreaterThanOrEqualTo 41, Total approved HITs GreaterThan 999 You will have to wait 1 day if you wish to retake this test. Write About Things That People Deserve or Dont Deserve Write sentences about deserving or being entitled to something. The sentences should say what the person thinks they deserve, from whom they deserve it, and why they deserve it.
229 05/25/2020 DanielHendrycks Impartiality Task Qualification Type. Location In CA GB US, HIT approval rate (%) GreaterThan 97, Impartiality Task Qualification Type. GreaterThanOrEqualTo 51, Total approved HITs GreaterThan 999 You will have to wait 1 day if you wish to retake this test. Write about how a character usually treats someone else. Write about how a character usually treats someone else and write justifications for treating someone differently.
230 05/25/2020 Ju Yeon Park SenateConfirmationQualTest SenateConfirmationQualTest GreaterThanOrEqualTo 8, Masters Exists Once you start, you won’t be allowed to retake this test. Compare Confirmation Hearing Statements This task involves reading two statement excerpts from congressional confirmation/nomination hearings in 1997-2018 and choose the relatively more positive statement. Masters
231 05/30/2020 Ai2 Israel ADVCL classification - qualification ADVCL classification - qualification GreaterThan 90 HIT approval rate (%) GreaterThan 99, Total approved HITs GreaterThan 5000, Location In AU CA GB NZ US, Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Adverbial-clause subject classification (WARNING: This HIT may contain adult content. Worker discretion is advised.) Identify who is doing action of the marked verb, among the bolded words?
232 05/30/2020 D Labs Gender Labelling Qualification Gender Labelling Qualification GreaterThanOrEqualTo 90 about 3 hours Labelling Gender of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely gender caution, past TO history shows rejections.
233 05/30/2020 D Labs Age Labelling Qualification Age Labelling Qualification GreaterThanOrEqualTo 90 about 3 hours Labelling Age of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely age Caution, past TO shows rejections
234 05/30/2020 VEVO Administrator - Production Video safety classification qualification - images Total approved HITs GreaterThanOrEqualTo 100, Location In AU CA GB US, HIT approval rate (%) GreaterThanOrEqualTo 99, Adult Content Qualification EqualTo 1 Video safety classification qualification - images GreaterThanOrEqualTo 99 3 minutes Give parental-guide ratings (G, PG, TV-14, TV-MA) to a group of images based on suitability for various aged audiences - V2 Give parental-guide ratings (G, PG, TV-14, TV-MA) to a group of images based on suitability for various aged audiences
235 05/30/2020 Dominic Duxbury Harbour Management Harbour Management Qualification GreaterThan 80 Once you start, you won’t be allowed to retake this test. Harbour Management Task and Questionnaire You must manage a harbour using software then fill in a questionnaire about your experience. We request each worker only completes this once.
236 05/30/2020 Sticky Age Age LessThanOrEqualTo 70 Location EqualTo US, Age GreaterThanOrEqualTo 18 1 day Fast and easy content viewing (few minutes for possible $0.60) - EG7to43ebOqkM6jC7xAIn Look at some content for a few minutes to help us improve our measurements.
237 05/30/2020 UMD Linguistics Research Group Test for native proficiency in American English, v2.0 Test for native proficiency in American English, v2.0 GreaterThanOrEqualTo 7 HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, H&I prevent retake DoesNotExist less than a minute Anteater: Judge sentences as good or bad! Quick 30-minute task: read sentences and judge whether they are acceptable, natural sentences of English.
238 05/30/2020 pucccp Convert text into robot instructions test v5 Convert text into robot instructions test (Golden Level) DoesNotExist, Location In AU CA GB IE IN NZ US, Convert text into robot instructions test v5 EqualTo 100 Convert text into robot instructions test (Bronze Level) DoesNotExist 1 minute Interpret directions into a robot plan (~2 min) You are given a set of directions. Convert them into commands a robot understands.
239 06/11/2020 BIU NLP Grammatical or Not Grammatical or Not GreaterThan 60, HIT approval rate (%) GreaterThan 60, Location EqualTo US Once you start, you won’t be allowed to retake this test. Rate Auto-Generated Movie Plots Rate 3 different generated movie plots, according to given criterions
240 06/11/2020 Imperial NLP Survey Completion Test Survey Completion Test EqualTo 100, Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Is this content toxic? Does the content that appears show toxic behaviour or not?
241 06/11/2020 Ria EnglishProficiency EnglishProficiency LessThan 80 Once you start, you won’t be allowed to retake this test. Revise AI-generated text (For non-expert English speakers) Revise 9 AI-generated paragraphs For non-expert English speakers
242 06/11/2020 f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 Reputation_Polarity_v3 message-us-to-proceed DoesNotExist, Reputation_Polarity_v3 GreaterThan 95, Masters Exists, recent-accuracy-twitter GreaterThan 70, z-questions-answered GreaterThan 200, cross-polarity-score GreaterThan 80 You will have to wait about 6 hours if you wish to retake this test. Judge the reputation polarity of Article Clips Judge the reputation polarity of Article Clips. The qualifications here can be earned by answering our twitter reputation polarity dataset and are updated daily. Masters plus must find other qual HITs as explained in Description
243 06/11/2020 Dialogue MTurk Admin Ask a Question based on Public Health Passage Ask a Question based on Public Health Passage from CDC website Exists ; Location In AU, CA, GB, US; Total approved HITs GreaterThan 5000; HIT approval rate (%) GreaterThanOrEqualTo 98 None Ask public health and COVID related questions - UK Passage batch; (~ 1 - 1.5 minute) ($8 - 12 dollar per hour) Given some passage from UK govt or NHS website, ask a question whose answer is the almost same as the given passage Has many batches for this qual test. Requester is member of TurkerNation and says that he does not reject good work.
244 06/11/2020 PFT Language NL Language NL GreaterThanOrEqualTo 100, Location EqualTo NL, Language EN GreaterThanOrEqualTo 100 You will have to wait 5 minutes if you wish to retake this test. [Nederlands] Herformuleer zinnen met je eigen woorden [Nederlands] Herformuleer zinnen met je eigen woorden For Language EN test see 5/8/2020 in this table.
245 06/23/2020 Imperial NLP Survey Completion Test (Comment Only) Adult Content Qualification EqualTo 1 Survey Completion Test (Comment Only) EqualTo 100 Once you start, you won’t be allowed to retake this test. Is this content toxic? (adult content) Based on a sample decide whether the content that appears shows toxic behaviour.
246 06/23/2020 Philip Huff Common Product Enumeration (CPE) Mapping Common Product Enumeration (CPE) Mapping GreaterThanOrEqualTo 40 1 day Find Common Product Enumerators (CPEs) for SNMP strings Use the SNMP string and context data to find a matching CPE string from the National Vulnerability Database. There are 2 concurrent groups. Please only choose 1.
247 06/23/2020 Pingchuan Ma Shot_Test Shot_Test GreaterThanOrEqualTo 90 2 minutes Choose the correct category for the video Choose the place where the video is taking place
248 06/23/2020 BIU NLP NLI Logic Games 14q-test HIT approval rate (%) GreaterThan 96, Location In AU CA GB US ZA, NLI Logic Games 14q-test GreaterThanOrEqualTo 84 about 3 hours NLI Logic Games Location (adrian) Given a sentence taken from the web, write your own sentences that is definitely correct about the situation or event from the given sentence
249 06/23/2020 Erin Text similarity batch 1 ext similarity batch 1 EqualTo 100 Hit limit DoesNotExist, Total approved HITs GreaterThanOrEqualTo 2000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US Once you start, you won’t be allowed to retake this test. Rate topic similarity in texts Rate the similarity of portions of U.S. presidential debates.
250 06/23/2020 BIU NLP NLI Logic Games Test Location NLI Logic Games Test Location GreaterThanOrEqualTo 90 HIT approval rate (%) GreaterThan 96, Location In AU CA GB US ZA 2 minutes NLI Logic Games Location Given a sentence taken from the web, write your own sentences that is definitely correct about the situation or event from the given sentence
251 06/23/2020 A transportation company Transportation Test Transportation Test GreaterThanOrEqualTo 10; Total approved HITs GreaterThanOrEqualTo 3000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 97 Once you start, you won’t be allowed to retake this test. reasonable-crowd Help us improve the quality of our transportation system
252 06/25/2020 MPI Dept. of Perceiving Systems Consent_Agreement_Mimicking_Human_Poses_20200528 Consent_Agreement_Mimicking_Human_Poses_20200528 EqualTo 100 Once you start, you won’t be allowed to retake this test. Can you mimic the pose? In this task you will be asked to 1) mimic a human pose, 2) take or have taken a picture of yourself in this pose, and 3) upload the picture.
253 06/25/2020 Ai2 Israel Entity Tracking training Entity Tracking training GreaterThanOrEqualTo 100 Total approved HITs GreaterThanOrEqualTo 2000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US about 3 hours Entity Tracking in Texts Tracking of mentions of the same entity in texts. An interesting task for native English speakers who are interested in linguistics and AI. This batch of HITs is a pilot (many more to come!). Random guesses not approved!
254 06/25/2020 Luwei label intrusion qualification Masters Exists, label intrusion qualification GreaterThanOrEqualTo 7 Once you start, you won’t be allowed to retake this test. Pick out the most irrelevant label For each HIT, you will see one short passage and four labels. Three of the labels will be related to the passage, but the other one will be out of place. Your job is to pick up the one label that seems LEAST related to the passage.
255 07/13/2020 John Gaddy Grammar Test Grammar Test GreaterThanOrEqualTo 40 HIT approval rate (%) GreaterThanOrEqualTo 97 Once you start, you won’t be allowed to retake this test. Write a short blog post on a specified topic Write a 300+ word blog post on a specified topic.
256 07/13/2020 UW Gaming Research Lab Eligibility Questions1 Location In AU CA GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 96 Once you start, you won’t be allowed to retake this test. Overwatch Player Experiences and Loot Box Use Answer questions about your thoughts, feelings and experiences opening loot boxes
257 07/13/2020 Coronavirus QA Research Feedback about COVID Chatbot Feedback about COVID Chatbot GreaterThanOrEqualTo 75; Total approved HITs GreaterThan 1000; Location In CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 98 Give feedback on our COVID-19 question answering system Rate and explain how well our bot answers questions about COVID-19
258 07/13/2020 Luwei top eight word set intrusion qualification Masters Exists, top eight word set intrusion qualification GreaterThanOrEqualTo 7 Once you start, you won’t be allowed to retake this test. Pick out the most irrelevant word set For each HIT, you will see ONE short passage and four word sets. Three of the word sets will be related to the passage, but the other one will be out of place. Your job is to pick up the one word set that seems LEAST related to the passage.
259 07/13/2020 [email protected] Evidence Selection for QA - qualification Location In US-AL US-AR US-DE US-FL US-GA US-IA US-KS US-KY US-LA US-MD US-MN US-MO US-MS US-ND US-NE US-OK US-SC US-SD US-TN US-TX US-VA US-WV, Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 95 1 hour Evidence Selection for QA Select the evidence needed to answer a question Noah accounts sometimes reject.
260 08/03/2020 Research Spanish formality qualification test Spanish formality qualification test GreaterThanOrEqualTo 70, Location In CA MX US Once you start, you won’t be allowed to retake this test. Spanish task: Formal rewrite of an informal sentence Generate a formal rewrite of an informal sentence in Spanish
261 08/03/2020 nlu.team Reasoning_warrant_collection Location NotIn IN, Location NotIn BD, Total approved HITs GreaterThanOrEqualTo 5000, Reasoning_warrant_collection EqualTo 100, HIT approval rate (%) GreaterThanOrEqualTo 99 Once you start, you won’t be allowed to retake this test. Do you know why Zoos should be banned ? This task requires you to write your reasonings for arguments on the topic: Ban Zoos.
262 08/17/2020 Cathrine Message Tone Detection v2 Respectful/Disrespectful tone identification performance DoesNotExist ; Message Tone Detection v2 GreaterThanOrEqualTo 85 Once you start, you won’t be allowed to retake this test. Identifying respectful/disrespectful message tone (qualification) Review messages taken from online classification and identify their tone as respectful/disrespectful
263 08/17/2020 Zazzle AWS Rate Image Style Triangle Qualification Unconventional Triangle DoesNotExist ; Total approved HITs GreaterThan 500; HIT approval rate (%) GreaterThanOrEqualTo 99; Location EqualTo US; Prevent Retake Style Triangle DoesNotExist 5 minutes Rating Image Styles Triangle (10 designs) This HIT involves rating the main styles in 10 designs by how realistic, simplified, and abstract they are. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px; The task will not load otherwise.
264 08/24/2021 Zazzle AWS Rate Image Style Artistic Marks Qualification Rate Image Style Artistic Marks Qualification (7/19/2019) EqualTo 100; Total approved HITs GreaterThan 1000; HIT approval rate (%) GreaterThanOrEqualTo 99; Unconventional Artistic Marks DoesNotExist ; Location EqualTo US 30 minutes Rating Image Styles Artistic Marks (10 designs) This HIT involves rating 10 designs by artistic marks. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px.
265 08/17/2020 Zazzle AWS Rate Image Style Negative Space Qualification Rate Image Style Artistic Marks Qualification (7/19/2019) EqualTo 100; Total approved HITs GreaterThan 1000; HIT approval rate (%) GreaterThanOrEqualTo 99; Unconventional Artistic Marks DoesNotExist ; Location EqualTo US 30 minutes Rating Image Styles Negative Space (10 designs) This HIT involves rating 10 designs by negative space. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px.
266 08/17/2020 George Stoica Relation Extraction Qualification Test 1 Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThanOrEqualTo 95, Adult Content Qualification EqualTo 1 10 minutes Relation Extraction WARNING: This HIT may contain adult content. Worker discretion is advised. Determine relationship between subject and object in sentence.
267 08/17/2020 AudioKite Genre Category: Comedy Music Genre Category: Comedy Music GreaterThanOrEqualTo 1 HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US less than a minute Listen to a comedy song and answer a survey about it. Listen to the song for at least 30 seconds and answer a survey about it. NOTE: The qualification test is to confirm you enjoy listening to the designated genre.
268 09/05/2020 ISI VISTA Lab Labeling ad hominems in conversations v2 Labeling ad hominems in conversations v2 EqualTo 6; Total approved HITs GreaterThan 1000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 95; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. 20-30 sec task labeling conversations v2 (warning: may contain offensive content) Label ad hominems (personal attacks) in conversations
269 09/05/2020 George Stoica org2locmulti Qualification Test Already Completed HITs DoesNotExist, Total approved HITs GreaterThan 500, org2locmulti Qualification Test GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 95, Adult Content Qualification EqualTo 1 5 minutes Relation Extraction WARNING: This HIT may contain adult content. Worker discretion is advised. Determine relationship between subject and object in sentence. *Impossible Qualification Test bug is fixed*
270 09/05/2020 BIU NLP hexagon-app-collection advanced-hexagon-app-verification DoesNotExist, hexagon-app-collection-expired DoesNotExist, Location In AU CA GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 about 4 hours Hexagon Board tasks (writing and drawing) (P01RS04) Write instructions for how to draw a given image drawn on a kid drawing board game (paved with hexagonal tiles). Afterwards, you should carry out your instructions step by step on an empty board game
271 09/05/2020 Evan Hernandez detailed image summarizer Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 90, Location EqualTo US 2 minutes Summarize a set of image regions Summarize what is shown in a set of image regions.
272 09/05/2020 BIU NLP Sentence Typing Task - P HIT approval rate (%) GreaterThanOrEqualTo 80, Location EqualTo US Once you start, you won’t be allowed to retake this test. 3 * Sentence Typing Task - unavailable from mobiles/tablets! - Easy and quick Your job will be to type 3 sentences into an empty text-box.
273 09/07/2020 Aristo Answering elementary-school science questions (Sept 2). Location In AU,CA,GB,US, Total approved HITs >=10000, HIT approval rate (%) ?=99, Answering elementary-school science questions (Sept2).>=7 6 hours Indicate whether a given answer to elementary-school science questions is (yes/no)
274 09/29/2020 Itamar Jalon Podcast rating Test Ver 2 Podcast rating Test LessThanOrEqualTo 51 Location In CA US Once you start, you won’t be allowed to retake this test. Listen and rate podcasts for emotional content Listen to stories from podcasts and rate how emotional you find them to be, and what emotions they make you feel
275 09/29/2020 Wen Fan qualification test No repeats DoesNotExist, HIT approval rate (%) GreaterThan 90, qualification test EqualTo 100 Location US Once you start, you won’t be allowed to retake this test. Remote Work in the Time of COVID-19 (45-60 minutes) We are conducting an academic survey on remote work and need your input! Requirements: (1) have worked at home at some point after COVID-19, (2) eligible based on a 3-question prescreening. Contains many open-ended questions.
276 09/29/2020 AudioKite Genre Category: Funk HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US 1 minute Listen to a funk song and answer a survey about it. A musician or label is seeking feedback on a funk song from people in the United States who enjoy funk music. Listen to the song for at least 30 seconds and answer a survey about it.
277 09/29/2020 Maryam Mirzaei Intention Recognition-PreQualification Test otal approved HITs GreaterThanOrEqualTo 80, Completed my test already DoesNotExist, Intention Recognition-PreQualification Test GreaterThanOrEqualTo 70 Once you start, you won’t be allowed to retake this test. Intention Annotation Find the surface intention versus the real (hidden) intention of the given question in the context (2-3 minutes).
278 09/29/2020 Clark University - GPMI New England Water Quality Qualification v5 New England Water Quality Qualification v5 EqualTo 100 Location US New England Water Quality Survey The purpose of the survey is to find out if people like you would support management programs that would improve water quality in New England rivers and streams.
279 09/29/2020 Christian Meske Demographics [auto-granted] Demographics [auto-granted] GreaterThan 1 Once you start, you won’t be allowed to retake this test. Medical Image Labeling Counting of blood cells infected with malaria parasites in a blood sample image. No previous medical knowledge required! Estimated time of work: ~8 minutes. IMPORTANT: You can participate just once in this or our other uploaded HITs with the same title. Otherwise, we are afraid to reject your work.
280 11/13/2020 GSV Urban Data Lab GSV Building Conditions Qualification Test HIT approval rate (%) GreaterThanOrEqualTo 90, Location EqualTo US less than a minute GSV Buildings Pairwise Conditions Survey Determine whether the building in image is maintained.
281 11/17/2020 DonorDevices HDD Labeling Test Total approved HITs GreaterThan 200, NotOnBanListNew GreaterThan 0, HIT approval rate (%) GreaterThan 80, HDD Labeling Test GreaterThan 66 1 day Reading Text on Hard Drive Labels Simple transcription. Find serial numbers, model numbers, etc on hard drive labels and transcribe.
282 11/17/2020 DonorDevices PCB Labeling Test Total approved HITs GreaterThan 200, NotOnBanListNew GreaterThan 0, PCB Labeling Test GreaterThan 66 1 day Reading Text on Hard Drive Printed Circuit Boards Find number printed on PCB board and transcribe. Simple.
283 12/07/2020 Buckeye Linguistics Research https://worker.mturk.com/qualifications/35OXBT565DUZ4B1768EVHC0KOAD2VH multi_agent_dialog_1606609887_max_submissions DoesNotExist, ParlAIExcludeQual86374t14979 GreaterThanOrEqualTo 7111 10 minutes Complex Question Dialogue This task requires reading a tutorial and completing a qualification task, which will take 20-30 minutes.
284 12/07/2020 QA Research Chat about multiple topics -- v0.1 Chat about multiple topics -- v0.1 GreaterThanOrEqualTo 90 Location In AU CA GB NZ US, HIT approval rate (%) GreaterThanOrEqualTo 97 Multi-Topic Chat This is a task to provide questions and answers in a conversational format, with conversation spanning across multiple topics/entities.
285 12/07/2020 Yujia Yan Kidbook annotation qualification Kidbook annotation qualification EqualTo 100HIT approval rate (%) GreaterThan 97, Total approved HITs GreaterThan 50 1 minute Story book entity annotation In this task you are asked to annotate entities in the presented text. Payment is determined by number of annotated chunks.
286 12/07/2020 NASA ULI Computer hardware and physical/vision Computer hardware and physical/vision survey EqualTo 100 Completed Experiment DoesNotExist Once you start, you won’t be allowed to retake this test. Complete a short survey followed by a virtual targeting experiment (~20 mins) Subjects will use their keyboard to direct a cursor into a target area
287 12/07/2020 Enrichment at Tink pretest-qualified-worker pretest-qualified-worker EqualTo 100 You will have to wait 7 days if you wish to retake this test. All Countries: Select the best fitting category to this Danish transaction (with qualification test) this transaction appeared on your bank statement, what category would be the best fit?
288 12/07/2020 Violet Peng common sense qualification HIT approval rate (%) GreaterThan 98, Total approved HITs GreaterThan 5000, common sense qualification GreaterThanOrEqualTo 26 Location EqualTo US Once you start, you won’t be allowed to retake this test. Challenge the Temporal Common Sense of Our AI & Earn ~$2 in ~10 mins for each task! (2 tasks available) Creativity Required Now collecting data for time domain and cause & effect scenario. TO reports rejects
289 12/09/2020 SCI Mturk https://worker.mturk.com/qualifications/35166AXV7BFJWZHCMO18XS3946CCOU Round 1 Participant DoesNotExist, Java Prerequisite In 3 5 6 7 Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 97 Once you start, you won’t be allowed to retake this test. Provide explanations for lines of Java code oull be provided a Java program in which you will write a self explanation for each line
290 12/09/2020 Lang Science Transcription qualification for English transcription qualification for English GreaterThanOrEqualTo 1 Once you start, you won’t be allowed to retake this test. Transcribe the text that appears in the image Look at the image and type the text exactly as it appears.
291 12/15/2020 Imperial NLP Qualification Test HSP B2-a Once you start, you won’t be allowed to retake this test. Is this content toxic? (adult content) Based on a sample decide whether the content that appears shows toxic behaviour.
292 12/29/2020 Audio Information Research Lab Kidbook annotation qualification HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 50 You will have to wait 1 minute if you wish to retake this test. Story book entity annotation pilot run 2 In this task you are asked to annotate entities in the presented text. Payment is determined by number of annotated chunks. It is another pilot run of the task.
293 12/29/2020 Pew Research InfoTech Qualification politics Masters Exists, HIT approval rate (%) GreaterThan 95, Location EqualTo US Once you start, you won’t be allowed to retake this test. Answer some questions about politicians social media posts Were conducting important non-partisan research to assess how politicians communicate on social media and what they talk about.
294 12/29/2020 Aparna Qualification Demographics Survey for following HITs HIT approval rate (%) GreaterThan 98, Location In CA US Once you start, you won’t be allowed to retake this test. Dog Labelling Task The task in this HIT is to determine if the dogs depicted in the images below have specified physical characteristics.
295 01/05/2021 chen Does is look like an objective stand alone Total approved HITs GreaterThan 1000, Does is look like an objective stand alone statement?3970 GreaterThan 99 HIT approval rate (%) GreaterThanOrEqualTo 97, Location In US Once you start, you won’t be allowed to retake this test. Does is look like an objective stand alone statement?1289 In this job, we provide you with sentences. Your task is to determine whether theyre objective, stand-alone statements.
296 01/05/2021 chen Does is look like an objective stand alone Does is look like an objective stand alone statement?6052 GreaterThan 99 Total approved HITs GreaterThan 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location In US Once you start, you won’t be allowed to retake this test. Does is look like an objective stand alone statement?8931 In this job, we provide you with sentences. Your task is to determine whether theyre objective, stand-alone statements.
297 01/19/2021 Keqin Bao Score Test Score Test GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90, Adult Content Qualification EqualTo 1 You will have to wait about 1 hour if you wish to retake this test. Collect the dialog response reply to the last utterance in the given dialog history.
298 01/19/2021 Maryam Davoodi Political Science Background-V13_prod Political Science Background-V13_prod GreaterThanOrEqualTo 80 You will have to wait 2 minutes if you wish to retake this test. Classification of political bills with the health topics. Read the abstract of a US state bill. Then, identify the entities who lose and gain a benefit from the bill. These entities are selected based on the topic of the bill.
299 01/19/2021 Florence H CCC Trusted Worker Total approved HITs GreaterThan 100, Location In AU CA GB IE NZ US, HIT approval rate (%) GreaterThan 70, CCC Trusted Worker GreaterThanOrEqualTo 30 Once you start, you won’t be allowed to retake this test. CCC o determine what is described in a sentence, see instructions
300 01/22/2021 Joshua Introne Climate change position test Climate change position test EqualTo 100 Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 98, Location EqualTo US Once you start, you won’t be allowed to retake this test. Determine the opinion of a Twitter user Review the profile text and sample of tweets to determine a Twitter users opinion about climate change.
301 01/27/2021 Hugh Mungus Labelling Qualification purple staff - 2021 : Labelling Qualification purple staff - 2021 GreaterThanOrEqualTo 90 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images Label each person image with the most likely role
302 02/01/2021 Hugh Mungus Gender Labelling Qualification General Gender Labelling Qualification General GreaterThanOrEqualTo 90 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely gender
303 02/15/2021 IOTG Computer Vision Video recording consent Video recording consent EqualTo 100 Once you start, you won’t be allowed to retake this test. Record a video clip with American Sign Language expression. You should record a short video clip with one sign expression from ASL.
304 02/15/2021 Aurora Solar Aligning 3D and Images Aligning 3D and Images GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90 You will have to wait less than a minute if you wish to retake this test. 3D Scan Alignment Align a 3D scan of a roof with an image of the roof. This task is designed to take around one minute.
305 02/16/2021 MPI Dept. of Perceiving Systems Body_Shape_Ratings_Language_Test Body_Shape_Ratings_Language_Test GreaterThanOrEqualTo 80; HIT approval rate (%) GreaterThan 95; Total approved HITs GreaterThan 5000; Location EqualTo US; Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Body Shape Ratings Describe the body shape of a person by rating how much you agree with a fixed set of words. Some images may show nudity, for example, a person in lingerie. You can do as many HITs as you want.
306 03/01/2021 Lynn Lohnas Qualification Test To Participate 2 11 - previous participant DoesNotExist, Qualification Test To Participate 2 EqualTo 100 Once you start, you won’t be allowed to retake this test. Research study on cognition of memory 12 Participate in a research study. This is a two-part study taking place over two days. Today, you will participate in Study Session 1 (about 30 minutes). Tomorrow, 24 hours later, you will participate in Study Session 2 (about 10 minutes).
307 03/01/2021 QA Research Qualification: Clarifying Ambiguity in a Dialog Qualification: Clarifying Ambiguity in a Dialog EqualTo 100 Select high qualified workers for our Ambiguity Task DoesNotExist, Location In CA IN US, HIT approval rate (%) GreaterThan 97 Clarify Ambiguity in Dialog: Qualification Test Clarify ambiguous questions in a dialog which discusses a story. You will be selected to be our long-term workers if your work is in high quality. Please submit more than 5 HITs for being properly evaluated.
308 03/02/2021 Hugh Mungus Age Labelling Qualification General Age Labelling Qualification General GreaterThanOrEqualTo 90 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely age category
309 03/02/2021 Elena Kochkina Determine claim-tweet relevance Determine claim-tweet relevance qualification test GreaterThan 70 Once you start, you won’t be allowed to retake this test. Claim-tweet relevance task Tag whether a tweet is relevant to a given claim
310 03/02/2021 Shuaichen Qualification Test for Map Description Qualification Test for Map Description EqualTo 600 You will have to wait less than a minute if you wish to retake this test. Describe/summary a choropleth map image (~ 1 minute) Describe/summary a choropleth map image in one or a few sentences
311 03/09/2021 Rosni Kottekulam Vasu Data Science and Hypothesis: Knowledge Test Location In CH DE IN US, Masters Exists, Data Science and Hypothesis: Knowledge Test GreaterThan 80 Once you start, you won’t be allowed to retake this test. Hypotheses Ranking for Data Science Task Rank a set of predefined hypotheses for a dataset based on how interesting you think they are
312 03/16/2021 Lucas HAI Sentiment Analysis Pre-Qual Test 1 HAI Sentiment Analysis Pre-Qual Test 1 GreaterThanOrEqualTo 50 Once you start, you won’t be allowed to retake this test. Help us evaluate the sentiment of movie reviews The mission is to classify some reviews as positive or negative and answer a short survey at the end.
313 03/16/2021 Yibo Zhang Finance and Accounting Knowledge Finance and Accounting Knowledge GreaterThanOrEqualTo 70 You will have to wait 4 months if you wish to retake this test. Investor Judgments and Decision on Digital Reports Participants in this HIT will play the role of investors
314 03/16/2021 Jin Kim Compare Comments Compare Comments GreaterThanOrEqualTo 6 Once you start, you won’t be allowed to retake this test. Which comment is more uncivil? Which comment is more uncivil?
315 03/16/2021 John Friday Event Coreference Test Total approved HITs GreaterThanOrEqualTo 1000, Event Coreference Test GreaterThanOrEqualTo 75 HIT approval rate (%) GreaterThanOrEqualTo 95, Location In US You will have to wait 1 day if you wish to retake this test. Annotating Event Coreference in News Articles You will be asked to read 1 pair of news articles, and for the given pair you will be asked to identify texts that refer to the same events.
316 03/16/2021 12traits Favorite Activities Favorite Activities EqualTo 100 HIT approval rate (%) GreaterThan 95 Once you start, you won’t be allowed to retake this test. Answer a survey on humor preferences and video games Answer a survey study related to your humor preferences, as well as preferences and experiences related to video games. Responding to this survey should not take more than 16 minutes.
317 03/30/2021 chen What is the sentiment associated with this review What is the sentiment associated with this review GreaterThan 80 Total approved HITs GreaterThan 1000, HIT approval rate GreaterThanOrEqualTo 97, Location In US Once you start, you won’t be allowed to retake this test What is the sentiment associated with this review In this job, we provide you with magazine reviews
318 03/30/2021 Imperial NLP Qualification Test HSP B2-b Qualification Test HSP B2-b EqualTo 100 Adult Content Qualification EqualTo 1 Once you start, you won’t be allowed to retake this test. Is this content toxic? (adult content) Based on a sample decide whether the content that appears shows toxic behaviour.
319 04/19/2021 Hugh Mungus age-general age-general GreaterThanOrEqualTo 120 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely age
320 04/19/2021 Amazon Requester Inc. - ‘CVB’ ShoppingCVDialogDataUsageAcknowledgement ShoppingCVDialogDataUsageAcknowledgement GreaterThanOrEqualTo Total approved HITs GreaterThanOrEqualTo 50, HIT approval rate (%) GreaterThanOrEqualTo 70, Location EqualTo US 0 Once you start, you won’t be allowed to retake this test. Shopping Visual Refinement 1_1 Teach a conversational agent to find better products with your voice. You see a task page containing two sets of products.
321 04/20/2021 Buckeye Linguistics Research ParlAIExcludeQual76627t91090 ParlAIExcludeQual76627t91090 GreaterThanOrEqualTo 7111 ParlAIExcludeQual17567t60639 Exists, Location In AU CA GB NZ US You will have to wait 10 minutes if you wish to retake this test. Complex Question Dialogue This task requires reading a tutorial and completing a qualification task, which will take 20-30 minutes
322 04/20/2021 Hugh Mungus gender-general gender-general GreaterThanOrEqualTo 130 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely gender
323 04/28/2021 Hugh Mungus role-purple role-purple GreaterThanOrEqualTo 150 You will have to wait less than a minute if you wish to retake this test. Labelling demographics of People in Images Label each person image with the most likely role
324 04/28/2021 Marian-Andrei Rizoiu Skilled at detecting stance Total approved HITs GreaterThan 100, Skilled at detecting stance GreaterThanOrEqualTo 80 Location In AU CA GB US, HIT approval rate (%) GreaterThan 96 Once you start, you won’t be allowed to retake this test. Label the stance of reddit users towards Brexit Label the stance of reddit users as either Pro-Brexit, Anti-Brexit or neutral based on their posts/comments.
325 05/31/2021 Maze maze_age_12 Masters Exists , maze_age_12 GreaterThanOrEqualTo 2443 maze_age_12 LessThanOrEqualTo 6283 You will have to wait 7 days if you wish to retake this test. High-pressure survey & feedback task. ou will be presented with a series of questions and small tasks. Please be honest and provide meaningful responses. Earn ~$0.38 per minute / $22.80 per hour
326 07/09/2021 Cornell LIL tangram-batch Location EqualTo US No retakes What does this shape look like to you? In this task, you will see a simple but abstract shape. Different people see different things when they look at the shape and we are interested in what you see. After you describe what the shape looks like, you will describe the parts of that shape.
327 07/09/2021 Huy Nghiem Pre screen survey 2 GreaterThan 0; HIT approval rate (%) GreaterThan 95; Location In CA, US; Adult Content Qualification EqualTo 1 No retakes Annotation of Racism in Tweets Please follow instructions to rate the tweets on levels of offensiveness, aggressiveness, and target(s) of these sentiments.
328 08/17/2021 Jacob Freeman Shared Resources Experiment Qualification Finished Shared Resources Experiment Qualification DoesNotExist ; Shared Resources Experiment Qualification EqualTo 1; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In CA, US No retakes Shared Resources Experiment, estimated $11/hr This is a research experiment consisting of a qual, pre-game test, and 8-player game.
329 08/30/2021 QA Research Talk about similar images --v0.46 Excluded DoesNotExist ; Talk about similar images -- v0.45 GreaterThanOrEqualTo 100; Total approved HITs GreaterThanOrEqualTo 500; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 95 Similar-Images Retrieval Game In this game you will be the describer. You will have to to come up with a detailed description of an image such that a retriever is able to select it among several similar ones.
330 05/16/2022 Varieties of Egalitarianism VoE_en_Ireland Location In GB, IE; VoE_performance NotIn 1; VoE_en_Ireland GreaterThanOrEqualTo 70 No retakes Statements about inequality, social justice and equal treatment Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? This is the test for Ireland, but also accessible to those located in the UK. Separate test also available for UK. (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned.
331 09/08/2021 Gerardo Ocampo Diaz Personal Reportable Experience Identification V1 Read a newspaper opinion piece and highlight mentions of personal experiences 1 minute Read a Newspaper Opinion Piece Read a newspaper opinion piece and highlight mentions of personal experiences
332 09/09/2021 Alexandria Grammaticality and plausibility: qualification (Sept 7, 2021) Grammaticality and plausibility: qualification (Sept 7, 2021). >= 8, Location In AU, CA, GB, US, Location In AU, CA, GB, US, HIT approval rate (%) >= 99 6 hours Grammaticality and plausibility. v1 In this HIT, you will compare sentences in terms of their grammaticality and plausibility.
333 09/15/2021 Carnegie Mellon University Civil Rights Qual: 8 doc, Score>=2, price .40, time 9am Civil Rights Qual: 8 doc, Score>=2, price .40, time 9am GreaterThanOrEqualTo 2 No retakes Enter a search topic and select the best results (~2 minutes) After performing a search, how relevant is the list of results to your search?
334 09/15/2021 Remesh Research Remesh Qualification (#b9f0699c) Total approved HITs GreaterThanOrEqualTo 5000, Remesh Qualification (#b9f0699c) EqualTo 1 No retakes Remesh Conversation: Eat More Produce Eat More Produce (~30 minute live conversation) 11:48 AM Eastern (#b9f0699c)
335 09/15/2021 SoTAHRS New Qualification Test Masters Exists, HIT approval rate (%) GreaterThanOrEqualTo 90, New Qualification Test EqualTo 100 No retakes Evaluate conversations (~25minutes) Rate the naturalness of conversations APPROVAL is a little low
336 09/15/2021 Michelle Japanese-English Proficiency Test Japanese-English Proficiency Test EqualTo 100 No retakes Labelling Korean Social Media Posts | Bilingual Each HIT requires you to select from a list of labels to indicate 3 attributes about each post - whether the post is relevant, the functional and the emotional benefits that are being discussed.
337 09/15/2021 Noah Turk Moral Foundations Score Total approved HITs GreaterThanOrEqualTo 100, Moral Foundations Score GreaterThanOrEqualTo 80, High-Quality Moral Annotations Exists, HIT approval rate (%) GreaterThanOrEqualTo 98, Location EqualTo US, Adult Content Qualification EqualTo 1 No retakes Moral Evaluation of Dialogue (WARNING: This HIT may contain adult content. Worker discretion is advised.) You can help us identify moral and social norm violations in conversations (question and answer pairs). Noah accounts sometimes reject.
338 09/15/2021 Noah Turk Moral Personality Test Total approved HITs GreaterThanOrEqualTo 100, Moral Foundations Score GreaterThanOrEqualTo 80, Moral Personality Test GreaterThan 0, HIT approval rate (%) GreaterThanOrEqualTo 98, Location EqualTo US, Adult Content Qualification EqualTo 1 No retakes Moral Evaluation of Dialogue (WARNING: This HIT may contain adult content. Worker discretion is advised.) You can help us identify moral and social norm violations in conversations (question and answer pairs). Noah accounts sometimes reject.
339 09/17/2021 Tampere University Audio Research Audio Question Answering Test Experimental settings DoesNotExist, Total approved HITs GreaterThan 3000, Location In AU CA GB IE NZ US, Participated in Audio QA annotation batch 2 DoesNotExist, Audio Question Answering Test GreaterThanOrEqualTo 19 No retakes Provide three questions for a 15-30s audio clip.(Batch 2) Write three questions about the contents of a single 15-30s audio clip. APPROVAL RATE is a little low
340 12/14/2021 UKP Lab, TU Darmstadt Toxic Dialogue QTest Toxic Dialogue QTest EqualTo 100, Adult Content Qualification EqualTo 1 No retakes Toxic Dialogue Annotation (WARNING: This HIT may contain adult content. Worker discretion is advised.) In this task we ask you to classify dialogues based on toxicity content
341 09/22/2021 IGLU Contest Test to qualify for fun collaborative Minecraft Game Test to qualify for fun collaborative Minecraft Game GreaterThan 80 5 minutes Play collaborative Minecraft game as a builder! You would be given instructions in natural language created by others to contribute to building a structure in an interactive voxel world. It is super fun!
342 09/22/2021 caisa.lab Test qualification Location In GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95, Test qualification EqualTo 100 Once you start, you won’t be allowed to retake this test. Stance polarity and intensity detection You will be requested to determine if a statement is against, neutral, or in favor towards a given topic in a 5-point scale. Source: Reddit DISCLAIMER: Statements may contain strong language or may be offensive to some readers.
343 09/22/2021 Alexandria Judge a Translation from an AI System - v2 Judge a Translation from an AI System - v2 >= 7, Location In AU, CA, GB, US, Total approved HITs >= 10000, HIT approval rate (%) >= 99 6 hours Judge the quality of an AI translation - v4 Judge the quality of a translation
344 09/23/2021 ASR research 'English Native Transcriber' 'English Native Transcriber' is not less than 99 10 minutes transcribe audio test write down what you hear lower case only no punctuation Requester has rejections reported and a 96% approval rating proceed with caution.
345 09/27/2021 Cognitive Lab 1 Teacher Qualification Taken the Survey DoesNotExist, 1 Teacher Qualification EqualTo 100 No retakes Evaluate 40 concept about teaching, learning and the brain. In this study you will evaluate you will evaluate 40 concepts about learning and the brain. In total you can earn $3 for completing the whole study. The first part of the study takes 40-50 minutes to complete; part 2 & 3 only takes about 15-20 minutes.
346 09/28/2021 Alexandria Grammaticality and plausibility: qualification for counterfactual statements (Sept 28, 2021). Location In AU, CA, GB, US; Location In AU, CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99; Grammaticality and plausibility: qualification for counterfactual statements (Sept 28, 2021). GreaterThanOrEqualTo 10 6 hours Annotating counteractual reasoning examples. v6 In this HIT, you will score a sentences in terms of their plausibility and coherence of counterfactual stories.
347 09/28/2021 Zeus Consensus sentiment-v0.1.0 sentiment-v0.1.0 EqualTo 100 1 day News Article Sentiment Label news articles according to their sentiment Limited info available, new requester
348 09/30/2021 Carnegie Mellon University MT birdawatching: 9 doc, Score>=4, price .40, time 8am MT birdawatching: 9 doc, Score>=4, price .40, time 8am GreaterThanOrEqualTo 4 No retakes Enter a search topic and select the best results (~2 minutes) After performing a search, how relevant is the list of results to your search?
349 10/01/2021 Carnegie Mellon University Aquariums: 9 doc, Score>=4, price .40, time 10am Aquariums: 9 doc, Score>=4, price .40, time 10am GreaterThanOrEqualTo 4, Location In US No retakes Enter a search topic and select the best results (~2 minutes) After performing a search, how relevant is the list of results to your search?
350 10/01/2021 Kumar Shridhar Math_level_qualification_1_1 Math_level_qualification_1_1 GreaterThanOrEqualTo 100 No retakes Simple math word problems solving We will provide you multiple math word problem tasks. We will ask you to try solve these math word problems and by doing so, you can learn something new. The task takes approximately ~35 minutes.
351 10/01/2021 MIT mturk Completed Robot Qualification Survey Completed Robot Qualification Survey Exists No retakes Describe robot actions Watch a robot perform some action then write a command describing it Approval rate is low.
352 10/04/2021 GSV Urban Data Lab GSV Buildings (Roofing) Qualification Survey 2.0 GSV Buildings (Roofing) Qualification Survey 2.0 EqualTo 60, Less than a minute Answer a short survey about building conditions For each image, you will focus on whether the building has deteriorated roofing.
353 10/04/2021 GSV Urban Data Lab GSV Buildings (Siding) Qualification Survey 2.0 GSV Buildings (Siding) Qualification Survey 2.0 Equal To 60 Less than a minute Answer a short survey about building conditions For each image, you will focus on whether the building has cracked siding.
354 10/04/2021 GSV Urban Data Lab GSV Buildings (Plywood) Qualification Survey 2.0 GSV Buildings (Plywood) Qualification Survey 2.0 EqualTo 60 Less than a minute Answer a short survey about building conditions For each image, you will focus on whether the building has plywood over its doors or windows.
355 10/06/2021 Hugh Mungus role-situlive-standard role-situlive-standard GreaterThanOrEqualTo 150 less than a minute Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely role
356 10/08/2021 SLS-6 PersonaChat With Highlights Qualification Test PersonaChat With Highlights Qualification Test EqualTo 100 1 minute Write what you would say with the given persona and context Highlight some part in the given persona and context, then write a response with the information you highlighted.
357 10/11/2021 James McGrath Identify NYC building picture. Identify NYC building picture. EqualTo 8 1 minute Identifying NYC building pictures at 418 Central Park West Identify the picture that looks most like the profile of an entire building from the outside. Do not include pictures of the inside of any building/apartment or taken from the inside or balcony of an apartment or building.
358 10/11/2021 Arthur Brazinskas SummBW blocked_worker DoesNotExist, Location In CA GB US, SummBW EqualTo 10 Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 98 Once you start, you won’t be allowed to retake this test. Select of the best customer review summary Select of customer review summaries generated by different AI algorithms
359 10/02/2022 yutsuk 4Q Qualification Test (20210827) 4Q Qualification Test (20210827) EqualTo 100, HIT approval rate (%) GreaterThan 95, Location In AU CA GB NZ US No retakes (20221001) Speaker's satisfaction labeling Labeling the degree of the speaker's satisfaction/dissatisfaction
360 10/19/2021 Jinuk Cho test10172150 Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 98, test10172150 GreaterThanOrEqualTo 100 Less than a minute Read short movie plots (generated by A.I.) and answer questions (~4 mins) Evaluate the A.I. generated story
361 10/19/2021 Michelle Deutsch Sprachprüfung | German Proficiency Test Deutsch Sprachprüfung | German Proficiency Test EqualTo 100 No retakes German Social Media Posts | Kennzeichnung deutscher Beiträge in sozialen Medien • Bei jedem HIT müssen Sie aus einer Liste Labels auswählen, und damit 5 Attribute zu jedem Beitrag angeben
362 10/20/2021 Carnegie Mellon University Largest Cities: time 9am, No Location Largest Cities: time 9am, No Location GreaterThanOrEqualTo 9 No retakes Enter a search topic and select the best results (~2 minutes) After performing a search, how relevant is the list of results to your search?
363 10/22/2021 Michael Roth QualificationTest Location In GB US, QualificationTest EqualTo 6, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 No retakes Does the underlined part make sense in the given how-to guide? determine whether the underlined part makes sense in the given how-to guide
364 10/25/2021 Herman Saksono Screener 210859-8-22-2 Total approved HITs GreaterThan 1000, Screener 210859-8-22-2 GreaterThanOrEqualTo 90, HIT approval rate (%) GreaterThan 95, Participated in 210859-8-22 DoesNotExist, Location EqualTo US No retakes Listening task (2.5 mins audio) + answering surveys. Takes 10-15 minutes for $3.75. Answer a survey, listen to a story, review the story, and answer an additional survey.
365 10/26/2021 UW Madison Alexa Skill Pre-Survey Test (Android) Alexa Skill Pre-Survey Test (Android) EqualTo 100, HIT approval rate (%) GreaterThan 90, Location EqualTo US, Completed survey updated DoesNotExist No retakes Collect Smartphone Applications Data, Analyze Browser History Analysis and Alexa Skills Information Provide basic information about which Alexa Skills you use, mobile phone applications you have and alexa skill related analysis of browser history Approval Rate at 95%
366 10/27/2021 SLS-6 DailyMail Summary Highlights Qualificcation Test Total approved HITs GreaterThanOrEqualTo 100, DailyMail Summary Highlights Qualificcation Test GreaterThanOrEqualTo 97,HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US 1 minute Read a dailymail news article and choose related sentence to reference summary. You need to read a dailymail news article and its corresponding reference summary and choose the most related sentence in the article to summary.
367 11/01/2021 Ao GUO Common Sense Test for Personalized Chat_2021.10.28 Location In AU CA GB IE NZ US, Each turker could only finish one HIT (SEN) DoesNotExist, Common Sense Test for Personalized Chat_2021.10.28 GreaterThanOrEqualTo 100,Total approved HITs GreaterThanOrEqualTo 50, HIT approval rate (%) GreaterThanOrEqualTo 90 No retakes Fill in Questionnaires and Chat with a Bot to Accomplish Specified Goals Answer a four-page questionnaire consisting of 147 questions and then chat with a bot in 3 rounds of conversation to accomplish the assigned goals.
368 11/01/2021 Fritz&Hammer Crowdsourcing Company LEI Qualifier Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location EqualTo US, Adult Content Qualification EqualTo 1 Temp Task 1 GreaterThanOrEqualTo 1, Company LEI Qualifier GreaterThanOrEqualTo 80 1 month Find the Legal Entity Identifier for a company Visit a website to find the Legal Entity Identifier for a company
369 11/04/2021 Youngrok Song qualification_test_obs_test Total approved HITs GreaterThan 500, Exclude Repeated DoesNotExist, HIT approval rate (%) GreaterThan 95, Location In CA US, qualification_test_obs_test EqualTo 100 Less than 1 minute Obstacle Evaluation You will be asked to write 2 short sentences (Question 1) and answer two sets of four 5-point likert questions (Question 2~5/6~9) Limited info available, new requester
370 11/05/2021 Hugh Mungus role-v1-purple role-v1-purple GreaterThanOrEqualTo 230 Less than a minute Labelling demographics of People in Images (Quick and easy qualification quiz!) Label each person image with the most likely role
371 11/16/2021 Jin event_coreference event_coreference EqualTo 100,Total approved HITs GreaterThan 1000, Location In AU CA GB US, HIT approval rate (%) GreaterThan 98 No retakes Event Coreference You will be presented with 25 sentence pairs that each has an event trigger word highlighted. Then, you will be asked if these two event mentions represented by the trigger words refer to the same real-world event.
372 11/17/0202 Recycling Company PETQualification1 GreaterThan 10, Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 95 1 day Answer classification questions for the shown images Each task contains 8 pages showing one image each. The task is to answer questions related to the shown image.
373 11/23/2021 Yossi Keshet Audio equipment test 2.1 Audio equipment test 2.1 EqualTo 100, Total approved HITs GreaterThan 10000, HIT approval rate (%) GreaterThan 95, Location EqualTo US 1 day Select the best (i.e. quality/human-sounding) audio given a reference audio Select the best (i.e. quality/human-sounding) audio given a reference audio
374 12/07/2021 IUCC CompAnalogy MTurk qualification-test-biomimicry-1 Location In CA, GB, US; qualification-test-biomimicry-1 EqualTo 100; Total approved HITs GreaterThan 10000; HIT approval rate (%) GreaterThan 97 No retakes Inspiration from nature Find animals that solve complex problems
375 12/26/2021 Napat Thumwanit Multiple-choice commonsense reasoning Inconsistent Commonsense Reasoning Performance Tracking DoesNotExist , Total approved HITs GreaterThan 1000, Dummy Qualification 4 DoesNotExist , Multiple-choice commonsense reasoning 2 GreaterThanOrEqualTo 90, HIT approval rate (%) GreaterThan 97 No retakes Multiple-choice Adversarial common sense question answering (3-5 minutes per HIT) You will verify the multiple-choice questions related to common sense reasoning. The task is as simple as choosing the answer or providing the reason in case of ambiguous
376 01/12/2022 Carnegie Mellon University Stars: time 10am Wednesday, 500 HITs Stars: time 10:20am Wednesday, 500 HITs >= 4, HIT approval rate (%) >= 90 No retakes Enter a search topic and select the best results (~2 minutes) After performing a search, how relevant is the list of results to your search?
377 01/21/2022 AdobeAWS2224 Legal sentence classification qualification test Legal sentence classification qualification test EqualTo 4; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In CA, US About 1 hour Legal text classification Annotate the given sentences with the categories (e.g. obligation, permission, prohibition, entitlement) expressed in them with respect to a given entity and highlight the words that evoke a particular category.
378 01/29/2022 AdobeAWS2224 Legal sentence categorization qualification test Legal sentence categorization qualification test EqualTo 10, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 5000 5 minutes Legal text classification Annotate the given sentences with the categories (e.g. obligation, permission, prohibition, entitlement) expressed in them w.r.t a given entity and highlight the words that evoke a particular category. Qualify test duration increased & retakes available.
379 01/29/2022 wyss_econ TweetQualification TweetQualification GreaterThanOrEqualTo 75; Location In AU, GB, IE, NZ, US No retakes Interactive labelling of Tweets for scientific research (~15$/h) Label Tweets related to climate change (simplified new qualification test). This is a small trial batch. More HITs will follow. We pay bonus (7$) for successful qualification in addition to standard HITs payment.
380 05/16/2022 Varieties of Egalitarianism VoE_fr_France Location In BE, CH, FR, LU; VoE_performance NotIn 1; VoE_fr_France GreaterThanOrEqualTo 70 No retakes Déclarations sur l’égalité, la justice sociale ou l’égalité de traitement Cette déclaration fait-elle une référence positive à l’égalité, la justice sociale et/ou l’égalité de traitement ? This is the test in French for Belgium, Switzerland, France, and Luxembourg (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned.
381 02/22/2022 huji nlp lab analogies_qualification analogies_qualification GreaterThan 90; Total approved HITs GreaterThanOrEqualTo 5000; Low Analogy Performance DoesNotExist ; HIT approval rate (%) GreaterThanOrEqualTo 99 1 day Choose the image that best solves the analogy Choose the image that best solves the analogy
382 04/12/2022 Alexandria Verify the plausibility of the middle sentence Lask of Qualification for Participating in GENIE annotations DoesNotExist Location In AU, CA, GB, US, Total approved HITs >= 10000, Verify the plausibility of the middle sentence >= 7, HIT approval rate (%) >= 99 6 hours Verify the plausibility of the middle sentence In this HIT, you will be shown a short 3-sentence story. The task requires you to mark if the middle sentence is correct.
383 04/12/2022 Alexandria Answering elementary-school science questions (Sept 2) Lask of Qualification for Participating in GENIE annotations DoesNotExist Total approved HITs >= 5000, Location In AU, CA, GB, US, HIT approval rate (%) >= 99, Answering elementary-school science questions (Sept 2). >= 8 6 hours Indicate whether a given answer to elementary-school science questions is correct (agree/disagree). In this HIT, you will be given several questions and will indciate whether the given answers are correct.
384 04/15/2022 CSMR Qualification for game content HIT by CSMR Answered more than 30 questions DoesNotExist , Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 98, Qualification for game content HIT by CSMR EqualTo 1 4 days Help us develop game content for a fun party game like Family Feud Give us your best guesstimates to questions based on your perceptions of others
385 04/28/2022 LiesbethA Instruction test: Labeling people Labeling people EqualTo 100 No retakes Highlight people in sentences Highlight people mentioned in a sentence and check if the writer implies a character trait of them. HITs may need shift+enter to submit, Limited requester info available
386 05/05/2022 Varieties of Egalitarianism VoE_en_Canada Total approved HITs GreaterThan 100; VoE_performance NotIn 1; VoE_en_Canada GreaterThanOrEqualTo 70; HIT approval rate (%) GreaterThanOrEqualTo 99; Location is CA No retakes Statements about inequality, social justice and equal treatment Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? This is the test for Canada (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned.
387 05/06/2022 Varieties of Egalitarianism VoE_en_Australia VoE_performance NotIn 1; Total approved HITs GreaterThan 500; VoE_en_Australia GreaterThanOrEqualTo 70; Location In AU, GB, IE, NZ, US; HIT approval rate (%) GreaterThanOrEqualTo 99 No retakes Statements about inequality, social justice and equal treatment Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? This test applies to US, AU, GB, IE, and NZ even though it specifically mentions AU. Note the timer. Reviews mention mistaken rejections were overturned.
388 05/08/2022 SAINTES Research Python qualification test Python qualification test GreaterThanOrEqualTo 85 No retakes Are two Python code snippets the same? You will be shown a pair of code snippets in Python. You will be asked to assess if they have the same functionality and if yes, which snippet you prefer. To qualify for this task, you need to complete a short Python quiz. Limited info available, new requester
389 05/13/2022 Whooosreading.org Decide if a sentence fully answers a question Limit reached - Decide if a sentence fully answers a question DoesNotExist ; Vetted - Decide if a sentence fully answers a question DoesNotExist ; Decide if a sentence fully answers a question GreaterThanOrEqualTo 80 12 hours Decide whether or not a sentence fully answers a question Decide whether or not a sentence fully answers a question
390 05/16/2022 Johannes Daxenberger Reasoning Annotation: Hygiene products (real) Reasoning Annotation: Hygiene products (real) >= 80, Location In CA, US, HIT approval rate (%) >= 95 No retakes Argument Annotation - Electric Shaver, Sentence Arguments, Batch 0
391 06/24/2022 Whooosreading.org Categorize each answer based on grammar rules and sentence Limit reached - Categorize each answer based on grammar rules and sentence structure DoesNotExist ; Categorize each answer based on grammar rules and sentence structure GreaterThanOrEqualTo 80; 12 hours Categorize each answer based on grammar rules and sentence structure Categorize each answer based on grammar rules and sentence structure
392
393 06/26/2022 Aparna Demographics Survey for following HITs Demographics Survey for following HITs Exists ; HIT approval rate (%) GreaterThan 98; Location In CA, US; Completed meal labelling task before DoesNotExist ; Adult Content Qualification EqualTo 1; Annotator pool previous DoesNotExist No retakes Text Labelling Task (WARNING: This HIT may contain adult content. Worker discretion is advised.) The task in this HIT is to label text snippets
394 06/28/2022 MSR-LIT-SPIRAL-NLGI natalie_general_task_qualifier natalie_general_task_qualifier GreaterThanOrEqualTo 90; HIT approval rate (%) GreaterThanOrEqualTo 80; Location EqualTo US No retakes Read a task description, a text and correct a solution for the task. Give feedback and instructions in English. 5 minutes per ta Analyze the task description, a source text and a candidate solution for the task. Correct the candidate solution, explain why it was wrong and give instructions describing your changes. Average of 5 minutes per task.
395 06/29/2022 Whooosreading.org Determine whether or not the sentence is a fragment Determine whether or not the sentence is a fragment >= 80; Limit reached - Determine whether or not the sentence is a fragment DoesNotExist; Vetted - Determine whether or not the sentence is a fragment DoesNotExist 12 hours Determine whether or not the sentence is a fragment Categorize each answer based on grammar rules and sentence structure
396 07/08/2022 Christopher Malon Noun Phrase Classification Test HIT approval rate (%) GreaterThan 89; Noun Phrase Classification Test GreaterThan 16; Location EqualTo US; Total approved HITs GreaterThan 999 No retakes Classify Noun Phrases Select a type of noun phrases in a review (Electronics in Amazon) One TO rejection report from 2012. Recent reviews generally okay/positive.
397 07/23/2022 Cornell LIL Qualification Test Qualification Test >= 8, Total approved HITs >= 500, HIT approval rate (%) >= 98, No retakes [More HITs to Come if You Passed the Qual!!] Interact with a Question Answering System You will ask a question regarding a topic that interests you, get an answer highlighted in a paragraph, and provide feedback on how good this answer is.
398 08/17/2022 Johannes Daxenberger Flight Request Annotation Qualification Test Flight Request Annotation Qualification Test >= 80, HIT approval rate (%) >= 95, Location In US No retakes Flight Request Annotation
399 08/22/2022 Checkmark Ninja Installed Version of our Chrome Extension Installed Version of our Chrome Extension >= 3 1 day Verify the LinkedIn URL for a person Use our Chrome Extension to verify the LinkedIn URL for a person. You do need a LinkedIn Account and have our Chrome Extension installed in order to proceed.
400 08/27/2022 mstar-team Ability to evaluate summaries on professional documents HIT approval rate (%) is greater than 95, Masters has been granted, Ability to evaluate summaries on professional documents has been granted 4 hours Evaluate summary quality Read an article and a pair of summaries, evaluate each summary based on coherence, consistency, coverage and overall quality. The precise definitions of those terms are given in the task. Advanced English reading comprehension is needed.
401 09/28/2022 Yanzhe Zhang Text Style Understanding Location In AU, CA, GB, US, HIT approval rate (%) >= 98, Text Style Understanding >= 5 No retakes Annotate the response quality based on a prompt Annotate the quality of a written response with regard to the style requested in the prompt.
402 09/28/2022 Jwala Dhamala English Varieties Test Dialect J Exists English Varieties Test Exists Total approved HITs >= 500, HIT approval rate (%) >= 98, No retakes Dialect Understanding Your goal is to decide whether bits of text sound acceptable according to the grammar rules of your dialect.
403 10/02/2022 Emily Provost Text Emotion Annotation Text Emotion Annotation EqualTo 100, Total approved HITs > 500, HIT approval rate (%) > 98, Adult Content Qualification EqualTo 1, 1 day Text Emotion Annotation Read a short piece of text and label the emotion expressed
404 10/02/2022 Alexa Qualification for Humor Evaluation (categorical) task Masters Exists Total approved HITs > 500, HIT approval rate (%) > 98, Qualification for Humor Evaluation (categorical) task EqualTo 100, Location EqualTo US, No retakes Is this a humorous response? Is this a humorous response for a playful user shopping request? Reports of rejections on Turkerview.
405 10/02/2022 addb-mturk Creative Comparison validation Qualification: 2022-09-29 23:22:21.408576 Creative Comparison validation Qualification: 2022-09-29 23:22:21.408576 >= 80, 5 minutes Brand Validation Reduced Categories Compare the videos and choose the right category
406 10/05/2022 HotWriter English Tier 1 English Tier 2 Exists Total approved HITs > 10, No retakes Write 260 words description for a product from images and title Write a product description which describes the features and benefits of the given product to a customer.
407 10/30/2022 Ron IRFL_image_qualification_v12 irfl_image_task_blocked_workers DoesNotExist ; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In AU, CA, GB, NZ, US; IRFL_image_qualification_v11 GreaterThan 90 1 hour IRFL - Image Recognition of Figurative Language Choose the image correct category for the image
408 01/24/2023 MineRL-BASALT BASALT - Minecraft Basic Familiarity Test BASALT - Minecraft Basic Familiarity Test 65 or greater 2 days
409 02/25/2023 IGLU Contest iglu-minecraft-eval-qualifier Total approved HITs > 500, HIT approval rate (%) > 95, iglu-minecraft-eval-qualifier > 86, Location In CA, DE, GB, NL, US, No retakes IGLU - Play Minecraft game! Play with and AI agent in Minecraft and complete a short survey. You must have Minecraft 19.2 already installed.
410 02/27/2023 BIGAI Very small qualification test to see if you understand our task 0226-2000 Location In AU, CA, DE, GB, US; Very small qualification test to see if you understand our task 0226-1600 GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 10 Less than a minute ecide whether an image contains a certain sentence. Decide whether an image contains a certain sentence.
411 03/16/2023 UBC NLP Lab Image understanding task Total approved HITs GreaterThanOrEqualTo 5000; Location In AU, CA, GB, NZ, US; HIT approval rate (%) GreaterThanOrEqualTo 97; Image understanding task GreaterThan 95 1 minute Write one sentence description for an image. Given an image, write one sentence that describes the image.
412 03/16/2023 Xiang - OSU Web Interface Consent Total approved HITs > 1000, Web Interface Consent EqualTo 100, Web Interface Qualification Master Exists HIT approval rate (%) > 98, Web Interface Qualification Exists 1 minute Demonstrate Simple daily online tasks that can be done on target websites Official HITs. You need to pass the qualification HITs first* Help make the web more accessible to all! Demonstrate daily tasks on a target website. You need to first propose tasks in a separate HIT.
413 04/12/2023 Qiang Zhang Time Aware Chat Time Aware Chat EqualTo 100, Total approved HITs >= 2000, Location In CA, US, HIT approval rate (%) >= 95 No retakes Time Aware Chat Have a natural conversation with another participant about specific events.
414 11/02/2023 Whooosreading.org Decide which sentence contains the better claim Limit reached - Decide which sentence contains the claim DoesNotExist Vetted - Decide which sentence contains the claim DoesNotExist Decide which sentence contains the better claim >= 80, 12 hours Regular - Decide which sentence contains the better claim Choose which sentence has a stronger claim.

 

Reader Interactions

Comments

  1. Dars says

    December 18, 2018 at 11:03 am

    A head’s up – Joseph Dario might need to have a warning on it now. Rejections are being reported in the TO.

    Reply
  2. soummer says

    February 9, 2019 at 11:55 am

    On Image Matcher 1.0 Eagle Eye, after the first few questions, several images would not open. Is it broke or just me?

    Reply
    • Rosie The Robot says

      May 18, 2019 at 10:54 pm

      I have no idea, I’m so sorry. I really don’t spend much time here. I invite you to join the TurkerNation Slack Channel, that is where I hang out and answer questions.

      Reply
  3. CH says

    March 8, 2019 at 10:42 am

    It would be helpful if we could mark what we’ve done or it told us which was a new posting 🙂

    Reply
    • Rosie The Robot says

      May 18, 2019 at 10:31 pm

      We invite you to join the TurkerNation Slack Channel. We post the Qual HITs and Qual Tests there. When I can, I add the Qual Tests here. Slack has very good notifications settings.

      Reply
      • Lynn says

        December 29, 2020 at 2:03 pm

        TurkerNation Slack Channel no longer exists.

        Reply
        • Rosie The Robot says

          April 11, 2021 at 5:47 pm

          Sure it does! You can join here. If are already a member, you’ll have to recover your password do log in.

          Reply
  4. Kenny says

    May 3, 2019 at 12:24 pm

    How often are these qual tests/qual hits update?

    Reply
    • Rosie The Robot says

      May 18, 2019 at 10:31 pm

      We invite you to join the TurkerNation Slack Channel. We post the Qual HITs and Qual Tests there. When I can, I add the Qual Tests here. Slack has very good notifications settings.

      Reply
      • Isabella says

        June 26, 2021 at 8:47 am

        Hi, Isabella here.
        What’s new link for slack?
        I really adjoint with you.
        Thanks!

        Reply
        • Rosie The Robot says

          July 8, 2021 at 2:46 pm

          We’re glad to have you in the Slack! We will try to keep you updated there! We can also answer your questions and provide companionship!

          Reply
  5. Joe says

    June 18, 2019 at 1:41 pm

    What happened to this page? I will miss it so much! Slack channel is great but I love the list that was here. Made it easy to keep track of which quals I had passed and which I still needed to try again. Any other options that are similar?

    Reply
    • Joe says

      June 18, 2019 at 1:42 pm

      Nevermind it is loading again. Phew…close call

      Reply
      • Rosie The Robot says

        June 18, 2019 at 10:01 pm

        We’re so glad you like it and that we were able to get it working again!

        Reply
    • jemar707 says

      June 18, 2019 at 10:06 pm

      Sorry it was being a little wonky! Thanks for commenting, it brought my attention to this quickly.

      Reply
  6. Mary says

    January 23, 2020 at 11:08 am

    Is there another page where I can find other Qualification Tests?

    Reply
    • Rosie The Robot says

      January 25, 2020 at 1:11 am

      Yes, before being posted here, they are posted in the Quals Channel on TurkerNation Slack. (Note: You DO NOT have to click “Just Arrived” or “Thanks for the invite” when you sign up. You can ignore the “Send a message to let @Admin know you’ve arrived” prompt.)

      Reply
      • Siva Murugesan says

        September 4, 2021 at 12:47 pm

        How to sign-in I am new user

        Reply
        • Rosie The Robot says

          October 4, 2021 at 3:39 pm

          I just checked this email address and it is not in the system so please follow the advice in my other reply.

          Reply
  7. César Rodríguez says

    March 14, 2020 at 9:03 am

    They are still updating this page. If not, how do I get connected?

    Reply
    • Rosie The Robot says

      March 23, 2020 at 9:33 pm

      Sorry, I’m a little behind. Newest quals can always be found in the quals channel of our Slack, which I believe you have already joined.

      Reply
  8. César says

    March 14, 2020 at 3:38 pm

    Is this website still being updated?

    Reply
  9. Siva Murugesan says

    September 4, 2021 at 12:49 pm

    Need to login details of turkernation slack.

    Reply
    • Rosie The Robot says

      October 4, 2021 at 3:39 pm

      Hi! Sorry, just seeing this. Did you already sign up? You would then chose your login details. Please go to https://tinyurl.com/JoinTurkerNation to sign up. If you are already a member, please input your email address and click on the forgot password link. Or write to [email protected] so I can check your email address.

      Reply
  10. Patricia Morris Randall says

    May 28, 2022 at 2:51 am

    hi,
    anyone get qualification for below hits link https://worker.mturk.com/?filters%5Bsearch_term%5D=MLDataLabeler+Qualifying+HIT+for+Bounding+Box+Tasks
    this is a mldatalabler bounding box task

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Footer

Privacy Policy

Copyright © 2025 · Magazine Pro on Genesis Framework · WordPress · Log in

Dynamic title for modals

Are you sure?

Please confirm deletion. There is no undo!