This table is sortable. The default setting is to show the newest tests on the top.
Note: we cannot vouch for all these requesters. Please pay close attention to any information in the notes column of each entry.
Do you have more to add to this list? Any changes? Leave a comment below or join TurkerNation’s Slack Workspace and easily add quals to the Quals Channel.
Here is a list of Requesters for whom we do not post qual tests because of their rejection record:
- Bright Machines
- Andreas Vlachos
- Hanna Diggins
- D Labs
- Joseph Dario
- John Smith
- nlp_super
- Q OCR
wdt_ID | Date Added to Hitmo | Requester | Test | Qualifications Needed | Wait to Retake | HIT Title | HIT Description | Notes |
---|---|---|---|---|---|---|---|---|
4 | 01/28/2019 | vainu | Company references qualification test | Company references qualification test GreaterThanOrEqualTo 80 | 1 day | Find the references page of a given website | Visit the website given below. Find a link of their references page | |
6 | 01/30/2019 | CHAI Group | Emotion Labelling Test | Short Audio EqualTo 100 | 8 hours | Labelling emotion of short (~25s) audio clip | Listen to ~25s audio clip and answer multiple choice questions. Earn up to 9.25 dollars per hour! Please listen to audio at 1x speed. | |
7 | 01/31/2019 | Michael Woytowitz | HeadshotQualification | HeadshotQualification Exists | 1 day | Find Professional Headshots Using Provided Information | Your task is to find headshots and copy and paste the image url. We've made an effort to make completing the HIT as seamless as possible but are open to any and all feedback | |
8 | 02/01/2019 | Robert West | Text Comprehension Questionnaire | Text Comprehension Questionnaire GreaterThan 5 | 7 days | Label Statements about Short Texts (~7.5 MINS) -> DO AT MOST 24 HITS | Given several statements, and a series of short texts, decide whether the texts are in accordance to the statements. Please do at most 24 hits. | |
9 | 02/02/2019 | Robert West | Nutrition Questionnaire | 10 hours | ||||
10 | 02/03/2019 | Mike Ross | Sentence Expansion Qualification Level 3 | Level3SentenceExpansion GreaterThanOrEqualTo 70 | 3rd party site | Sentence Rewrite | https://docs.google.com/document/d/e/2PACX-1vRqW_2fuL41KgfRqRWDO3LB_F9P2SBdz3yClDL6xxkRI2Sux56z6gFNrD5y06R0V4GaJJH6lKJn4UZP/pub | |
11 | 02/04/2019 | Hamish Brocklebank | Choosing sentiment, emotion and topic for short text (video comment) | Once you start, you won’t be allowed to retake this test. | Choose sentiment, emotion and topic for short text | Choose sentiment, emotion and topic for short text | ||
12 | 02/05/2019 | Ian Stewart | Reading comprehension test//Examen de comprensión lectora | 1 minute | ||||
13 | 02/06/2019 | Carnegie Mellon Social Computing Group | Parenting Topics Training | Once you start, you won’t be allowed to retake this test. | ||||
14 | 02/07/2019 | Vladimir | Product Category Detection Quiz | 2 hours | ||||
15 | 02/08/2019 | S365 | News title sentiment qualification | 2 hours | ||||
16 | 02/09/2019 | Research Tasks | v_2-Qualified Workers | Once you start, you won’t be allowed to retake this test. | ||||
17 | 02/10/2019 | Vered Shwartz | Relationship between News Headline | Relationship between News Headline GreaterThanOrEqualTo 83 | 1 minute | Relationship between News Headlines | Annotating the relationships between two news headlines | |
18 | 02/11/2019 | Vered Shwartz | News Headline Relationships | 1 minute | ||||
19 | 02/12/2019 | Suggestic, Inc. | Menu Items Annotation | 5 minutes | ||||
20 | 02/13/2019 | Martin Schmitt | Familiarity with typed placeholders and inference | 20 minutes | ||||
21 | 02/14/2019 | Fred Vollmer | Image Landmark Selection | 1 hour | ||||
22 | 02/15/2019 | Friedrich Fraundorfer | Semantic Drone Dataset Labeling Qualification v1 | Less than 1 minute | ||||
23 | 02/16/2019 | BIU NLP | What's Missing - test2 | Once you start, you won’t be allowed to retake this test. | ||||
24 | 02/17/2019 | Nathan Stevenson | Financial entity recognition accuracy test | 10 minutes | Answer Verification | Accept | |||
25 | 02/18/2019 | QA Test | Chat about a story -- v4 | |||||
26 | 02/19/2019 | Vered Shwartz | Sentence Relation Labelling | 10 minutes | ||||
27 | 02/20/2019 | Dsys Mturk | Image Content Moderation | 1 minute | ||||
28 | 02/21/2019 | Matt Garner | ShopHero Grocery Product Image Transcription Qualification v1 | 1 day | ||||
29 | 02/22/2019 | Enlearn | SubtractionTest | |||||
31 | 02/23/2019 | Tae Soo Kim | Cataract Surgery Qualification | 1 minute | ||||
33 | 02/24/2019 | Johannes Daxenberger | Argument Similarity BWS | usually >50% correct is enough | 1 day | |||
34 | 02/25/2019 | ROC-NLP-Research | Story Completion 20 | 1 hour | ||||
35 | 02/26/2019 | f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 | Reputation_Polarity_v3 | Unknown - Note: *For Masters | 6 hours | |||
36 | 02/27/2019 | YCharts | YCharts Excel Qualification | Ensures that you are able to open and read Microsoft Excel files with the extension .xlsb | 1 day | |||
37 | 02/28/2019 | Brand Research Dept. | Brand Recognition Qualification Quiz | You must pass at least 18/20 to work on HITs. | 1 day | |||
38 | 03/01/2019 | Flow Mturk | Parking Sign Transcription | 30 minutes | Transcribe Parking Signs | This requester is known to reject at times. He sometimes reverses. | ||
39 | 03/02/2019 | Thor Russell | FIQ Summary Assessor L1 | SpeakingAssessor is greater than 9 | 2 minutes | Check the ID | Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs. | |
40 | 03/03/2019 | Marc O'Relius | Sentiment Qualification | Once you start, you won’t be allowed to retake this test. | ||||
41 | 03/04/2019 | Shaojin Ding | American English Accent Pretest | American English Accent Pretest GreaterThanOrEqualTo 3, Finished taslp20 MOS unseen DoesNotExist | Once you start, you won’t be allowed to retake this test. | Audio Quality Test | In this test, you will evaluate the acoustic quality of 85 short human speech segments. Each speech segment is about 4 seconds. The estimated time of finish the task is 12 mins. | Old TO shows rejections do at your own risk. |
42 | 05/05/2019 | Image Matcher 1.0 | Eagle Eye | |||||
43 | 03/06/2019 | The Theater Lab | DA1.0- Theater Lab responder | 3 days | ||||
44 | 03/07/2019 | amt_qcri | Political Proficiency Test | Political Proficiency Test EqualTo 20 | Less than 1 minute | Analysing Political Leaning of News Articles | Analyse the political leaning of the news article based on the headline and text of the article | |
45 | 03/08/2019 | Prateek Singhal | Qualification Test for question/para mapping | Qualification Test for question/para mapping EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Map the following question to the paragraph/content where the answer to the question may lie. | Please review the following content to figure out where the answer to the posted question may reside | |
46 | 03/08/2019 | rybn | play chess test | play chess test EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Play the next move in chess game!!! | A chessgame HIT that requires a certain score from a qualification test to accept. You must play the next move. | |
47 | 09/02/2019 | CASOS Department | Can you label a tweet's relationship with a another tweet (v2) | Can you label a tweet's relationship with a another tweet (v2)? Exists | 4 days | Label whether reply tweet agree or disagree with target tweet | ||
48 | 03/10/2019 | Bunny Inc. | [audio] Audio sample quality assurance - Audio wave | [audio] Audio sample quality assurance - Audio wave Exists | Once you start, you won’t be allowed to retake this test. | [audio] Audio sample quality assurance #29555 - Audio wave | VoiceBunny is a crowdsourced service to get professional voice over recordings. The objective of these tasks is to check whether the audio samples submitted by voice actors meet the quality criteria of VoiceBunny. | |
49 | 03/11/2019 | Crowdsurf Support | Qualified to work on Transcription Tasks | Qualified to work on Transcription Tasks is not less than 900 | Once you start, you won’t be allowed to retake this test. | Transcribe up to 35 Seconds of Media to Text - Earn up to $0.17 per HIT!! | Transcribe up to 35 seconds of Media into text. Reward amount is variable based on media length. Additional reward amounts will be paid as a bonus. | |
50 | 03/12/2019 | Mattia Samory | Linguistic pattern detection qualification | Once you start, you won’t be allowed to retake this test. | ||||
51 | 03/13/2019 | f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 | External_Entity_Qualification | 70% accuracy to pass | 6 hours | |||
52 | 03/14/2019 | CU Learning Lab | Qualification for HIT: What do you think of these foods | Once you start, you won’t be allowed to retake this test. | ||||
53 | 03/15/2019 | UserBob | Reviewer | UserBob has scores for different level reviewers. This qualification is used to indicate your reviewer level. As you complete shorter reviews for UserBob your reviewer level will be increased allowing you to accept HITs for longer reviews. | 1 minute | UserBob posts various HITS | UserBob HITS are to review a website or app | |
54 | 03/16/2019 | Yandex Inc | Relevance evaluation | Relevance evaluation is 3 | 20 minutes | Relevance of URLs for queries (15 tasks) | We will give you pairs - query and URL (also you will have screenshot of that URL to help you). That are real queries from search systems and real sites. You need to understand is this site contains relevant or useful information for this request or not. | |
55 | 03/17/2019 | RealCME | Family health screening survey | Once you start, you won’t be allowed to retake this test. | ||||
56 | 05/25/2020 | Maze | maze_age_12 | Maze wants to know your age to check if you fit with the targeted audience | 7 days | Small usability task & feedback on a website/app prototype. (~33 minute) | You will see small screenshots from an app or a website and you have small challenges to execute. Earn ~$0.20 per minute | Requester sometimes rejects - Various HITs use this qual which was originally added 3/18/2019 |
58 | 03/19/2019 | shreya | ImageCategorizeQualification_new | Once you start, you won’t be allowed to retake this test. | This test appears to have been removed | |||
59 | 03/20/2019 | Jing Chen | Demographics | 5 minutes | ||||
60 | 03/21/2019 | Amazon Mechanical Turk | Adult Content Qualification | Qualification to work on hits containing adult content. | ||||
61 | 03/22/2019 | Cardcow | Data Entry for Postcards | Data Entry for Postcards is 1 | 10 minutes | Enter Detailed Information for a Postcard | Please view the image contained in this HIT and enter appropriate data | |
62 | 03/23/2019 | AudioKite | Certify that you enjoy listening to music in 7 different genre categories. | 100 | Less than 1 minute | |||
63 | 03/24/2019 | Bunny Inc. | [audio] Audio sample quality assurance - Normalization | Once you start, you won’t be allowed to retake this test. | ||||
64 | 03/25/2019 | Yilin Zheng | Image annotation - watch the video first | Once you start, you won’t be allowed to retake this test. | ||||
65 | 03/26/2019 | iRobot Corp. | TermsAndConditions | 1 | Once you start, you won’t be allowed to retake this test. | |||
66 | 03/27/2019 | Bunny Inc. | [audio] Audio sample quality assurance - Age and gender | Once you start, you won’t be allowed to retake this test. | ||||
68 | 03/28/2019 | PickFu | PickFu NDA | |||||
69 | 03/29/2019 | Fynn Gerken | Financial Experience | Investment Experience EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Investment experiment (~10 mins $$ BONUS UP TO 75 CENTS ) | This is an academic investment experiment (~10 mins). Task involves viewing material and answering related questions. Three very short qualification questions. Flat rate: $0.50. Bonus: up to $0.75 (3 comprehension questions- $0.25 per correct answer). | |
70 | 03/30/2019 | BEAM | Study Qualification 1 | Once you start, you won’t be allowed to retake this test. | ||||
71 | 03/31/2019 | Hamish Brocklebank | Choosing sentiment, emotion and topic for short text | Once you start, you won’t be allowed to retake this test. | Choose sentiment, emotion and topic for short text | Choose sentiment, emotion and topic for short text | ||
72 | 05/25/2020 | Maze | maze_gender_12 | Maze wants to know your gender to check if you fit with the targeted audience for various HITs | 7 days | Small usability task & feedback on a website/app prototype. (~33 minute) | You will see small screenshots from an app or a website and you have small challenges to execute. Earn ~$0.20 per minute | Sometimes rejects - Various HITs use this qual which was originally added 04/01/2019 |
73 | 04/02/2019 | Abhijeet Sangwan | Text Analysis Qualification | This qualification will give workers access to Review Analysis hits. | Less than 1 minute | |||
74 | 04/03/2019 | Paul May | consent | Once you start, you won’t be allowed to retake this test. | ||||
75 | 04/04/2019 | Postech Database Laboratory | SQL Ability | SQL Ability EqualTo 100 | 12 hours | Natural Language to SQL Translation | You will be asked to make corresponding MySQL query for the given Natural Language question. It is required to know MySQL query language. | |
76 | 04/05/2019 | Amazon Requester Inc. - EviMultimedia | Image Quality Ratebility | 15 days | ||||
77 | 04/06/2019 | IWS | Photo moderation - evaluate a photo (some adult content) | Total approved HITs GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 85; Photo moderation - evaluate a photo (some adult content) EqualTo 100; Adult Content Qualification Exists | You will have to wait almost 5 years if you wish to retake this test. | Answer questions about a photo [May include adult content - discretion advised] | Answer 1-10 questions about a photo. May include adult content. Ongoing project for a major website. | |
78 | 04/07/2019 | amturk | xCapture v1.5 | 1 hour | ||||
79 | 04/08/2019 | Amazon Requester Inc. - A9 Data Validation | Category Validation Qualification | |||||
80 | 04/09/2019 | Robert West | Cardio Questionnaire | 10 hours | ||||
81 | 04/10/2019 | John Williamson | Consent | Once you start, you won’t be allowed to retake this test. | ||||
82 | 04/11/2019 | DataAnalysis | paulriv-fitment-qualtest | Less than a minute | ||||
83 | 04/12/2019 | J & B's Research | TBI Qualification | Once you start, you won’t be allowed to retake this test. | ||||
84 | 04/13/2019 | Yibo Zhang | Investment Knowledge and Experience | Finance and Accounting Knowledge is not less than 70 | 4 months | Investor Behavior 2019 | Participants in this HIT will play the role of investors | This test has a 5 minute timer. |
85 | 04/14/2019 | vainu | Company business ID finder | Company business ID finder test is not less than 100 | 1 day | Find the Entity number of a company | In this HIT, your task is to find a entity number for a company name by searching it from the search engine provided by task. | |
86 | 04/15/2019 | vainu | Need Correct Link to Test | Find personal names from business news and earn a Qualification (Computer required) | In this HIT, the task is to identify and highlight any personal names from a series of short business news articles. After finishing, we will automatically score your submission from 0 to 100 based on how accurately you have found the correct entities fro | |||
87 | 04/16/2019 | vainu | Need Correct Link to Test | Find location names from business news and earn a Qualification | In this HIT, the task is to identify and highlight any location names from a series of short business news articles | |||
88 | 04/17/2019 | vainu | Need Correct Link to Test | Vainu Job Title Name Annotations is not less than 80 | Find job title names from business news and earn a Qualification (Computer required) | Your task is to find and highlight all job title names from short business news articles. Please note, that a qualification is required to work on these HITs. | ||
89 | 04/18/2019 | vainu | PDF extraction qualification test (BS) | PDF extraction qualification test (BS) is not less than 80 | 1 day | Find financial values from PDFs (BS) | Find financial values from attached pdf document | |
90 | 04/19/2019 | vainu | Need Correct Link to Test | PDF extraction qualification test (IS) is not less than 80 | 1 day | Find financial values from PDFs (IS) | Find financial values from attached pdf document | |
91 | 04/20/2019 | Mango Languages | Short Spanish Proficiency Test | Short Spanish Proficiency Test is 100 | Once you start, you won’t be allowed to retake this test. | Select the best translation in Spanish for a given word in English. | The task is to select one or more out of three possible translations in Spanish for a common word in English. If none of the proposed translations is acceptable, you are asked to provide a suitable translation. | |
92 | 04/21/2019 | Noah | QualificationA | QualificationA GreaterThanOrEqualTo 80 | 17 minutes | Teaching a bot to modify the world | Imagine you are teaching a bot to modify the world. | Requester has many accounts and has been known to reject |
93 | 04/22/2019 | Foxtrot | Foxtrot English Expert | Foxtrot English Expert GreaterThanOrEqualTo 2 | Once you start, you won’t be allowed to retake this test. | Copy Edit English Text | Correct all spelling, grammar, and style errors in some English text | |
94 | 04/23/2019 | Granola Transcriptions | ingredients | ingredients Exists | Transcribe ingredient text from an image | Write the ingredient text from the given images in the appropriate fields | ||
95 | 04/24/2019 | Hamish Brocklebank | Choosing sentiment, emotion and topic for short text (tweets minified) | Choosing sentiment, emotion and topic for short text (tweets minified) GreaterThan 50 | Once you start, you won't be able to repeat this test. | Choose sentiment, emotion and topic for short text | Choose sentiment, emotion and topic for short text | Qualifications: Location In AU, GB, IE, IL, IN, NL, NZ, PL, US, ZA; Choosing sentiment, emotion and topic for short text (tweets minified) GreaterThan 50; Total approved HITs GreaterThan 100; HIT approval rate (%) GreaterThan 90 |
96 | 04/25/2019 | Briefcam Mechanical Turk | truck_tests_capacity | truck_tests_capacity GreaterThan 16 | Once you start, you won’t be allowed to retake this test. | Rich Classification Tagging | Tag each sequence with the appropriate class | |
97 | 04/26/2019 | EdiRequester | MainTaskQualification | MainTaskQualification EqualTo 100 | 5 minutes | What and where is the object? | Describe the object and its location on the picture. | |
98 | 04/27/2019 | Sébastien Drouyer | Vehicle qualification test | Vehicle qualification test GreaterThan 90 | Once you start, you won’t be allowed to retake this test. | Vehicle annotations on satellite images - NEW | Help us spot where vehicles are on satellite images | |
99 | 04/28/2019 | MTurk Answer Elicitation | Answer Verification Test 3 | Answer Verification Test 3 GreaterThan 22 | 4 days | Rate the quality of an answer based on the provided question | ||
100 | 04/29/2019 | mturk-sandbox | IT Topic Classification | IT Topic Classification EqualTo 100 | 2 days | Categorize the purpose of information technology posts | Categorize short text documents related to IT research, production comparison and problem resolution | |
101 | 04/30/2019 | Ruoyu Jia | Missing word qualify test | Missing word qualify test GreaterThan 75 | Once you start, you won’t be allowed to retake this test. | Rate the Pronunciation of Short English Sentence Recordings | Rate the Pronunciation of Short English Sentence Recordings. For more details, check out the preview. | |
102 | 05/01/2019 | Aakanksha | Linguistic Reasoning Test | Linguistic Reasoning Test EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Label relation between sentences | We will give you a pair of sentences. You will need to determine whether one sentence can be concluded to be true from the other. | |
103 | 05/02/2019 | vainu | Company careers pages finder test | Company careers pages finder test GreaterThanOrEqualTo 100 | 1 day | Find a careers page from a company website | In this HIT, your task is to find a company careers page from a website of a company. | |
104 | 05/03/2019 | vainu | Company websites (SWE) | Company websites (SWE) GreaterThanOrEqualTo 80 | 1 day | Is the given website a homepage of a company or an organization? | Visit the website given below. Is it a homepage of a company or an organization? | |
105 | 05/04/2019 | Noah | Qualification 4A | Qualification 4A is not less than 80 | 17 minutes | Teaching a bot to modify the world | Imagine you are teaching a bot to modify the world. | Requester has many accounts and has been known to reject |
106 | 05/05/2019 | salathegroup | Instructional quiz for tracing food items | Once you start, you won’t be allowed to retake this test. | Trace the food items in an image | Select food category and trace a path around each food item in this image | ||
109 | 05/08/2019 | BIU NLP | 'Writing and answering questions on a sentence' test score (%) | Writing and answering questions on a sentence' test score (%) is not less than 90 | 2 minutes | Write question-answer pairs about a word | Given a sentence containing a single highlighted word, Your goals are: (1) write questions about that word which are answerable by the sentence and (2) mark their respective answers in the sentence. | |
110 | 05/09/2019 | Enlearn | AddFractions3 | AddFractions2 is not one of: 0, 1, 2, 3, 4, 5, 6, 7 AddFractions3 is greater than 0 | Once you start, you won’t be allowed to retake this test. | Learn how to solve math problems involving fractions. | Work through math problems using our learning website | |
111 | 05/10/2019 | Benjamin Tan | Screening qualification to perform annotation tasks. (NOTE: You can take the pre-screening test here before you take the qualification test: https://goo.gl/forms/qJUkBzc6joDbENMt2) | Screening qualification to perform annotation tasks. | 1 minute | This qualifies you for various types of HITS from this Requester. | This qualifies you for various types of HITS from this Requester. | |
112 | 05/11/2019 | Thor Russell | SpeakingAssessor | 2 minutes | ||||
113 | 05/12/2019 | vainu | Vainu Entity Annotations Qualification | Vainu Entity Annotations Qualification is not less than 90 | 5 days | Find organization, personal, location and job title names in business news articles | Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs. | |
114 | 05/13/2019 | vainu | Company references qualification test | Company references qualification test is not less than 80 | 1 day | Find the references page of a given website | Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs. | |
116 | 05/14/2019 | Enlearn | AddFractions4 | AddFractions4 is greater than 0 | Once you start, you won’t be allowed to retake this test. | Learn how to solve math problems involving fractions. | Work through math problems using our learning website. | |
119 | 05/15/2019 | Yohan Jo | Pre-task for Criticism Annotation | Pre-task for Criticism Annotation GreaterThanOrEqualTo 22 | Once you start, you won’t be allowed to retake this test. | Criticism Annotation | Read argumentative dialogues and annotate criticisms. Fun for workers who love argumentation and critical thinking! Workers must be aged 18 or older, fluent in English (native or bilingual), and pursuing/having a Bachelor's degree. | |
120 | 05/16/2019 | Yohan Jo | Pre-task for Counterexample Annotation | Pre-task for Counterexample Annotation GreaterThan 97 | Once you start, you won’t be allowed to retake this test. | Counterexample Annotation | Read argumentative dialogues and annotate counterexamples. Fun for workers who love argumentation and critical thinking! Workers must be aged 18 or older, fluent in English (native or bilingual), and pursuing/having a Bachelor's degree. | |
121 | 05/17/2019 | Darina Benikova | Comparison Specificity | Comparison Specificity GreaterThanOrEqualTo 40 | 10 minutes | |||
122 | 05/18/2019 | Noah Turk | Product Similarity Qualification | Product Similarity Qualification is 5, Masters is Granted | 3 hours | Check if two web pages describe the same product | Given 2 URLs and images decide if two web pages describe the same product | Requester has many accounts and has been known to reject |
123 | 05/19/2019 | Vered Shwartz | Phrasal Verbs | Phrasal Verbs is 100 | 1 minute | Phrasal Verbs | In this task you will be given a sentence with a highlighted span, and asked to identify the (phrasal) verb in the span | |
124 | 05/20/2019 | FA-Turkmaster | Pre-Screened (copy editing) | 1 | Once you start, you won’t be allowed to retake this test. | Copy Editing | This Qualification has been deactivated You cannot request this Qualification because its Author has deactivated it. | |
125 | 05/21/2019 | Gemma Boleda | DataProtectionv0.1 | 100 | 2 min | Name objects in images | Name the object in the red box with the first name that comes to mind | Timer set to 25 seconds. Read it all, close the window and start over after 2 minutes. |
126 | 05/22/2019 | shreya | ImageCategorizeQualification | 80 | Once you start, you won't be able to retake this test | Categorize each image and describe in words | This task include images of indoor and outdoor scenes and they have to be categorized in their respective classes | Categorize rooms in houses |
127 | 05/23/2019 | Kazuhiro Ota | QT Passed Workers | 100 | 5 minutes | Judge the quality of video descriptions | Review two video clips and an associated video description and judge the quality of the description. | Also need Adult Qualification |
128 | 05/24/2019 | UKP Lab, TU Darmstadt | Argument Similarity BWS | Argument Similarity BWS GreaterThanOrEqualTo 50; Total approved HITs GreaterThanOrEqualTo 1000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 98 | 1 Day | Argument Similarity | ||
129 | 05/25/2019 | GSV Urban Data Lab | GSV Trash Single Image Survey | Qualifications: GSV Trash Single Image Survey GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 90; Location EqualTo US | less than a minute | GSV Trash Single Image | Determine whether the streetview image contains trash | |
130 | 05/28/2019 | Hamish Brocklebank | Choosing sentiment and emotion for comments in Spanish | Location is one of: AR, BO, CL, CO, CR, DO, EC, ES, GQ, GT, HN, MX, NI, PA, PE, PR, PY, SV, US, UY, VE HIT approval rate is greater than 90 Total approved HITs is greater than 100 Choosing sentiment and emotion for comments in Spanish is greater than 50 | Once you start, you won’t be allowed to retake this test | 1 min: Choose sentiment and emotion for short text in Spanish | 1 min: Choose sentiment and emotion for short text in Spanish | |
132 | 06/01/2019 | MLDataLabeler | BoundingBoxTestScore | BoundingBoxTestScore is not less than 84 | You will have to wait 1 day if you wish to retake this test | Bounding Box Tasks | Bounding Box Tasks | After this test is completed/passed, you MUST do the accompanying qualification HIT. It may not always be available. |
133 | 06/03/2019 | MLDataLabeler | SemSegTestScore | SemSegTestScore is not less than 84 | You will have to wait 1 day if you wish to retake this test | Semantic Segmentation | Semantic Segmentation Tasks | You have to do a hit after this test to get the qualification for Segmentation Tasks |
134 | 06/12/2019 | Hamish Brocklebank | Choosing sentiment and emotion for an opinion | Location In AU, GB, IE, IL, IN, NL, NZ, PL, US, ZA; Total approved HITs GreaterThan 100; HIT approval rate (%) GreaterThan 90; Choosing sentiment and emotion for an opinion GreaterThan 50 | Once you start, you won’t be allowed to retake this test. | Choose sentiment and emotion for short text | 1 min: Choose sentiment and emotion for short text | |
135 | 06/29/2019 | Brex | Business Categorization Test | Business Categorization Test is not less than 100 | 2 minute | Identify this business | Instructions: https://www.dropbox.com/s/nragfkasaos7483/Instructions.pdf?dl=0 | |
136 | 08/09/2019 | MLDataLabeler | NamedEntityRecognitionTestScore | NamedEntityRecognitionTestScore is not less than 80 | 1 day | Qualifying HIT for Named Entity Recognition Tasks | Qualifying HIT for Named Entity Recognition Tasks | |
137 | 08/11/2019 | vainu | Vainu Entity Annotations Qualification 2 | Vainu Entity Annotations Qualification 2 is not less than 100 | 6 hours | Find organization, personal, location and job title names in business news articles (Computer required) | Your task is to find and highlight all the organization, personal, location and job title names in a business news article. Please note, that a qualification is required to work on these HITs | You also need this qualification to do these hits: Vainu Complete Name Annotations qualification for excellent workers is not less than 90 |
138 | 08/11/2019 | Yihan Lu | Java related knowledge test | Java related knowledge test is not less than 60 | 30 minutes | Explain each line of code in a Java file | Write brief explanation for the line in the given java code. | |
139 | 08/11/2019 | Vivien | Language Qualification Test | Language Qualification Test is 100 | Once you start, you won’t be allowed to retake this test. | Answer a survey about similar sounding words | Answer questions about your language background and Generate similar sounding words | |
140 | 08/11/2019 | EdiRequester | Summary evaluation qualification | Summary evaluation qualification is not less than 7 | Once you start, you won’t be allowed to retake this test. | Summary evaluation | This task it about evaluation of system generated summaries for reviews. | Masters Required |
144 | 10/04/2019 | MIT Lincoln Laboratory | Labeling Qualification | Not sure at this time | 10 minutes | Not sure at this time | 15c to tag a picture for disaster damage | |
145 | 10/17/2019 | Mattia Samory | Sexism Detective | Location is US, HIT approval rate (%) is not less than 99, Sexism Detective is not less than 80, Total approved HITs is greater than 10000 | 1 Day | That's sexist! Identify different types of sexism | Tell us whether a sentence is sexist or not, and help us understand why is it sexist | Requester can be contacted at TurkerNation Slack |
146 | 11/22/2019 | Ai2 Israel | Missing Verbs | Missing Verbs equalto 100 Total approved HITs is greater than 5000, HIT approval rate (%) is greater than 97 | 1 min | Missing Verbs | Given a question, write down the steps that should be taken in order to return its answer. | Requester is a member of Turker Nation |
147 | 12/27/2019 | Ai2 Israel | Grammatical Sentences2 | HIT Approval not less than 99, Location one of: AU, CA, GB, US, Grammatical Sentences2 is 100 | No retakes | Is This Sentence Grammatical? | You'll be given sentences and have to decide whether or not they are grammatical. | Requester is a member of TurkerNation |
148 | 05/26/2020 | Jade Yu | Native English Speaker Qualification Test (01) | Native English Speaker Qualification Test (01) EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Symmetry of English Sentences | Rate degrees of symmetry for sentence pairs | |
149 | 01/07/2020 | Supernova | Trend Validation Test | Trend Validation Test GreaterThanOrEqualTo 70 | Once you start, you won’t be allowed to retake this test. | Trend Validation | Following are some tweets that were extracted from a set of tweets. Each set of keywords come with a few tweets. Validate if the keywords together are any kind of current trends | Rejections reported earlier, have since been reversed. |
150 | 01/07/2020 | new-admin | atEvent Transcription Qualification | HIT approval rate (%) GreaterThan 70; atEvent Transcription Qualification EqualTo 100 | You will have to wait 1 minute if you wish to retake this test. | Business Card Reader | Transcribe the text contained in the Business Card. | |
151 | 01/08/2020 | Caleb | Cyberbullying detection score | Cyberbullying detection score GreaterThanOrEqualTo 80; Bot list DoesNotExist ; Total approved HITs GreaterThanOrEqualTo 500; HIT approval rate (%) GreaterThanOrEqualTo 98; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Identifying cyberbullying on Twitter (WARNING: This HIT may contain adult content. Worker discretion is advised.) | You can help identify cyberbullying and non-cyberbullying cases on Twitter by classifying tweets according to 5 important criteria | |
152 | 01/14/2020 | MPI Dept of Perceiving Systems | Consent agreement for Can you mimic the pose? version 2 | Consent agreement for Can you mimic the pose? version 2 EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Can you mimic the pose | Mixed TO, proceed with caution | |
154 | 01/14/2020 | Ai2 Israel | Consecutive Sentences - Entailment | Total approved HITs GreaterThanOrEqualTo 5000; HIT approval rate (%) GreaterThanOrEqualTo 99; Location In AU, CA, GB, US, Consecutive Sentences - Entailment equal to 100 | Once you start, you won’t be allowed to retake this test. | Answer a question about two sentences | Given you know that the first sentence is true, is the second sentence also true? | Requester is a member of Turker Nation |
156 | 01/17/2020 | Brex | Business Identification Test | Total approved HITs GreaterThan 200; Business Identification Test GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThanOrEqualTo 95 | You will have to wait 5 minutes if you wish to retake this test. | Identify this business (12 cent bonus for matched answer!) | Based on the information provided, determine the correct name of the business / merchant and its website. (12 cent bonus if your answer matches another independent worker's!) | |
157 | 01/24/2020 | Kyle Harris | Get Data from a PDF and the Web | Location In AO, AS, AU, BD, CA, FJ, GB, GI, JM, KY, MP, NZ, PK, TO, TT, US; Total approved HITs GreaterThanOrEqualTo 700; Get Data from a PDF and the Web GreaterThanOrEqualTo 70; HIT approval rate (%) GreaterThanOrEqualTo 98 | Once you start, you won’t be allowed to retake this test. | Review legal complaint for contact information. | Review the given pdf file containing a legal complaint and collect the information as requested. Some information requires some searching the internet. | |
158 | 01/24/2020 | RPI facs | AU1 (Inner Brow Raiser) BP4D+ Onset | AU1 (Inner Brow Raiser) BP4D+ Onset is greater than 7 | You will have to wait 1 minute if you wish to retake this test. | Not known | Not known | |
159 | 01/24/2020 | Ai2 Israel | Consecutive Sentences - Entailment, flip | Total approved HITs GreaterThanOrEqualTo 5000; Location In AU, CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99; Consecutive Sentences - Entailment, flip EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Answer a question about two sentences | Given you know that the first sentence is true, is the second sentence also true? | Requester posts on TN |
160 | 01/24/2020 | Reef Diver | Reef Classfication - Qualification Test (QUT)623 | Reef Classfication - Qualification Test (QUT)623 GreaterThanOrEqualTo 60 | 1 minute | Coral Reef Image Classification | Identify coral reef features on photos from the Great Barrier Reef. (15 points per image … Est 1 min) | Quote from Requester, "FYI Assignments are rejected when they get very poor accuracy regardless of the Worker history and eventually this could happen to anyone. We are mindful of this and hoping to limit the number of rejections in the future." |
161 | 01/24/2020 | RealCME | Health discussion screening survey | Health discussion screening survey GreaterThanOrEqualTo 70; Health presentation participant DoesNotExist ; Location EqualTo US | Once you start, you won’t be allowed to retake this test. | A health coach presentation and assessment | For this HIT, qualified workers will complete a 15 to 30 minute coaching activity about their health. Please enter the code provided at the end of the survey to submit. | |
162 | 01/24/2020 | Northeastern U. DataVis Studies | SQL qualification test | SQL qualification test GreaterThanOrEqualTo 66; Worker attempted/completed Understanding SQL Queries -- $5.20 to $16.47 with bonuses HIT previously DoesNotExist ; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Understanding SQL Queries -- $5.20 to $16.47 with bonuses | ||
163 | 01/27/2020 | BIU NLP | Paraphrases alignment | Paraphrases alignment EqualTo 100; Total approved HITs GreaterThanOrEqualTo 1000; HIT approval rate (%) GreaterThanOrEqualTo 90 | Once you start, you won’t be allowed to retake this test | Annotate alignment between predicate paraphrases | Annotate whether two predicates are entailment or not | |
164 | 01/27/2020 | vainu | Find social media company page links for a company | Total approved HITs GreaterThanOrEqualTo 100; Find the Facebook page of the company blacklist DoesNotExist ; Find social media company page links for a company GreaterThanOrEqualTo 95; HIT approval rate (%) GreaterThanOrEqualTo 90 | 1 Day | Find the Facebook page of the company | Find the Facebook page of the company by googling with the company name | |
165 | 01/27/2020 | vainu | Company websites (SWE) 190114 | Total approved HITs GreaterThanOrEqualTo 100; What kind of website is this? 9ad0fc812a614879b383fbb1b5e9c88f blacklist DoesNotExist ; Company websites (SWE) 190114 GreaterThanOrEqualTo 99; HIT approval rate (%) GreaterThanOrEqualTo 90 | 1 Day | What kind of website is this? | In this HIT, your task is to determine what category does a website belong to. | |
166 | 01/27/2020 | komachi_lab | Architecture | HIT approval rate (%) GreaterThan 80; Architecture EqualTo 100; Location EqualTo US | 7 days | Determine if sentences require reference. | Step1: Read a sentence. /Step2: Think about whether you can trust informations of sentence. /Step3: Evaluate the degree that can be trusted by 1 to 4. | |
167 | 05/16/2022 | Varieties of Egalitarianism | VoE_en_United Kingdom | Location In GB, IE; VoE_en_United Kingdom GreaterThanOrEqualTo 70; VoE_performance NotIn 1 | No retakes | Statements about inequality, social justice and equal treatment | Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? | This is the test for the UK, but also accessible to those located in Ireland. Separate test also available for Ireland. (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned. |
169 | 01/27/2020 | Allen NLP | narrativeqa | Total approved HITs GreaterThanOrEqualTo 5000; narrativeqa Exists ; Location In CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99 | Once you start, you won’t be allowed to retake this test. | Judge whether two answers are the same | Read a short paragraph, and determine whether two answers are equal with respect to a question. | |
170 | 01/28/2020 | David Elling | Word Rating Task Qualification | HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Word Rating Task Qualification Exists ; Location EqualTo US; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Rate offensiveness of words | Go through a list of 10 words and for each one, rate how offensive it is on a scale of 1 (not offensive at all) to 10 (highly offensive) | |
172 | 01/31/2020 | Supernova | Grammar Check | Not known | 2 hours | Not known | not known | Some HITs rejected and later reversed. Proceed with caution |
174 | 02/10/2020 | Patrik Jonell | Demographic qualification | Demographic qualification Exists ; Total approved HITs GreaterThan 10000; HIT approval rate (%) GreaterThan 98; Has done this or similar HIT DoesNotExist ; qualification: 3236663131 Exists | Once you start, you won’t be allowed to retake this test. | Experiment Rating virtual character gesticulation | ||
175 | 02/11/2020 | FA-Turkmaster | Pre-Screened (copy editing) | Copy Editor DoesNotExist ; Pre-Screened (copy editing) GreaterThanOrEqualTo 80; Location EqualTo US; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Copy Editing Screener | This HIT is used to screen for potential future copy editing HITs at a higher reward. Edit several answers to questions correcting spelling, grammar, casing, punctuation, etc. | Adult Content Qualification (See 03/21/2019 in this table) |
176 | 02/11/2020 | FA-Turkmaster | Screened (opened packaging) | Screened (opened packaging) GreaterThanOrEqualTo 80; Location EqualTo US; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Product Photo Verification (WARNING: This HIT may contain adult content. Worker discretion is advised.) BATCH: 850458 | Answer 2 questions about a given photo. | Adult Content Qualification (See 03/21/2019 in this table) |
177 | 02/11/2020 | Matt Garner | ShopHero Grocery Product Image Transcription Qualification v1 | ShopHero Grocery Product Image Transcription Qualification v1 GreaterThanOrEqualTo 1; Location NotEqualTo IN; HIT approval rate (%) GreaterThanOrEqualTo 95 | You will have to wait 1 day if you wish to retake this test. | Transcribe Product Details from Product Image | Update product brand, name, and package size from product image | |
178 | 02/11/2020 | Alexa Shopping NLP Research | ShoppingDialogDataUsageAcknowledgement | Total approved HITs GreaterThanOrEqualTo 100; ShoppingDialogMaxHITsPerWorker DoesNotExist ; ShoppingDialogDataUsageAcknowledgement GreaterThanOrEqualTo 0; HIT approval rate (%) GreaterThanOrEqualTo 80; Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Shopping Dialog 1_1 | Teach a conversational agent to find better products with your voice. | |
179 | 02/15/2020 | Michael Mayfield | Grammar Test | Grammar Test GreaterThanOrEqualTo 80 | Once you start, you won’t be allowed to retake this test. | Correct this sentence | Correct the sentence as necessary. | |
180 | 02/17/2020 | CEL | CEL Qualification | Total approved HITs >= 100, CEL Qualification EqualTo 100, HIT approval rate (%) >= 98, Location EqualTo US, | Once you start, you won’t be allowed to retake this test. | Academic psychology study Women (~5-10 minutes) | This study has a prescreening qualification test that should take less than 30 seconds. | |
181 | 02/21/2020 | Servify US | Image filtering QR1 | Image filtering QR1 GreaterThanOrEqualTo 90; Total approved HITs GreaterThanOrEqualTo 10000; HIT approval rate (%) GreaterThanOrEqualTo 99 | 5 minutes | Batch 1/4. Front Panel Image filter | The given image is of the Front Panel of a smartphone. Do you see any cracks? Choose 'Yes' if it has cracks. Else, choose 'No'. | Requester is a member of TurkerNation |
182 | 02/23/2020 | AudioKite | Likes Pop / Dance | Likes Pop / Dance GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a pop song and answer a survey about it. | A musician or label is seeking feedback on a pop song from people in the United States who enjoy pop music. Listen to the song for at least 30 seconds and answer a survey about it. | |
183 | 02/23/2020 | AudioKite | LIKESJAZZ | LIKESJAZZ GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a jazz-blues song and answer a survey about it. | A musician or label is seeking feedback on a jazz-blues song from people in the United States who enjoy jazz-blues music. Listen to the song for at least 30 seconds and answer a survey about it. | |
184 | 02/25/2020 | AudioKite | Likes Hip Hop / Rap / R&B | Likes Hip Hop / Rap / R&B GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a hiphop-rap song and answer a survey about it. | A musician or label is seeking feedback on a hiphop-rap song from people in the United States who enjoy hiphop-rap music. Listen to the song for at least 30 seconds and answer a survey about it. | |
185 | 02/25/2020 | AudioKite | Genre Category: Instrumental | Genre Category: Instrumental GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a instrumental song and answer a survey about it. | A musician or label is seeking feedback on a instrumental song from people in the United States who enjoy instrumental music. Listen to the song for at least 30 seconds and answer a survey about it. | |
186 | 02/25/2020 | AudioKite | Likes Folk Music | Likes Folk Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a folk song and answer a survey about it. | A musician or label is seeking feedback on a folk song from people in the United States who enjoy folk music. Listen to the song for at least 30 seconds and answer a survey about it. | |
187 | 03/01/2020 | AudioKite | Likes Country Music | Likes Country Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a country song and answer a survey about it. | A musician or label is seeking feedback on a country song from people in the United States who enjoy country music. Listen to the song for at least 30 seconds and answer a survey about it. | |
188 | 03/01/2020 | AudioKite | Likes Electronic / Avant-Garde | Likes Electronic / Avant-Garde GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a electronic song and answer a survey about it. | Listen to a electronic song and answer a survey about it. | |
189 | 03/01/2020 | AudioKite | Genre Category: Other | Genre Category: Other GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | less than a minute | Listen to a other song and answer a survey about it. | A musician or label is seeking feedback on a other song from people in the United States who enjoy other music. Listen to the song for at least 30 seconds and answer a survey about it. | |
190 | 03/01/2020 | justin cechmanek | Bounding Boxes Around Holes | Once you start, you won’t be allowed to retake this test. | Draw bounding boxes tightly around screw and bolt holes in PCBs | Draw bounding boxes tightly around screw and bolt holes in printed circuit boards (PCBs) | Proceed with caution, appears to have affiliation with Bright Machines. However, has not shown rejections yet, so they might be turning over a new leaf. | |
191 | 03/07/2020 | Virginia Tech Cloud Interpretation Group | Tree Canopy Classification Qualification | Not known | Not known | Photo interpretation of tree canopy using dot grid | We will test the use of crowdsourced photo interpretations of canopy cover to validate national products. Crowd-workers will interpret percent TCC using a 100-dot-grid overlain on 1-meter NAIP imagery. | Requester is a member of Turker Nation. |
192 | 03/23/2020 | Guanlong | american_accent_pretest_2020 | Participated in Mel audio quality test 2020 DoesNotExist ; american_accent_pretest_2020 EqualTo 3; Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Rate audio quality of speech recordings [~15min to finish; fast-approval] | Please rate the audio quality of the given sound clips following the instructions in the HIT. Worry-free submission -- automatically checks for unfinished questions before submitting! Fast approval. Good reviews from previous participants. | |
193 | 03/23/2020 | UKP Lab, TU Darmstadt (aka Tilman Beck) | Argument Annotation Qualification (real) | Not known | Once you start, you won’t be allowed to retake this test | Rating arguments for given topics | Not known | |
194 | 03/23/2020 | komachi_lab | https://worker.mturk.com/qualifications/3EZ90CUA4SQ9SEB29ZY4EW3RWY3WIF Enginnering | Enginnering EqualTo 100; HIT approval rate (%) GreaterThan 80; Location EqualTo US | You will have to wait 7 days if you wish to retake this test. | Determine if sentences require reference. | Step1: Read a sentence. /Step2: Think about whether you can trust informations of sentence. /Step3: Evaluate the degree that can be trusted by 1 to 4. | |
195 | 03/28/2020 | Whooosreading.org | Identify which sentence contains the most text detail | Identify which sentence contains the most text detail GreaterThanOrEqualTo 80 | Once you start, you won’t be allowed to retake this test. | Pick the most detailed sentence | The following sentences were pulled from responses to some open-ended questions about a book. Please read each pair of sentence and select the one that gives the most factual information about the book. | You need this qual to take the qual HITs. Please note that rejections were reported in the past but he seems to be better now. |
196 | 04/18/2020 | Ai2 Israel | sentence similarities | Total approved HITs is equal or greater than 5000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location is one of AU, CA, GB, US, sentence similarities is 100 | Once you start, you won’t be allowed to retake this test. | Answer questions about two similar sentences | you will be presented with multiple Yes/No questions, based on two similar sentences | Requester posts and answers questions at TurkerNation. |
197 | 05/04/2020 | AudioKite | Genre Category Children's | Genre Category: Children's GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, | You will have to wait less than a minute if you wish to retake this test. | Listen to a childrens song and answer a survey about it | ||
198 | 05/04/2020 | AudioKite | Likes Hard Rock / Heavy Metal Music | Likes Hard Rock / Heavy Metal Music GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, | You will have to wait less than a minute if you wish to retake this test. | Listen to a hard-rock song and answer a survey about it | ||
199 | 05/04/2020 | AudioKite | Likes EDM / Dance Music | Likes EDM / Dance Music GreaterThanOrEqualTo 1; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US | You will have to wait less than a minute if you wish to retake this test. | Listen to a edm-dance song and answer a survey about it | ||
200 | 05/05/2020 | AudioKite | Likes Indie / Rock / Alternative | Likes Indie / Rock / Alternative GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, | less than a minute | Listen to a indie-alternative song and answer a survey about it | A musician or label is seeking feedback on a indie-alternative song from people in the United States who enjoy indie-alternative music. | |
201 | 05/05/2020 | Plancky | Public Data Test | Masters Exists, Public Data Test GreaterThan 100 | Once you start, you won’t be allowed to retake this test. | Does the business have any arcade games on premises? | Choose the appropriate category that best suits the company. Use any text, reviews, photos, etc. | |
202 | 05/05/2020 | EX Research | Test task #1 | Test task #2 GreaterThanOrEqualTo 10, Test task #3 GreaterThanOrEqualTo 10, Test task #1 GreaterThanOrEqualTo 10, | Once you start, you won’t be allowed to retake this test. | Find the correct LinkedIn profile of an Attorney | This is an easy task. It should take you less than 5 minutes. But it requires you to have a LinkedIn account (sign up is free at www.linkedin.com) and it requires you to pay attention to details. | Requires you to have a LinkedIn account |
203 | 05/08/2020 | COG Annotations | Cone Q Medical Test | Cone Q Medical Test GreaterThanOrEqualTo 2 , HIT approval rate (%) GreaterThanOrEqualTo 75, | Medical Image Hand Key-point Annotations (~7-8 minutes) | Please proceed only if you are comfortable viewing images from an operating room. You will be task with placing bounding boxes and markers on joints of hands in single images. Submit after annotating frame. | ||
204 | 05/08/2020 | Aristo | Verify the plausibility of the middle sentence | Location In AUGBUS, Total approved HITs GreaterThanOrEqualTo 10000, Verify the plausibility of the middle sentence GreaterThanOrEqualTo | about 6 hours | Verify the plausibility of the middle sentence (pilot 2) | n this HIT, you will be shown a short 3-sentence story. The task requires you to mark if the middle sentence is correct. | |
205 | 05/08/2020 | DanielHendrycks | Utiliarianism Qualification Round | Utiliarianism Qualification Round GreaterThanOrEqualTo 31 | 1 day | Write scenarios then rank them by how enjoyable they are. | Write scenarios of varying degrees of pleasantness. Then rank these four scenarios by how enjoyable they are to the person in the scenarios. | |
206 | 05/08/2020 | Fritz&Hammer Crowdsourcing | Simple Breach | Global Soft Block DoesNotExist, Simple Breach GreaterThanOrEqualTo 79 Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location EqualTo US, Adult Content Qualification EqualTo 1 | about 1 month | Does a document describe a data security breach? | Read a document and determine whether it describes a data security incident (expected duration ~1 minute, no adult content) | Requires Adult Content Qualification (See 03/21/2019 in this table) |
207 | 05/08/2020 | PFT | Language ES | Language ES GreaterThanOrEqualTo 100 | 5 minutes | [Español] Clasificar una frase generada por el usuario | [Español] Clasifique una oración generada por el usuario dependiendo de si la intención que expresa es la misma que otras oraciones de ejemplo. | |
208 | 05/08/2020 | PFT | Language EN | Location EqualTo ES, Language EN GreaterThanOrEqualTo 100 | 5 minutes | [Español] Clasificar una frase generada por el usuario | [Español] Clasifique una oración generada por el usuario dependiendo de si la intención que expresa es la misma que otras oraciones de ejemplo. | |
209 | 05/08/2020 | Anurag Das | American accent test | American accent test EqualTo 100 accent test batch 1 DoesNotExist | Once you start, you won’t be allowed to retake this test. | Test on voice and/or accent similarity | Please rate the similarity of the voice/accent of the sounds in each pair | |
210 | 05/08/2020 | AudioKite | Genre Category: Punk | Genre Category: Punk GreaterThanOrEqualTo 1 | less than a minute | Listen to a punk song and answer a survey about it. | A musician or label is seeking feedback on a punk song from people in the United States who enjoy punk music. Listen to the song for at least 30 seconds and answer a survey about it. | The qualification test is to confirm you enjoy listening to the designated genre. |
211 | 05/08/2020 | GMM Benchmark | Image Label Qualification Test | Faces Dataset Evaluated DoesNotExist, Image Label Qualification Test GreaterThan 64 | Once you start, you won’t be allowed to retake this test. | Determine whether the images are real or fake | Decide whether each image is real or a computer generated fake. Workers will be given a $0.02 bonus for each correct answer. | |
212 | 05/08/2020 | AudioKite | Likes R&B Music | Likes R&B Music GreaterThanOrEqualTo 1 | less than a minute | Listen to a randb song and answer a survey about it. | A musician or label is seeking feedback on a randb song from people in the United States who enjoy randb music. Listen to the song for at least 30 seconds and answer a survey about it. | |
213 | 05/08/2020 | PFT | Language DE | Language DE GreaterThanOrEqualTo 100 Location EqualTo DE, Language EN | 5 minutes | [Deutsch] Formulieren Sie Sätze mit Ihren eigenen Worten um | [Deutsch] Formulieren Sie Sätze mit Ihren eigenen Worten um | |
214 | 05/08/2020 | PFT | Language IT | Language IT GreaterThanOrEqualTo 100 Location EqualTo IT, Language EN GreaterThanOrEqualTo 100 | 5 minutes | [Italiano] Riformulate le frasi con parole vostre | [Italiano] Riformulate le frasi con le vostre parole | |
215 | 05/08/2020 | MLDataLabeler | NamedEntityRecognitionTestScore | NamedEntityRecognitionTestScore GreaterThanOrEqualTo 80 NamedEntityRecognitionSeparateQualHIT GreaterThanOrEqualTo 80, 9f9cab21-bb6b-4f3b-8f76-533778e3f752 DoesNotExist, WorkersBlockedDueToPoorWorkQuality DoesNotExist | 1 day | Select and label short bits of text | Select parts of the text that correspond to the available categories | |
216 | 05/08/2020 | vainu | Find the website of a given company | Total approved HITs GreaterThanOrEqualTo 100, Find the website of a company 7efa4e36178f4103876303ed072537a0 blacklist DoesNotExist, Find the website of a given company GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90 | 1 day | Find the website of a company | Search this company from google and find out | |
217 | 05/14/2020 | Hot Shop | English Tier 1 | Total approved HITs GreaterThan 1000, English Tier 1 Exists | Once you start, you won’t be allowed to retake this test. | Write 60 words product description from images and title (good english required) | Write a product description which describes the features and benefits of the given product to a customer. | Used to reject, made a qual to reduce rejections. You'll need good English grammar and attention to detail. Also a rejection cushion would be good |
218 | 05/21/2020 | DanielHendrycks | Obligations Qualification Type | Obligations Qualification Type GreaterThanOrEqualTo 31, Location In CAGBUS, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 499 | You will have to wait 1 day if you wish to retake this test. | Write Requests and Reasonable or Unreasonable Excuses | Write a reasonable request or command. Then write reasonable and unreasonable excuses | |
219 | 05/14/2020 | DanielHendrycks | Virtue/Vice Qual | Location In CAGBUS, Virtue/Vice Qual GreaterThanOrEqualTo 41, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 499 | You will have to wait 5 days if you wish to retake this test. | Write Scenarios Demonstrating Different Virtues and Vices | Write scenarios that each demonstrate a different character trait/virtue/vice. | |
220 | 05/14/2020 | Jared Johansen | Convert text into robot instructions test | Convert text into robot instructions test (Golden Level) DoesNotExist, Convert text into robot instructions test EqualTo 100, Total approved HITs GreaterThan 1000, Location In AUCAGBUS, HIT approval rate (%) GreaterThan 90 | Once you start, you won’t be allowed to retake this test. | Interpret directions into robot commands | You are given a set of directions. Answer some questions about it and convert them into robot commands. | |
221 | 05/14/2020 | AudioKite | Likes World Music | Likes World Music GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US | You will have to wait less than a minute if you wish to retake this test. | Listen to a world song and answer a survey about it. | A musician or label is seeking feedback on a world song from people in the United States who enjoy world music. Listen to the song for at least 30 seconds and answer a survey about it. | |
222 | 05/14/2020 | gmk34 | DelibotOnboardingTest | DelibotOnboardingTest GreaterThanOrEqualTo 100, Location In AU CA GB IE US, DelibotDONE DoesNotExist, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 | Once you start, you won’t be allowed to retake this test. | Chat and solve a problem! [up to 1.5$ BONUS for completing every step] (~10-15 mins) | You will be part of a small-group chat between 3 people, where you will try solving a simple puzzle. | Warning on TO regarding technical difficulty. |
223 | 05/14/2020 | Jared Johansen | Convert text into robot instructions test v2 | Convert text into robot instructions test (Golden Level) DoesNotExist, Total approved HITs GreaterThan 100, Location In AU CA GB US, Convert text into robot instructions test v2 EqualTo 100, HIT approval rate (%) GreaterThan 90 | Once you start, you won’t be allowed to retake this test. | Interpret directions into robot commands | You are given a set of directions. Answer some questions about it and convert them into robot commands. | |
224 | 05/14/2020 | AudioKite | Genre Category: Christian | Genre Category: Christian GreaterThanOrEqualTo 1, HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US :heavy_plus_sign: 1 | You will have to wait less than a minute if you wish to retake this test. | Listen to a christian song and answer a survey about it | A musician or label is seeking feedback on a christian song from people in the United States who enjoy christian music. Listen to the song for at least 30 seconds and answer a survey about it. | |
225 | 05/14/2020 | SG AMT | ContentDisclaimer | ContentDisclaimer GreaterThanOrEqualTo 100 | You will have to wait less than a minute if you wish to retake this test. | QUALIFICATION TASK - What emotion do you hear in this audio? | Listen to short (~2sec) audio clips and choose from a list of emotions. This is the unpaid qualification task, it takes around 5 minutes and is required for working on paid HITs | |
226 | 05/14/2020 | Ria | TookCovid19Test | TookQuizOnCOVID19 DoesNotExist, TookCovid19Test Exists | Once you start, you won’t be allowed to retake this test. | Collaborative Fact Checking | Fact checking of statements about COVID-19 and image identification | |
227 | 05/25/2020 | Brandon | Consent_Agreement | Consent_Agreement EqualTo 1, Masters Exists, Adult Content Qualification EqualTo 1 | You will have to wait less than a minute if you wish to retake this test. | Semantic Similarity of Documents | Classification of documents based on the sentiment of the text. | Requires Masters and the Adult Content Qualification (See 03/21/2019 in this table) |
228 | 05/25/2020 | DanielHendrycks | Desert Task Qualification Type. | Location In CA GB US, HIT approval rate (%) GreaterThan 97, Desert Task Qualification Type. GreaterThanOrEqualTo 41, Total approved HITs GreaterThan 999 | You will have to wait 1 day if you wish to retake this test. | Write About Things That People Deserve or Dont Deserve | Write sentences about deserving or being entitled to something. The sentences should say what the person thinks they deserve, from whom they deserve it, and why they deserve it. | |
229 | 05/25/2020 | DanielHendrycks | Impartiality Task Qualification Type. | Location In CA GB US, HIT approval rate (%) GreaterThan 97, Impartiality Task Qualification Type. GreaterThanOrEqualTo 51, Total approved HITs GreaterThan 999 | You will have to wait 1 day if you wish to retake this test. | Write about how a character usually treats someone else. | Write about how a character usually treats someone else and write justifications for treating someone differently. | |
230 | 05/25/2020 | Ju Yeon Park | SenateConfirmationQualTest | SenateConfirmationQualTest GreaterThanOrEqualTo 8, Masters Exists | Once you start, you won’t be allowed to retake this test. | Compare Confirmation Hearing Statements | This task involves reading two statement excerpts from congressional confirmation/nomination hearings in 1997-2018 and choose the relatively more positive statement. | Masters |
231 | 05/30/2020 | Ai2 Israel | ADVCL classification - qualification | ADVCL classification - qualification GreaterThan 90 HIT approval rate (%) GreaterThan 99, Total approved HITs GreaterThan 5000, Location In AU CA GB NZ US, Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Adverbial-clause subject classification (WARNING: This HIT may contain adult content. Worker discretion is advised.) | Identify who is doing action of the marked verb, among the bolded words? | |
232 | 05/30/2020 | D Labs | Gender Labelling Qualification | Gender Labelling Qualification GreaterThanOrEqualTo 90 | about 3 hours | Labelling Gender of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely gender | caution, past TO history shows rejections. |
233 | 05/30/2020 | D Labs | Age Labelling Qualification | Age Labelling Qualification GreaterThanOrEqualTo 90 | about 3 hours | Labelling Age of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely age | Caution, past TO shows rejections |
234 | 05/30/2020 | VEVO Administrator - Production | Video safety classification qualification - images | Total approved HITs GreaterThanOrEqualTo 100, Location In AU CA GB US, HIT approval rate (%) GreaterThanOrEqualTo 99, Adult Content Qualification EqualTo 1 Video safety classification qualification - images GreaterThanOrEqualTo 99 | 3 minutes | Give parental-guide ratings (G, PG, TV-14, TV-MA) to a group of images based on suitability for various aged audiences - V2 | Give parental-guide ratings (G, PG, TV-14, TV-MA) to a group of images based on suitability for various aged audiences | |
235 | 05/30/2020 | Dominic Duxbury | Harbour Management | Harbour Management Qualification GreaterThan 80 | Once you start, you won’t be allowed to retake this test. | Harbour Management Task and Questionnaire | You must manage a harbour using software then fill in a questionnaire about your experience. We request each worker only completes this once. | |
236 | 05/30/2020 | Sticky | Age | Age LessThanOrEqualTo 70 Location EqualTo US, Age GreaterThanOrEqualTo 18 | 1 day | Fast and easy content viewing (few minutes for possible $0.60) - EG7to43ebOqkM6jC7xAIn | Look at some content for a few minutes to help us improve our measurements. | |
237 | 05/30/2020 | UMD Linguistics Research Group | Test for native proficiency in American English, v2.0 | Test for native proficiency in American English, v2.0 GreaterThanOrEqualTo 7 HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US, H&I prevent retake DoesNotExist | less than a minute | Anteater: Judge sentences as good or bad! | Quick 30-minute task: read sentences and judge whether they are acceptable, natural sentences of English. | |
238 | 05/30/2020 | pucccp | Convert text into robot instructions test v5 | Convert text into robot instructions test (Golden Level) DoesNotExist, Location In AU CA GB IE IN NZ US, Convert text into robot instructions test v5 EqualTo 100 Convert text into robot instructions test (Bronze Level) DoesNotExist | 1 minute | Interpret directions into a robot plan (~2 min) | You are given a set of directions. Convert them into commands a robot understands. | |
239 | 06/11/2020 | BIU NLP | Grammatical or Not | Grammatical or Not GreaterThan 60, HIT approval rate (%) GreaterThan 60, Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Rate Auto-Generated Movie Plots | Rate 3 different generated movie plots, according to given criterions | |
240 | 06/11/2020 | Imperial NLP | Survey Completion Test | Survey Completion Test EqualTo 100, Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Is this content toxic? | Does the content that appears show toxic behaviour or not? | |
241 | 06/11/2020 | Ria | EnglishProficiency | EnglishProficiency LessThan 80 | Once you start, you won’t be allowed to retake this test. | Revise AI-generated text (For non-expert English speakers) | Revise 9 AI-generated paragraphs | For non-expert English speakers |
242 | 06/11/2020 | f8b64e4e-b7c8-47a8-9ee3-b161727f4ca2 | Reputation_Polarity_v3 | message-us-to-proceed DoesNotExist, Reputation_Polarity_v3 GreaterThan 95, Masters Exists, recent-accuracy-twitter GreaterThan 70, z-questions-answered GreaterThan 200, cross-polarity-score GreaterThan 80 | You will have to wait about 6 hours if you wish to retake this test. | Judge the reputation polarity of Article Clips | Judge the reputation polarity of Article Clips. The qualifications here can be earned by answering our twitter reputation polarity dataset and are updated daily. | Masters plus must find other qual HITs as explained in Description |
243 | 06/11/2020 | Dialogue MTurk Admin | Ask a Question based on Public Health Passage | Ask a Question based on Public Health Passage from CDC website Exists ; Location In AU, CA, GB, US; Total approved HITs GreaterThan 5000; HIT approval rate (%) GreaterThanOrEqualTo 98 | None | Ask public health and COVID related questions - UK Passage batch; (~ 1 - 1.5 minute) ($8 - 12 dollar per hour) | Given some passage from UK govt or NHS website, ask a question whose answer is the almost same as the given passage | Has many batches for this qual test. Requester is member of TurkerNation and says that he does not reject good work. |
244 | 06/11/2020 | PFT | Language NL | Language NL GreaterThanOrEqualTo 100, Location EqualTo NL, Language EN GreaterThanOrEqualTo 100 | You will have to wait 5 minutes if you wish to retake this test. | [Nederlands] Herformuleer zinnen met je eigen woorden | [Nederlands] Herformuleer zinnen met je eigen woorden | For Language EN test see 5/8/2020 in this table. |
245 | 06/23/2020 | Imperial NLP | Survey Completion Test (Comment Only) | Adult Content Qualification EqualTo 1 Survey Completion Test (Comment Only) EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Is this content toxic? (adult content) | Based on a sample decide whether the content that appears shows toxic behaviour. | |
246 | 06/23/2020 | Philip Huff | Common Product Enumeration (CPE) Mapping | Common Product Enumeration (CPE) Mapping GreaterThanOrEqualTo 40 | 1 day | Find Common Product Enumerators (CPEs) for SNMP strings | Use the SNMP string and context data to find a matching CPE string from the National Vulnerability Database. There are 2 concurrent groups. Please only choose 1. | |
247 | 06/23/2020 | Pingchuan Ma | Shot_Test | Shot_Test GreaterThanOrEqualTo 90 | 2 minutes | Choose the correct category for the video | Choose the place where the video is taking place | |
248 | 06/23/2020 | BIU NLP | NLI Logic Games 14q-test | HIT approval rate (%) GreaterThan 96, Location In AU CA GB US ZA, NLI Logic Games 14q-test GreaterThanOrEqualTo 84 | about 3 hours | NLI Logic Games Location (adrian) | Given a sentence taken from the web, write your own sentences that is definitely correct about the situation or event from the given sentence | |
249 | 06/23/2020 | Erin | Text similarity batch 1 | ext similarity batch 1 EqualTo 100 Hit limit DoesNotExist, Total approved HITs GreaterThanOrEqualTo 2000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Rate topic similarity in texts | Rate the similarity of portions of U.S. presidential debates. | |
250 | 06/23/2020 | BIU NLP | NLI Logic Games Test Location | NLI Logic Games Test Location GreaterThanOrEqualTo 90 HIT approval rate (%) GreaterThan 96, Location In AU CA GB US ZA | 2 minutes | NLI Logic Games Location | Given a sentence taken from the web, write your own sentences that is definitely correct about the situation or event from the given sentence | |
251 | 06/23/2020 | A transportation company | Transportation Test | Transportation Test GreaterThanOrEqualTo 10; Total approved HITs GreaterThanOrEqualTo 3000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 97 | Once you start, you won’t be allowed to retake this test. | reasonable-crowd | Help us improve the quality of our transportation system | |
252 | 06/25/2020 | MPI Dept. of Perceiving Systems | Consent_Agreement_Mimicking_Human_Poses_20200528 | Consent_Agreement_Mimicking_Human_Poses_20200528 EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Can you mimic the pose? | In this task you will be asked to 1) mimic a human pose, 2) take or have taken a picture of yourself in this pose, and 3) upload the picture. | |
253 | 06/25/2020 | Ai2 Israel | Entity Tracking training | Entity Tracking training GreaterThanOrEqualTo 100 Total approved HITs GreaterThanOrEqualTo 2000, HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US | about 3 hours | Entity Tracking in Texts | Tracking of mentions of the same entity in texts. An interesting task for native English speakers who are interested in linguistics and AI. This batch of HITs is a pilot (many more to come!). Random guesses not approved! | |
254 | 06/25/2020 | Luwei | label intrusion qualification | Masters Exists, label intrusion qualification GreaterThanOrEqualTo 7 | Once you start, you won’t be allowed to retake this test. | Pick out the most irrelevant label | For each HIT, you will see one short passage and four labels. Three of the labels will be related to the passage, but the other one will be out of place. Your job is to pick up the one label that seems LEAST related to the passage. | |
255 | 07/13/2020 | John Gaddy | Grammar Test | Grammar Test GreaterThanOrEqualTo 40 HIT approval rate (%) GreaterThanOrEqualTo 97 | Once you start, you won’t be allowed to retake this test. | Write a short blog post on a specified topic | Write a 300+ word blog post on a specified topic. | |
256 | 07/13/2020 | UW Gaming Research Lab | Eligibility Questions1 | Location In AU CA GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 96 | Once you start, you won’t be allowed to retake this test. | Overwatch Player Experiences and Loot Box Use | Answer questions about your thoughts, feelings and experiences opening loot boxes | |
257 | 07/13/2020 | Coronavirus QA Research | Feedback about COVID Chatbot | Feedback about COVID Chatbot GreaterThanOrEqualTo 75; Total approved HITs GreaterThan 1000; Location In CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 98 | Give feedback on our COVID-19 question answering system | Rate and explain how well our bot answers questions about COVID-19 | ||
258 | 07/13/2020 | Luwei | top eight word set intrusion qualification | Masters Exists, top eight word set intrusion qualification GreaterThanOrEqualTo 7 | Once you start, you won’t be allowed to retake this test. | Pick out the most irrelevant word set | For each HIT, you will see ONE short passage and four word sets. Three of the word sets will be related to the passage, but the other one will be out of place. Your job is to pick up the one word set that seems LEAST related to the passage. | |
259 | 07/13/2020 | [email protected] | Evidence Selection for QA - qualification | Location In US-AL US-AR US-DE US-FL US-GA US-IA US-KS US-KY US-LA US-MD US-MN US-MO US-MS US-ND US-NE US-OK US-SC US-SD US-TN US-TX US-VA US-WV, Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 95 | 1 hour | Evidence Selection for QA | Select the evidence needed to answer a question | Noah accounts sometimes reject. |
260 | 08/03/2020 | Research | Spanish formality qualification test | Spanish formality qualification test GreaterThanOrEqualTo 70, Location In CA MX US | Once you start, you won’t be allowed to retake this test. | Spanish task: Formal rewrite of an informal sentence | Generate a formal rewrite of an informal sentence in Spanish | |
261 | 08/03/2020 | nlu.team | Reasoning_warrant_collection | Location NotIn IN, Location NotIn BD, Total approved HITs GreaterThanOrEqualTo 5000, Reasoning_warrant_collection EqualTo 100, HIT approval rate (%) GreaterThanOrEqualTo 99 | Once you start, you won’t be allowed to retake this test. | Do you know why Zoos should be banned ? | This task requires you to write your reasonings for arguments on the topic: Ban Zoos. | |
262 | 08/17/2020 | Cathrine | Message Tone Detection v2 | Respectful/Disrespectful tone identification performance DoesNotExist ; Message Tone Detection v2 GreaterThanOrEqualTo 85 | Once you start, you won’t be allowed to retake this test. | Identifying respectful/disrespectful message tone (qualification) | Review messages taken from online classification and identify their tone as respectful/disrespectful | |
263 | 08/17/2020 | Zazzle AWS | Rate Image Style Triangle Qualification | Unconventional Triangle DoesNotExist ; Total approved HITs GreaterThan 500; HIT approval rate (%) GreaterThanOrEqualTo 99; Location EqualTo US; Prevent Retake Style Triangle DoesNotExist | 5 minutes | Rating Image Styles Triangle (10 designs) | This HIT involves rating the main styles in 10 designs by how realistic, simplified, and abstract they are. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px; The task will not load otherwise. | |
264 | 08/24/2021 | Zazzle AWS | Rate Image Style Artistic Marks Qualification | Rate Image Style Artistic Marks Qualification (7/19/2019) EqualTo 100; Total approved HITs GreaterThan 1000; HIT approval rate (%) GreaterThanOrEqualTo 99; Unconventional Artistic Marks DoesNotExist ; Location EqualTo US | 30 minutes | Rating Image Styles Artistic Marks (10 designs) | This HIT involves rating 10 designs by artistic marks. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px. | |
265 | 08/17/2020 | Zazzle AWS | Rate Image Style Negative Space Qualification | Rate Image Style Artistic Marks Qualification (7/19/2019) EqualTo 100; Total approved HITs GreaterThan 1000; HIT approval rate (%) GreaterThanOrEqualTo 99; Unconventional Artistic Marks DoesNotExist ; Location EqualTo US | 30 minutes | Rating Image Styles Negative Space (10 designs) | This HIT involves rating 10 designs by negative space. Javascript must be enabled. Only works on Chrome/Firefox. Needs minimum screen resolution of 1280px x 720px. | |
266 | 08/17/2020 | George Stoica | Relation Extraction Qualification Test 1 | Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThanOrEqualTo 95, Adult Content Qualification EqualTo 1 | 10 minutes | Relation Extraction WARNING: This HIT may contain adult content. Worker discretion is advised. | Determine relationship between subject and object in sentence. | |
267 | 08/17/2020 | AudioKite | Genre Category: Comedy Music | Genre Category: Comedy Music GreaterThanOrEqualTo 1 HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US | less than a minute | Listen to a comedy song and answer a survey about it. | Listen to the song for at least 30 seconds and answer a survey about it. NOTE: The qualification test is to confirm you enjoy listening to the designated genre. | |
268 | 09/05/2020 | ISI VISTA Lab | Labeling ad hominems in conversations v2 | Labeling ad hominems in conversations v2 EqualTo 6; Total approved HITs GreaterThan 1000; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 95; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | 20-30 sec task labeling conversations v2 (warning: may contain offensive content) | Label ad hominems (personal attacks) in conversations | |
269 | 09/05/2020 | George Stoica | org2locmulti Qualification Test | Already Completed HITs DoesNotExist, Total approved HITs GreaterThan 500, org2locmulti Qualification Test GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 95, Adult Content Qualification EqualTo 1 | 5 minutes | Relation Extraction WARNING: This HIT may contain adult content. Worker discretion is advised. | Determine relationship between subject and object in sentence. *Impossible Qualification Test bug is fixed* | |
270 | 09/05/2020 | BIU NLP | hexagon-app-collection | advanced-hexagon-app-verification DoesNotExist, hexagon-app-collection-expired DoesNotExist, Location In AU CA GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 | about 4 hours | Hexagon Board tasks (writing and drawing) (P01RS04) | Write instructions for how to draw a given image drawn on a kid drawing board game (paved with hexagonal tiles). Afterwards, you should carry out your instructions step by step on an empty board game | |
271 | 09/05/2020 | Evan Hernandez | detailed image summarizer | Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 90, Location EqualTo US | 2 minutes | Summarize a set of image regions | Summarize what is shown in a set of image regions. | |
272 | 09/05/2020 | BIU NLP | Sentence Typing Task - P | HIT approval rate (%) GreaterThanOrEqualTo 80, Location EqualTo US | Once you start, you won’t be allowed to retake this test. | 3 * Sentence Typing Task - unavailable from mobiles/tablets! - Easy and quick | Your job will be to type 3 sentences into an empty text-box. | |
273 | 09/07/2020 | Aristo | Answering elementary-school science questions (Sept 2). | Location In AU,CA,GB,US, Total approved HITs >=10000, HIT approval rate (%) ?=99, Answering elementary-school science questions (Sept2).>=7 | 6 hours | Indicate whether a given answer to elementary-school science questions is (yes/no) | ||
274 | 09/29/2020 | Itamar Jalon | Podcast rating Test Ver 2 | Podcast rating Test LessThanOrEqualTo 51 Location In CA US | Once you start, you won’t be allowed to retake this test. | Listen and rate podcasts for emotional content | Listen to stories from podcasts and rate how emotional you find them to be, and what emotions they make you feel | |
275 | 09/29/2020 | Wen Fan | qualification test | No repeats DoesNotExist, HIT approval rate (%) GreaterThan 90, qualification test EqualTo 100 Location US | Once you start, you won’t be allowed to retake this test. | Remote Work in the Time of COVID-19 (45-60 minutes) | We are conducting an academic survey on remote work and need your input! Requirements: (1) have worked at home at some point after COVID-19, (2) eligible based on a 3-question prescreening. Contains many open-ended questions. | |
276 | 09/29/2020 | AudioKite | Genre Category: Funk | HIT approval rate (%) GreaterThanOrEqualTo 95, Location EqualTo US | 1 minute | Listen to a funk song and answer a survey about it. | A musician or label is seeking feedback on a funk song from people in the United States who enjoy funk music. Listen to the song for at least 30 seconds and answer a survey about it. | |
277 | 09/29/2020 | Maryam Mirzaei | Intention Recognition-PreQualification Test | otal approved HITs GreaterThanOrEqualTo 80, Completed my test already DoesNotExist, Intention Recognition-PreQualification Test GreaterThanOrEqualTo 70 | Once you start, you won’t be allowed to retake this test. | Intention Annotation | Find the surface intention versus the real (hidden) intention of the given question in the context (2-3 minutes). | |
278 | 09/29/2020 | Clark University - GPMI | New England Water Quality Qualification v5 | New England Water Quality Qualification v5 EqualTo 100 Location US | New England Water Quality Survey | The purpose of the survey is to find out if people like you would support management programs that would improve water quality in New England rivers and streams. | ||
279 | 09/29/2020 | Christian Meske | Demographics [auto-granted] | Demographics [auto-granted] GreaterThan 1 | Once you start, you won’t be allowed to retake this test. | Medical Image Labeling | Counting of blood cells infected with malaria parasites in a blood sample image. No previous medical knowledge required! Estimated time of work: ~8 minutes. | IMPORTANT: You can participate just once in this or our other uploaded HITs with the same title. Otherwise, we are afraid to reject your work. |
280 | 11/13/2020 | GSV Urban Data Lab | GSV Building Conditions Qualification Test | HIT approval rate (%) GreaterThanOrEqualTo 90, Location EqualTo US | less than a minute | GSV Buildings Pairwise Conditions Survey | Determine whether the building in image is maintained. | |
281 | 11/17/2020 | DonorDevices | HDD Labeling Test | Total approved HITs GreaterThan 200, NotOnBanListNew GreaterThan 0, HIT approval rate (%) GreaterThan 80, HDD Labeling Test GreaterThan 66 | 1 day | Reading Text on Hard Drive Labels | Simple transcription. Find serial numbers, model numbers, etc on hard drive labels and transcribe. | |
282 | 11/17/2020 | DonorDevices | PCB Labeling Test | Total approved HITs GreaterThan 200, NotOnBanListNew GreaterThan 0, PCB Labeling Test GreaterThan 66 | 1 day | Reading Text on Hard Drive Printed Circuit Boards | Find number printed on PCB board and transcribe. Simple. | |
283 | 12/07/2020 | Buckeye Linguistics Research | https://worker.mturk.com/qualifications/35OXBT565DUZ4B1768EVHC0KOAD2VH | multi_agent_dialog_1606609887_max_submissions DoesNotExist, ParlAIExcludeQual86374t14979 GreaterThanOrEqualTo 7111 | 10 minutes | Complex Question Dialogue | This task requires reading a tutorial and completing a qualification task, which will take 20-30 minutes. | |
284 | 12/07/2020 | QA Research | Chat about multiple topics -- v0.1 | Chat about multiple topics -- v0.1 GreaterThanOrEqualTo 90 Location In AU CA GB NZ US, HIT approval rate (%) GreaterThanOrEqualTo 97 | Multi-Topic Chat | This is a task to provide questions and answers in a conversational format, with conversation spanning across multiple topics/entities. | ||
285 | 12/07/2020 | Yujia Yan | Kidbook annotation qualification | Kidbook annotation qualification EqualTo 100HIT approval rate (%) GreaterThan 97, Total approved HITs GreaterThan 50 | 1 minute | Story book entity annotation | In this task you are asked to annotate entities in the presented text. Payment is determined by number of annotated chunks. | |
286 | 12/07/2020 | NASA ULI | Computer hardware and physical/vision | Computer hardware and physical/vision survey EqualTo 100 Completed Experiment DoesNotExist | Once you start, you won’t be allowed to retake this test. | Complete a short survey followed by a virtual targeting experiment (~20 mins) | Subjects will use their keyboard to direct a cursor into a target area | |
287 | 12/07/2020 | Enrichment at Tink | pretest-qualified-worker | pretest-qualified-worker EqualTo 100 | You will have to wait 7 days if you wish to retake this test. | All Countries: Select the best fitting category to this Danish transaction (with qualification test) | this transaction appeared on your bank statement, what category would be the best fit? | |
288 | 12/07/2020 | Violet Peng | common sense qualification | HIT approval rate (%) GreaterThan 98, Total approved HITs GreaterThan 5000, common sense qualification GreaterThanOrEqualTo 26 Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Challenge the Temporal Common Sense of Our AI & Earn ~$2 in ~10 mins for each task! (2 tasks available) Creativity Required | Now collecting data for time domain and cause & effect scenario. | TO reports rejects |
289 | 12/09/2020 | SCI Mturk | https://worker.mturk.com/qualifications/35166AXV7BFJWZHCMO18XS3946CCOU | Round 1 Participant DoesNotExist, Java Prerequisite In 3 5 6 7 Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 97 | Once you start, you won’t be allowed to retake this test. | Provide explanations for lines of Java code | oull be provided a Java program in which you will write a self explanation for each line | |
290 | 12/09/2020 | Lang Science | Transcription qualification for English | transcription qualification for English GreaterThanOrEqualTo 1 | Once you start, you won’t be allowed to retake this test. | Transcribe the text that appears in the image | Look at the image and type the text exactly as it appears. | |
291 | 12/15/2020 | Imperial NLP | Qualification Test HSP B2-a | Once you start, you won’t be allowed to retake this test. | Is this content toxic? (adult content) | Based on a sample decide whether the content that appears shows toxic behaviour. | ||
292 | 12/29/2020 | Audio Information Research Lab | Kidbook annotation qualification | HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 50 | You will have to wait 1 minute if you wish to retake this test. | Story book entity annotation pilot run 2 | In this task you are asked to annotate entities in the presented text. Payment is determined by number of annotated chunks. It is another pilot run of the task. | |
293 | 12/29/2020 | Pew Research InfoTech | Qualification politics | Masters Exists, HIT approval rate (%) GreaterThan 95, Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Answer some questions about politicians social media posts | Were conducting important non-partisan research to assess how politicians communicate on social media and what they talk about. | |
294 | 12/29/2020 | Aparna | Qualification Demographics Survey for following HITs | HIT approval rate (%) GreaterThan 98, Location In CA US | Once you start, you won’t be allowed to retake this test. | Dog Labelling Task | The task in this HIT is to determine if the dogs depicted in the images below have specified physical characteristics. | |
295 | 01/05/2021 | chen | Does is look like an objective stand alone | Total approved HITs GreaterThan 1000, Does is look like an objective stand alone statement?3970 GreaterThan 99 HIT approval rate (%) GreaterThanOrEqualTo 97, Location In US | Once you start, you won’t be allowed to retake this test. | Does is look like an objective stand alone statement?1289 | In this job, we provide you with sentences. Your task is to determine whether theyre objective, stand-alone statements. | |
296 | 01/05/2021 | chen | Does is look like an objective stand alone | Does is look like an objective stand alone statement?6052 GreaterThan 99 Total approved HITs GreaterThan 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location In US | Once you start, you won’t be allowed to retake this test. | Does is look like an objective stand alone statement?8931 | In this job, we provide you with sentences. Your task is to determine whether theyre objective, stand-alone statements. | |
297 | 01/19/2021 | Keqin Bao | Score Test | Score Test GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90, Adult Content Qualification EqualTo 1 | You will have to wait about 1 hour if you wish to retake this test. | Collect the dialog response | reply to the last utterance in the given dialog history. | |
298 | 01/19/2021 | Maryam Davoodi | Political Science Background-V13_prod | Political Science Background-V13_prod GreaterThanOrEqualTo 80 | You will have to wait 2 minutes if you wish to retake this test. | Classification of political bills with the health topics. | Read the abstract of a US state bill. Then, identify the entities who lose and gain a benefit from the bill. These entities are selected based on the topic of the bill. | |
299 | 01/19/2021 | Florence H | CCC Trusted Worker | Total approved HITs GreaterThan 100, Location In AU CA GB IE NZ US, HIT approval rate (%) GreaterThan 70, CCC Trusted Worker GreaterThanOrEqualTo 30 | Once you start, you won’t be allowed to retake this test. | CCC | o determine what is described in a sentence, see instructions | |
300 | 01/22/2021 | Joshua Introne | Climate change position test | Climate change position test EqualTo 100 Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 98, Location EqualTo US | Once you start, you won’t be allowed to retake this test. | Determine the opinion of a Twitter user | Review the profile text and sample of tweets to determine a Twitter users opinion about climate change. | |
301 | 01/27/2021 | Hugh Mungus | Labelling Qualification purple staff - 2021 | : Labelling Qualification purple staff - 2021 GreaterThanOrEqualTo 90 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images | Label each person image with the most likely role | |
302 | 02/01/2021 | Hugh Mungus | Gender Labelling Qualification General | Gender Labelling Qualification General GreaterThanOrEqualTo 90 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely gender | |
303 | 02/15/2021 | IOTG Computer Vision | Video recording consent | Video recording consent EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Record a video clip with American Sign Language expression. | You should record a short video clip with one sign expression from ASL. | |
304 | 02/15/2021 | Aurora Solar | Aligning 3D and Images | Aligning 3D and Images GreaterThanOrEqualTo 100 HIT approval rate (%) GreaterThanOrEqualTo 90 | You will have to wait less than a minute if you wish to retake this test. | 3D Scan Alignment | Align a 3D scan of a roof with an image of the roof. This task is designed to take around one minute. | |
305 | 02/16/2021 | MPI Dept. of Perceiving Systems | Body_Shape_Ratings_Language_Test | Body_Shape_Ratings_Language_Test GreaterThanOrEqualTo 80; HIT approval rate (%) GreaterThan 95; Total approved HITs GreaterThan 5000; Location EqualTo US; Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Body Shape Ratings | Describe the body shape of a person by rating how much you agree with a fixed set of words. Some images may show nudity, for example, a person in lingerie. You can do as many HITs as you want. | |
306 | 03/01/2021 | Lynn Lohnas | Qualification Test To Participate 2 | 11 - previous participant DoesNotExist, Qualification Test To Participate 2 EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Research study on cognition of memory 12 | Participate in a research study. This is a two-part study taking place over two days. Today, you will participate in Study Session 1 (about 30 minutes). Tomorrow, 24 hours later, you will participate in Study Session 2 (about 10 minutes). | |
307 | 03/01/2021 | QA Research | Qualification: Clarifying Ambiguity in a Dialog | Qualification: Clarifying Ambiguity in a Dialog EqualTo 100 Select high qualified workers for our Ambiguity Task DoesNotExist, Location In CA IN US, HIT approval rate (%) GreaterThan 97 | Clarify Ambiguity in Dialog: Qualification Test | Clarify ambiguous questions in a dialog which discusses a story. You will be selected to be our long-term workers if your work is in high quality. Please submit more than 5 HITs for being properly evaluated. | ||
308 | 03/02/2021 | Hugh Mungus | Age Labelling Qualification General | Age Labelling Qualification General GreaterThanOrEqualTo 90 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely age category | |
309 | 03/02/2021 | Elena Kochkina | Determine claim-tweet relevance | Determine claim-tweet relevance qualification test GreaterThan 70 | Once you start, you won’t be allowed to retake this test. | Claim-tweet relevance task | Tag whether a tweet is relevant to a given claim | |
310 | 03/02/2021 | Shuaichen | Qualification Test for Map Description | Qualification Test for Map Description EqualTo 600 | You will have to wait less than a minute if you wish to retake this test. | Describe/summary a choropleth map image (~ 1 minute) | Describe/summary a choropleth map image in one or a few sentences | |
311 | 03/09/2021 | Rosni Kottekulam Vasu | Data Science and Hypothesis: Knowledge Test | Location In CH DE IN US, Masters Exists, Data Science and Hypothesis: Knowledge Test GreaterThan 80 | Once you start, you won’t be allowed to retake this test. | Hypotheses Ranking for Data Science Task | Rank a set of predefined hypotheses for a dataset based on how interesting you think they are | |
312 | 03/16/2021 | Lucas | HAI Sentiment Analysis Pre-Qual Test 1 | HAI Sentiment Analysis Pre-Qual Test 1 GreaterThanOrEqualTo 50 | Once you start, you won’t be allowed to retake this test. | Help us evaluate the sentiment of movie reviews | The mission is to classify some reviews as positive or negative and answer a short survey at the end. | |
313 | 03/16/2021 | Yibo Zhang | Finance and Accounting Knowledge | Finance and Accounting Knowledge GreaterThanOrEqualTo 70 | You will have to wait 4 months if you wish to retake this test. | Investor Judgments and Decision on Digital Reports | Participants in this HIT will play the role of investors | |
314 | 03/16/2021 | Jin Kim | Compare Comments | Compare Comments GreaterThanOrEqualTo 6 | Once you start, you won’t be allowed to retake this test. | Which comment is more uncivil? | Which comment is more uncivil? | |
315 | 03/16/2021 | John Friday | Event Coreference Test | Total approved HITs GreaterThanOrEqualTo 1000, Event Coreference Test GreaterThanOrEqualTo 75 HIT approval rate (%) GreaterThanOrEqualTo 95, Location In US | You will have to wait 1 day if you wish to retake this test. | Annotating Event Coreference in News Articles | You will be asked to read 1 pair of news articles, and for the given pair you will be asked to identify texts that refer to the same events. | |
316 | 03/16/2021 | 12traits | Favorite Activities | Favorite Activities EqualTo 100 HIT approval rate (%) GreaterThan 95 | Once you start, you won’t be allowed to retake this test. | Answer a survey on humor preferences and video games | Answer a survey study related to your humor preferences, as well as preferences and experiences related to video games. Responding to this survey should not take more than 16 minutes. | |
317 | 03/30/2021 | chen | What is the sentiment associated with this review | What is the sentiment associated with this review GreaterThan 80 Total approved HITs GreaterThan 1000, HIT approval rate GreaterThanOrEqualTo 97, Location In US | Once you start, you won’t be allowed to retake this test | What is the sentiment associated with this review | In this job, we provide you with magazine reviews | |
318 | 03/30/2021 | Imperial NLP | Qualification Test HSP B2-b | Qualification Test HSP B2-b EqualTo 100 Adult Content Qualification EqualTo 1 | Once you start, you won’t be allowed to retake this test. | Is this content toxic? (adult content) | Based on a sample decide whether the content that appears shows toxic behaviour. | |
319 | 04/19/2021 | Hugh Mungus | age-general | age-general GreaterThanOrEqualTo 120 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely age | |
320 | 04/19/2021 | Amazon Requester Inc. - ‘CVB’ | ShoppingCVDialogDataUsageAcknowledgement | ShoppingCVDialogDataUsageAcknowledgement GreaterThanOrEqualTo Total approved HITs GreaterThanOrEqualTo 50, HIT approval rate (%) GreaterThanOrEqualTo 70, Location EqualTo US 0 | Once you start, you won’t be allowed to retake this test. | Shopping Visual Refinement 1_1 | Teach a conversational agent to find better products with your voice. You see a task page containing two sets of products. | |
321 | 04/20/2021 | Buckeye Linguistics Research | ParlAIExcludeQual76627t91090 | ParlAIExcludeQual76627t91090 GreaterThanOrEqualTo 7111 ParlAIExcludeQual17567t60639 Exists, Location In AU CA GB NZ US | You will have to wait 10 minutes if you wish to retake this test. | Complex Question Dialogue | This task requires reading a tutorial and completing a qualification task, which will take 20-30 minutes | |
322 | 04/20/2021 | Hugh Mungus | gender-general | gender-general GreaterThanOrEqualTo 130 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely gender | |
323 | 04/28/2021 | Hugh Mungus | role-purple | role-purple GreaterThanOrEqualTo 150 | You will have to wait less than a minute if you wish to retake this test. | Labelling demographics of People in Images | Label each person image with the most likely role | |
324 | 04/28/2021 | Marian-Andrei Rizoiu | Skilled at detecting stance | Total approved HITs GreaterThan 100, Skilled at detecting stance GreaterThanOrEqualTo 80 Location In AU CA GB US, HIT approval rate (%) GreaterThan 96 | Once you start, you won’t be allowed to retake this test. | Label the stance of reddit users towards Brexit | Label the stance of reddit users as either Pro-Brexit, Anti-Brexit or neutral based on their posts/comments. | |
325 | 05/31/2021 | Maze | maze_age_12 | Masters Exists , maze_age_12 GreaterThanOrEqualTo 2443 maze_age_12 LessThanOrEqualTo 6283 | You will have to wait 7 days if you wish to retake this test. | High-pressure survey & feedback task. | ou will be presented with a series of questions and small tasks. Please be honest and provide meaningful responses. Earn ~$0.38 per minute / $22.80 per hour | |
326 | 07/09/2021 | Cornell LIL | tangram-batch | Location EqualTo US | No retakes | What does this shape look like to you? | In this task, you will see a simple but abstract shape. Different people see different things when they look at the shape and we are interested in what you see. After you describe what the shape looks like, you will describe the parts of that shape. | |
327 | 07/09/2021 | Huy Nghiem | Pre screen survey 2 | GreaterThan 0; HIT approval rate (%) GreaterThan 95; Location In CA, US; Adult Content Qualification EqualTo 1 | No retakes | Annotation of Racism in Tweets | Please follow instructions to rate the tweets on levels of offensiveness, aggressiveness, and target(s) of these sentiments. | |
328 | 08/17/2021 | Jacob Freeman | Shared Resources Experiment Qualification | Finished Shared Resources Experiment Qualification DoesNotExist ; Shared Resources Experiment Qualification EqualTo 1; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In CA, US | No retakes | Shared Resources Experiment, estimated $11/hr | This is a research experiment consisting of a qual, pre-game test, and 8-player game. | |
329 | 08/30/2021 | QA Research | Talk about similar images --v0.46 | Excluded DoesNotExist ; Talk about similar images -- v0.45 GreaterThanOrEqualTo 100; Total approved HITs GreaterThanOrEqualTo 500; Location In CA, US; HIT approval rate (%) GreaterThanOrEqualTo 95 | Similar-Images Retrieval Game | In this game you will be the describer. You will have to to come up with a detailed description of an image such that a retriever is able to select it among several similar ones. | ||
330 | 05/16/2022 | Varieties of Egalitarianism | VoE_en_Ireland | Location In GB, IE; VoE_performance NotIn 1; VoE_en_Ireland GreaterThanOrEqualTo 70 | No retakes | Statements about inequality, social justice and equal treatment | Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? | This is the test for Ireland, but also accessible to those located in the UK. Separate test also available for UK. (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned. |
331 | 09/08/2021 | Gerardo Ocampo Diaz | Personal Reportable Experience Identification V1 | Read a newspaper opinion piece and highlight mentions of personal experiences | 1 minute | Read a Newspaper Opinion Piece | Read a newspaper opinion piece and highlight mentions of personal experiences | |
332 | 09/09/2021 | Alexandria | Grammaticality and plausibility: qualification (Sept 7, 2021) | Grammaticality and plausibility: qualification (Sept 7, 2021). >= 8, Location In AU, CA, GB, US, Location In AU, CA, GB, US, HIT approval rate (%) >= 99 | 6 hours | Grammaticality and plausibility. v1 | In this HIT, you will compare sentences in terms of their grammaticality and plausibility. | |
333 | 09/15/2021 | Carnegie Mellon University | Civil Rights Qual: 8 doc, Score>=2, price .40, time 9am | Civil Rights Qual: 8 doc, Score>=2, price .40, time 9am GreaterThanOrEqualTo 2 | No retakes | Enter a search topic and select the best results (~2 minutes) | After performing a search, how relevant is the list of results to your search? | |
334 | 09/15/2021 | Remesh Research | Remesh Qualification (#b9f0699c) | Total approved HITs GreaterThanOrEqualTo 5000, Remesh Qualification (#b9f0699c) EqualTo 1 | No retakes | Remesh Conversation: Eat More Produce | Eat More Produce (~30 minute live conversation) 11:48 AM Eastern (#b9f0699c) | |
335 | 09/15/2021 | SoTAHRS | New Qualification Test | Masters Exists, HIT approval rate (%) GreaterThanOrEqualTo 90, New Qualification Test EqualTo 100 | No retakes | Evaluate conversations (~25minutes) | Rate the naturalness of conversations | APPROVAL is a little low |
336 | 09/15/2021 | Michelle | Japanese-English Proficiency Test | Japanese-English Proficiency Test EqualTo 100 | No retakes | Labelling Korean Social Media Posts | Bilingual | Each HIT requires you to select from a list of labels to indicate 3 attributes about each post - whether the post is relevant, the functional and the emotional benefits that are being discussed. | |
337 | 09/15/2021 | Noah Turk | Moral Foundations Score | Total approved HITs GreaterThanOrEqualTo 100, Moral Foundations Score GreaterThanOrEqualTo 80, High-Quality Moral Annotations Exists, HIT approval rate (%) GreaterThanOrEqualTo 98, Location EqualTo US, Adult Content Qualification EqualTo 1 | No retakes | Moral Evaluation of Dialogue (WARNING: This HIT may contain adult content. Worker discretion is advised.) | You can help us identify moral and social norm violations in conversations (question and answer pairs). | Noah accounts sometimes reject. |
338 | 09/15/2021 | Noah Turk | Moral Personality Test | Total approved HITs GreaterThanOrEqualTo 100, Moral Foundations Score GreaterThanOrEqualTo 80, Moral Personality Test GreaterThan 0, HIT approval rate (%) GreaterThanOrEqualTo 98, Location EqualTo US, Adult Content Qualification EqualTo 1 | No retakes | Moral Evaluation of Dialogue (WARNING: This HIT may contain adult content. Worker discretion is advised.) | You can help us identify moral and social norm violations in conversations (question and answer pairs). | Noah accounts sometimes reject. |
339 | 09/17/2021 | Tampere University Audio Research | Audio Question Answering Test | Experimental settings DoesNotExist, Total approved HITs GreaterThan 3000, Location In AU CA GB IE NZ US, Participated in Audio QA annotation batch 2 DoesNotExist, Audio Question Answering Test GreaterThanOrEqualTo 19 | No retakes | Provide three questions for a 15-30s audio clip.(Batch 2) | Write three questions about the contents of a single 15-30s audio clip. | APPROVAL RATE is a little low |
340 | 12/14/2021 | UKP Lab, TU Darmstadt | Toxic Dialogue QTest | Toxic Dialogue QTest EqualTo 100, Adult Content Qualification EqualTo 1 | No retakes | Toxic Dialogue Annotation (WARNING: This HIT may contain adult content. Worker discretion is advised.) | In this task we ask you to classify dialogues based on toxicity content | |
341 | 09/22/2021 | IGLU Contest | Test to qualify for fun collaborative Minecraft Game | Test to qualify for fun collaborative Minecraft Game GreaterThan 80 | 5 minutes | Play collaborative Minecraft game as a builder! | You would be given instructions in natural language created by others to contribute to building a structure in an interactive voxel world. It is super fun! | |
342 | 09/22/2021 | caisa.lab | Test qualification | Location In GB US, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95, Test qualification EqualTo 100 | Once you start, you won’t be allowed to retake this test. | Stance polarity and intensity detection | You will be requested to determine if a statement is against, neutral, or in favor towards a given topic in a 5-point scale. Source: Reddit DISCLAIMER: Statements may contain strong language or may be offensive to some readers. | |
343 | 09/22/2021 | Alexandria | Judge a Translation from an AI System - v2 | Judge a Translation from an AI System - v2 >= 7, Location In AU, CA, GB, US, Total approved HITs >= 10000, HIT approval rate (%) >= 99 | 6 hours | Judge the quality of an AI translation - v4 | Judge the quality of a translation | |
344 | 09/23/2021 | ASR research | 'English Native Transcriber' | 'English Native Transcriber' is not less than 99 | 10 minutes | transcribe audio test | write down what you hear lower case only no punctuation | Requester has rejections reported and a 96% approval rating proceed with caution. |
345 | 09/27/2021 | Cognitive Lab | 1 Teacher Qualification | Taken the Survey DoesNotExist, 1 Teacher Qualification EqualTo 100 | No retakes | Evaluate 40 concept about teaching, learning and the brain. | In this study you will evaluate you will evaluate 40 concepts about learning and the brain. In total you can earn $3 for completing the whole study. The first part of the study takes 40-50 minutes to complete; part 2 & 3 only takes about 15-20 minutes. | |
346 | 09/28/2021 | Alexandria | Grammaticality and plausibility: qualification for counterfactual statements (Sept 28, 2021). | Location In AU, CA, GB, US; Location In AU, CA, GB, US; HIT approval rate (%) GreaterThanOrEqualTo 99; Grammaticality and plausibility: qualification for counterfactual statements (Sept 28, 2021). GreaterThanOrEqualTo 10 | 6 hours | Annotating counteractual reasoning examples. v6 | In this HIT, you will score a sentences in terms of their plausibility and coherence of counterfactual stories. | |
347 | 09/28/2021 | Zeus Consensus | sentiment-v0.1.0 | sentiment-v0.1.0 EqualTo 100 | 1 day | News Article Sentiment | Label news articles according to their sentiment | Limited info available, new requester |
348 | 09/30/2021 | Carnegie Mellon University | MT birdawatching: 9 doc, Score>=4, price .40, time 8am | MT birdawatching: 9 doc, Score>=4, price .40, time 8am GreaterThanOrEqualTo 4 | No retakes | Enter a search topic and select the best results (~2 minutes) | After performing a search, how relevant is the list of results to your search? | |
349 | 10/01/2021 | Carnegie Mellon University | Aquariums: 9 doc, Score>=4, price .40, time 10am | Aquariums: 9 doc, Score>=4, price .40, time 10am GreaterThanOrEqualTo 4, Location In US | No retakes | Enter a search topic and select the best results (~2 minutes) | After performing a search, how relevant is the list of results to your search? | |
350 | 10/01/2021 | Kumar Shridhar | Math_level_qualification_1_1 | Math_level_qualification_1_1 GreaterThanOrEqualTo 100 | No retakes | Simple math word problems solving | We will provide you multiple math word problem tasks. We will ask you to try solve these math word problems and by doing so, you can learn something new. The task takes approximately ~35 minutes. | |
351 | 10/01/2021 | MIT mturk | Completed Robot Qualification Survey | Completed Robot Qualification Survey Exists | No retakes | Describe robot actions | Watch a robot perform some action then write a command describing it | Approval rate is low. |
352 | 10/04/2021 | GSV Urban Data Lab | GSV Buildings (Roofing) Qualification Survey 2.0 | GSV Buildings (Roofing) Qualification Survey 2.0 EqualTo 60, | Less than a minute | Answer a short survey about building conditions | For each image, you will focus on whether the building has deteriorated roofing. | |
353 | 10/04/2021 | GSV Urban Data Lab | GSV Buildings (Siding) Qualification Survey 2.0 | GSV Buildings (Siding) Qualification Survey 2.0 Equal To 60 | Less than a minute | Answer a short survey about building conditions | For each image, you will focus on whether the building has cracked siding. | |
354 | 10/04/2021 | GSV Urban Data Lab | GSV Buildings (Plywood) Qualification Survey 2.0 | GSV Buildings (Plywood) Qualification Survey 2.0 EqualTo 60 | Less than a minute | Answer a short survey about building conditions | For each image, you will focus on whether the building has plywood over its doors or windows. | |
355 | 10/06/2021 | Hugh Mungus | role-situlive-standard | role-situlive-standard GreaterThanOrEqualTo 150 | less than a minute | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely role | |
356 | 10/08/2021 | SLS-6 | PersonaChat With Highlights Qualification Test | PersonaChat With Highlights Qualification Test EqualTo 100 | 1 minute | Write what you would say with the given persona and context | Highlight some part in the given persona and context, then write a response with the information you highlighted. | |
357 | 10/11/2021 | James McGrath | Identify NYC building picture. | Identify NYC building picture. EqualTo 8 | 1 minute | Identifying NYC building pictures at 418 Central Park West | Identify the picture that looks most like the profile of an entire building from the outside. Do not include pictures of the inside of any building/apartment or taken from the inside or balcony of an apartment or building. | |
358 | 10/11/2021 | Arthur Brazinskas | SummBW | blocked_worker DoesNotExist, Location In CA GB US, SummBW EqualTo 10 Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 98 | Once you start, you won’t be allowed to retake this test. | Select of the best customer review summary | Select of customer review summaries generated by different AI algorithms | |
359 | 10/02/2022 | yutsuk | 4Q Qualification Test (20210827) | 4Q Qualification Test (20210827) EqualTo 100, HIT approval rate (%) GreaterThan 95, Location In AU CA GB NZ US | No retakes | (20221001) Speaker's satisfaction labeling | Labeling the degree of the speaker's satisfaction/dissatisfaction | |
360 | 10/19/2021 | Jinuk Cho | test10172150 | Total approved HITs GreaterThan 500, HIT approval rate (%) GreaterThan 98, test10172150 GreaterThanOrEqualTo 100 | Less than a minute | Read short movie plots (generated by A.I.) and answer questions (~4 mins) | Evaluate the A.I. generated story | |
361 | 10/19/2021 | Michelle | Deutsch Sprachprüfung | German Proficiency Test | Deutsch Sprachprüfung | German Proficiency Test EqualTo 100 | No retakes | German Social Media Posts | Kennzeichnung deutscher Beiträge in sozialen Medien • | Bei jedem HIT müssen Sie aus einer Liste Labels auswählen, und damit 5 Attribute zu jedem Beitrag angeben | |
362 | 10/20/2021 | Carnegie Mellon University | Largest Cities: time 9am, No Location | Largest Cities: time 9am, No Location GreaterThanOrEqualTo 9 | No retakes | Enter a search topic and select the best results (~2 minutes) | After performing a search, how relevant is the list of results to your search? | |
363 | 10/22/2021 | Michael Roth | QualificationTest | Location In GB US, QualificationTest EqualTo 6, Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 95 | No retakes | Does the underlined part make sense in the given how-to guide? | determine whether the underlined part makes sense in the given how-to guide | |
364 | 10/25/2021 | Herman Saksono | Screener 210859-8-22-2 | Total approved HITs GreaterThan 1000, Screener 210859-8-22-2 GreaterThanOrEqualTo 90, HIT approval rate (%) GreaterThan 95, Participated in 210859-8-22 DoesNotExist, Location EqualTo US | No retakes | Listening task (2.5 mins audio) + answering surveys. Takes 10-15 minutes for $3.75. | Answer a survey, listen to a story, review the story, and answer an additional survey. | |
365 | 10/26/2021 | UW Madison | Alexa Skill Pre-Survey Test (Android) | Alexa Skill Pre-Survey Test (Android) EqualTo 100, HIT approval rate (%) GreaterThan 90, Location EqualTo US, Completed survey updated DoesNotExist | No retakes | Collect Smartphone Applications Data, Analyze Browser History Analysis and Alexa Skills Information | Provide basic information about which Alexa Skills you use, mobile phone applications you have and alexa skill related analysis of browser history | Approval Rate at 95% |
366 | 10/27/2021 | SLS-6 | DailyMail Summary Highlights Qualificcation Test | Total approved HITs GreaterThanOrEqualTo 100, DailyMail Summary Highlights Qualificcation Test GreaterThanOrEqualTo 97,HIT approval rate (%) GreaterThanOrEqualTo 99, Location EqualTo US | 1 minute | Read a dailymail news article and choose related sentence to reference summary. | You need to read a dailymail news article and its corresponding reference summary and choose the most related sentence in the article to summary. | |
367 | 11/01/2021 | Ao GUO | Common Sense Test for Personalized Chat_2021.10.28 | Location In AU CA GB IE NZ US, Each turker could only finish one HIT (SEN) DoesNotExist, Common Sense Test for Personalized Chat_2021.10.28 GreaterThanOrEqualTo 100,Total approved HITs GreaterThanOrEqualTo 50, HIT approval rate (%) GreaterThanOrEqualTo 90 | No retakes | Fill in Questionnaires and Chat with a Bot to Accomplish Specified Goals | Answer a four-page questionnaire consisting of 147 questions and then chat with a bot in 3 rounds of conversation to accomplish the assigned goals. | |
368 | 11/01/2021 | Fritz&Hammer Crowdsourcing | Company LEI Qualifier | Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 97, Location EqualTo US, Adult Content Qualification EqualTo 1 Temp Task 1 GreaterThanOrEqualTo 1, Company LEI Qualifier GreaterThanOrEqualTo 80 | 1 month | Find the Legal Entity Identifier for a company | Visit a website to find the Legal Entity Identifier for a company | |
369 | 11/04/2021 | Youngrok Song | qualification_test_obs_test | Total approved HITs GreaterThan 500, Exclude Repeated DoesNotExist, HIT approval rate (%) GreaterThan 95, Location In CA US, qualification_test_obs_test EqualTo 100 | Less than 1 minute | Obstacle Evaluation | You will be asked to write 2 short sentences (Question 1) and answer two sets of four 5-point likert questions (Question 2~5/6~9) | Limited info available, new requester |
370 | 11/05/2021 | Hugh Mungus | role-v1-purple | role-v1-purple GreaterThanOrEqualTo 230 | Less than a minute | Labelling demographics of People in Images (Quick and easy qualification quiz!) | Label each person image with the most likely role | |
371 | 11/16/2021 | Jin | event_coreference | event_coreference EqualTo 100,Total approved HITs GreaterThan 1000, Location In AU CA GB US, HIT approval rate (%) GreaterThan 98 | No retakes | Event Coreference | You will be presented with 25 sentence pairs that each has an event trigger word highlighted. Then, you will be asked if these two event mentions represented by the trigger words refer to the same real-world event. | |
372 | 11/17/0202 | Recycling Company | PETQualification1 GreaterThan 10, Total approved HITs GreaterThan 100, HIT approval rate (%) GreaterThan 95 | 1 day | Answer classification questions for the shown images | Each task contains 8 pages showing one image each. The task is to answer questions related to the shown image. | ||
373 | 11/23/2021 | Yossi Keshet | Audio equipment test 2.1 | Audio equipment test 2.1 EqualTo 100, Total approved HITs GreaterThan 10000, HIT approval rate (%) GreaterThan 95, Location EqualTo US | 1 day | Select the best (i.e. quality/human-sounding) audio given a reference audio | Select the best (i.e. quality/human-sounding) audio given a reference audio | |
374 | 12/07/2021 | IUCC CompAnalogy MTurk | qualification-test-biomimicry-1 | Location In CA, GB, US; qualification-test-biomimicry-1 EqualTo 100; Total approved HITs GreaterThan 10000; HIT approval rate (%) GreaterThan 97 | No retakes | Inspiration from nature | Find animals that solve complex problems | |
375 | 12/26/2021 | Napat Thumwanit | Multiple-choice commonsense reasoning | Inconsistent Commonsense Reasoning Performance Tracking DoesNotExist , Total approved HITs GreaterThan 1000, Dummy Qualification 4 DoesNotExist , Multiple-choice commonsense reasoning 2 GreaterThanOrEqualTo 90, HIT approval rate (%) GreaterThan 97 | No retakes | Multiple-choice Adversarial common sense question answering (3-5 minutes per HIT) | You will verify the multiple-choice questions related to common sense reasoning. The task is as simple as choosing the answer or providing the reason in case of ambiguous | |
376 | 01/12/2022 | Carnegie Mellon University | Stars: time 10am Wednesday, 500 HITs | Stars: time 10:20am Wednesday, 500 HITs >= 4, HIT approval rate (%) >= 90 | No retakes | Enter a search topic and select the best results (~2 minutes) | After performing a search, how relevant is the list of results to your search? | |
377 | 01/21/2022 | AdobeAWS2224 | Legal sentence classification qualification test | Legal sentence classification qualification test EqualTo 4; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In CA, US | About 1 hour | Legal text classification | Annotate the given sentences with the categories (e.g. obligation, permission, prohibition, entitlement) expressed in them with respect to a given entity and highlight the words that evoke a particular category. | |
378 | 01/29/2022 | AdobeAWS2224 | Legal sentence categorization qualification test | Legal sentence categorization qualification test EqualTo 10, HIT approval rate (%) GreaterThan 95, Total approved HITs GreaterThan 5000 | 5 minutes | Legal text classification | Annotate the given sentences with the categories (e.g. obligation, permission, prohibition, entitlement) expressed in them w.r.t a given entity and highlight the words that evoke a particular category. Qualify test duration increased & retakes available. | |
379 | 01/29/2022 | wyss_econ | TweetQualification | TweetQualification GreaterThanOrEqualTo 75; Location In AU, GB, IE, NZ, US | No retakes | Interactive labelling of Tweets for scientific research (~15$/h) | Label Tweets related to climate change (simplified new qualification test). This is a small trial batch. More HITs will follow. We pay bonus (7$) for successful qualification in addition to standard HITs payment. | |
380 | 05/16/2022 | Varieties of Egalitarianism | VoE_fr_France | Location In BE, CH, FR, LU; VoE_performance NotIn 1; VoE_fr_France GreaterThanOrEqualTo 70 | No retakes | Déclarations sur l’égalité, la justice sociale ou l’égalité de traitement | Cette déclaration fait-elle une référence positive à l’égalité, la justice sociale et/ou l’égalité de traitement ? | This is the test in French for Belgium, Switzerland, France, and Luxembourg (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned. |
381 | 02/22/2022 | huji nlp lab | analogies_qualification | analogies_qualification GreaterThan 90; Total approved HITs GreaterThanOrEqualTo 5000; Low Analogy Performance DoesNotExist ; HIT approval rate (%) GreaterThanOrEqualTo 99 | 1 day | Choose the image that best solves the analogy | Choose the image that best solves the analogy | |
382 | 04/12/2022 | Alexandria | Verify the plausibility of the middle sentence | Lask of Qualification for Participating in GENIE annotations DoesNotExist Location In AU, CA, GB, US, Total approved HITs >= 10000, Verify the plausibility of the middle sentence >= 7, HIT approval rate (%) >= 99 | 6 hours | Verify the plausibility of the middle sentence | In this HIT, you will be shown a short 3-sentence story. The task requires you to mark if the middle sentence is correct. | |
383 | 04/12/2022 | Alexandria | Answering elementary-school science questions (Sept 2) | Lask of Qualification for Participating in GENIE annotations DoesNotExist Total approved HITs >= 5000, Location In AU, CA, GB, US, HIT approval rate (%) >= 99, Answering elementary-school science questions (Sept 2). >= 8 | 6 hours | Indicate whether a given answer to elementary-school science questions is correct (agree/disagree). | In this HIT, you will be given several questions and will indciate whether the given answers are correct. | |
384 | 04/15/2022 | CSMR | Qualification for game content HIT by CSMR | Answered more than 30 questions DoesNotExist , Total approved HITs GreaterThanOrEqualTo 1000, HIT approval rate (%) GreaterThanOrEqualTo 98, Qualification for game content HIT by CSMR EqualTo 1 | 4 days | Help us develop game content for a fun party game like Family Feud | Give us your best guesstimates to questions based on your perceptions of others | |
385 | 04/28/2022 | LiesbethA | Instruction test: Labeling people | Labeling people EqualTo 100 | No retakes | Highlight people in sentences | Highlight people mentioned in a sentence and check if the writer implies a character trait of them. | HITs may need shift+enter to submit, Limited requester info available |
386 | 05/05/2022 | Varieties of Egalitarianism | VoE_en_Canada | Total approved HITs GreaterThan 100; VoE_performance NotIn 1; VoE_en_Canada GreaterThanOrEqualTo 70; HIT approval rate (%) GreaterThanOrEqualTo 99; Location is CA | No retakes | Statements about inequality, social justice and equal treatment | Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? | This is the test for Canada (Different versions of HIT and Test available based on location), Note the timer. Reviews mention mistaken rejections were overturned. |
387 | 05/06/2022 | Varieties of Egalitarianism | VoE_en_Australia | VoE_performance NotIn 1; Total approved HITs GreaterThan 500; VoE_en_Australia GreaterThanOrEqualTo 70; Location In AU, GB, IE, NZ, US; HIT approval rate (%) GreaterThanOrEqualTo 99 | No retakes | Statements about inequality, social justice and equal treatment | Does the statement include a positive reference to equality, social justice, and/or equal treatment of all people? | This test applies to US, AU, GB, IE, and NZ even though it specifically mentions AU. Note the timer. Reviews mention mistaken rejections were overturned. |
388 | 05/08/2022 | SAINTES Research | Python qualification test | Python qualification test GreaterThanOrEqualTo 85 | No retakes | Are two Python code snippets the same? | You will be shown a pair of code snippets in Python. You will be asked to assess if they have the same functionality and if yes, which snippet you prefer. To qualify for this task, you need to complete a short Python quiz. | Limited info available, new requester |
389 | 05/13/2022 | Whooosreading.org | Decide if a sentence fully answers a question | Limit reached - Decide if a sentence fully answers a question DoesNotExist ; Vetted - Decide if a sentence fully answers a question DoesNotExist ; Decide if a sentence fully answers a question GreaterThanOrEqualTo 80 | 12 hours | Decide whether or not a sentence fully answers a question | Decide whether or not a sentence fully answers a question | |
390 | 05/16/2022 | Johannes Daxenberger | Reasoning Annotation: Hygiene products (real) | Reasoning Annotation: Hygiene products (real) >= 80, Location In CA, US, HIT approval rate (%) >= 95 | No retakes | Argument Annotation - Electric Shaver, Sentence Arguments, Batch 0 | ||
391 | 06/24/2022 | Whooosreading.org | Categorize each answer based on grammar rules and sentence | Limit reached - Categorize each answer based on grammar rules and sentence structure DoesNotExist ; Categorize each answer based on grammar rules and sentence structure GreaterThanOrEqualTo 80; | 12 hours | Categorize each answer based on grammar rules and sentence structure | Categorize each answer based on grammar rules and sentence structure | |
392 | ||||||||
393 | 06/26/2022 | Aparna | Demographics Survey for following HITs | Demographics Survey for following HITs Exists ; HIT approval rate (%) GreaterThan 98; Location In CA, US; Completed meal labelling task before DoesNotExist ; Adult Content Qualification EqualTo 1; Annotator pool previous DoesNotExist | No retakes | Text Labelling Task (WARNING: This HIT may contain adult content. Worker discretion is advised.) | The task in this HIT is to label text snippets | |
394 | 06/28/2022 | MSR-LIT-SPIRAL-NLGI | natalie_general_task_qualifier | natalie_general_task_qualifier GreaterThanOrEqualTo 90; HIT approval rate (%) GreaterThanOrEqualTo 80; Location EqualTo US | No retakes | Read a task description, a text and correct a solution for the task. Give feedback and instructions in English. 5 minutes per ta | Analyze the task description, a source text and a candidate solution for the task. Correct the candidate solution, explain why it was wrong and give instructions describing your changes. Average of 5 minutes per task. | |
395 | 06/29/2022 | Whooosreading.org | Determine whether or not the sentence is a fragment | Determine whether or not the sentence is a fragment >= 80; Limit reached - Determine whether or not the sentence is a fragment DoesNotExist; Vetted - Determine whether or not the sentence is a fragment DoesNotExist | 12 hours | Determine whether or not the sentence is a fragment | Categorize each answer based on grammar rules and sentence structure | |
396 | 07/08/2022 | Christopher Malon | Noun Phrase Classification Test | HIT approval rate (%) GreaterThan 89; Noun Phrase Classification Test GreaterThan 16; Location EqualTo US; Total approved HITs GreaterThan 999 | No retakes | Classify Noun Phrases | Select a type of noun phrases in a review (Electronics in Amazon) | One TO rejection report from 2012. Recent reviews generally okay/positive. |
397 | 07/23/2022 | Cornell LIL | Qualification Test | Qualification Test >= 8, Total approved HITs >= 500, HIT approval rate (%) >= 98, | No retakes | [More HITs to Come if You Passed the Qual!!] Interact with a Question Answering System | You will ask a question regarding a topic that interests you, get an answer highlighted in a paragraph, and provide feedback on how good this answer is. | |
398 | 08/17/2022 | Johannes Daxenberger | Flight Request Annotation Qualification Test | Flight Request Annotation Qualification Test >= 80, HIT approval rate (%) >= 95, Location In US | No retakes | Flight Request Annotation | ||
399 | 08/22/2022 | Checkmark Ninja | Installed Version of our Chrome Extension | Installed Version of our Chrome Extension >= 3 | 1 day | Verify the LinkedIn URL for a person | Use our Chrome Extension to verify the LinkedIn URL for a person. You do need a LinkedIn Account and have our Chrome Extension installed in order to proceed. | |
400 | 08/27/2022 | mstar-team | Ability to evaluate summaries on professional documents | HIT approval rate (%) is greater than 95, Masters has been granted, Ability to evaluate summaries on professional documents has been granted | 4 hours | Evaluate summary quality | Read an article and a pair of summaries, evaluate each summary based on coherence, consistency, coverage and overall quality. The precise definitions of those terms are given in the task. Advanced English reading comprehension is needed. | |
401 | 09/28/2022 | Yanzhe Zhang | Text Style Understanding | Location In AU, CA, GB, US, HIT approval rate (%) >= 98, Text Style Understanding >= 5 | No retakes | Annotate the response quality based on a prompt | Annotate the quality of a written response with regard to the style requested in the prompt. | |
402 | 09/28/2022 | Jwala Dhamala | English Varieties Test | Dialect J Exists English Varieties Test Exists Total approved HITs >= 500, HIT approval rate (%) >= 98, | No retakes | Dialect Understanding | Your goal is to decide whether bits of text sound acceptable according to the grammar rules of your dialect. | |
403 | 10/02/2022 | Emily Provost | Text Emotion Annotation | Text Emotion Annotation EqualTo 100, Total approved HITs > 500, HIT approval rate (%) > 98, Adult Content Qualification EqualTo 1, | 1 day | Text Emotion Annotation | Read a short piece of text and label the emotion expressed | |
404 | 10/02/2022 | Alexa | Qualification for Humor Evaluation (categorical) task | Masters Exists Total approved HITs > 500, HIT approval rate (%) > 98, Qualification for Humor Evaluation (categorical) task EqualTo 100, Location EqualTo US, | No retakes | Is this a humorous response? | Is this a humorous response for a playful user shopping request? | Reports of rejections on Turkerview. |
405 | 10/02/2022 | addb-mturk | Creative Comparison validation Qualification: 2022-09-29 23:22:21.408576 | Creative Comparison validation Qualification: 2022-09-29 23:22:21.408576 >= 80, | 5 minutes | Brand Validation Reduced Categories | Compare the videos and choose the right category | |
406 | 10/05/2022 | HotWriter | English Tier 1 | English Tier 2 Exists Total approved HITs > 10, | No retakes | Write 260 words description for a product from images and title | Write a product description which describes the features and benefits of the given product to a customer. | |
407 | 10/30/2022 | Ron | IRFL_image_qualification_v12 | irfl_image_task_blocked_workers DoesNotExist ; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 5000; Location In AU, CA, GB, NZ, US; IRFL_image_qualification_v11 GreaterThan 90 | 1 hour | IRFL - Image Recognition of Figurative Language | Choose the image correct category for the image | |
408 | 01/24/2023 | MineRL-BASALT | BASALT - Minecraft Basic Familiarity Test | BASALT - Minecraft Basic Familiarity Test 65 or greater | 2 days | |||
409 | 02/25/2023 | IGLU Contest | iglu-minecraft-eval-qualifier | Total approved HITs > 500, HIT approval rate (%) > 95, iglu-minecraft-eval-qualifier > 86, Location In CA, DE, GB, NL, US, | No retakes | IGLU - Play Minecraft game! | Play with and AI agent in Minecraft and complete a short survey. You must have Minecraft 19.2 already installed. | |
410 | 02/27/2023 | BIGAI | Very small qualification test to see if you understand our task 0226-2000 | Location In AU, CA, DE, GB, US; Very small qualification test to see if you understand our task 0226-1600 GreaterThanOrEqualTo 100; HIT approval rate (%) GreaterThan 98; Total approved HITs GreaterThan 10 | Less than a minute | ecide whether an image contains a certain sentence. | Decide whether an image contains a certain sentence. | |
411 | 03/16/2023 | UBC NLP Lab | Image understanding task | Total approved HITs GreaterThanOrEqualTo 5000; Location In AU, CA, GB, NZ, US; HIT approval rate (%) GreaterThanOrEqualTo 97; Image understanding task GreaterThan 95 | 1 minute | Write one sentence description for an image. | Given an image, write one sentence that describes the image. | |
412 | 03/16/2023 | Xiang - OSU | Web Interface Consent | Total approved HITs > 1000, Web Interface Consent EqualTo 100, Web Interface Qualification Master Exists HIT approval rate (%) > 98, Web Interface Qualification Exists | 1 minute | Demonstrate Simple daily online tasks that can be done on target websites | Official HITs. You need to pass the qualification HITs first* Help make the web more accessible to all! Demonstrate daily tasks on a target website. You need to first propose tasks in a separate HIT. | |
413 | 04/12/2023 | Qiang Zhang | Time Aware Chat | Time Aware Chat EqualTo 100, Total approved HITs >= 2000, Location In CA, US, HIT approval rate (%) >= 95 | No retakes | Time Aware Chat | Have a natural conversation with another participant about specific events. | |
414 | 11/02/2023 | Whooosreading.org | Decide which sentence contains the better claim | Limit reached - Decide which sentence contains the claim DoesNotExist Vetted - Decide which sentence contains the claim DoesNotExist Decide which sentence contains the better claim >= 80, | 12 hours | Regular - Decide which sentence contains the better claim | Choose which sentence has a stronger claim. |
Dars says
A head’s up – Joseph Dario might need to have a warning on it now. Rejections are being reported in the TO.
soummer says
On Image Matcher 1.0 Eagle Eye, after the first few questions, several images would not open. Is it broke or just me?
Rosie The Robot says
I have no idea, I’m so sorry. I really don’t spend much time here. I invite you to join the TurkerNation Slack Channel, that is where I hang out and answer questions.
CH says
It would be helpful if we could mark what we’ve done or it told us which was a new posting 🙂
Rosie The Robot says
We invite you to join the TurkerNation Slack Channel. We post the Qual HITs and Qual Tests there. When I can, I add the Qual Tests here. Slack has very good notifications settings.
Lynn says
TurkerNation Slack Channel no longer exists.
Rosie The Robot says
Sure it does! You can join here. If are already a member, you’ll have to recover your password do log in.
Kenny says
How often are these qual tests/qual hits update?
Rosie The Robot says
We invite you to join the TurkerNation Slack Channel. We post the Qual HITs and Qual Tests there. When I can, I add the Qual Tests here. Slack has very good notifications settings.
Isabella says
Hi, Isabella here.
What’s new link for slack?
I really adjoint with you.
Thanks!
Rosie The Robot says
We’re glad to have you in the Slack! We will try to keep you updated there! We can also answer your questions and provide companionship!
Joe says
What happened to this page? I will miss it so much! Slack channel is great but I love the list that was here. Made it easy to keep track of which quals I had passed and which I still needed to try again. Any other options that are similar?
Joe says
Nevermind it is loading again. Phew…close call
Rosie The Robot says
We’re so glad you like it and that we were able to get it working again!
jemar707 says
Sorry it was being a little wonky! Thanks for commenting, it brought my attention to this quickly.
Mary says
Is there another page where I can find other Qualification Tests?
Rosie The Robot says
Yes, before being posted here, they are posted in the Quals Channel on TurkerNation Slack. (Note: You DO NOT have to click “Just Arrived” or “Thanks for the invite” when you sign up. You can ignore the “Send a message to let @Admin know you’ve arrived” prompt.)
Siva Murugesan says
How to sign-in I am new user
Rosie The Robot says
I just checked this email address and it is not in the system so please follow the advice in my other reply.
César Rodríguez says
They are still updating this page. If not, how do I get connected?
Rosie The Robot says
Sorry, I’m a little behind. Newest quals can always be found in the quals channel of our Slack, which I believe you have already joined.
César says
Is this website still being updated?
Siva Murugesan says
Need to login details of turkernation slack.
Rosie The Robot says
Hi! Sorry, just seeing this. Did you already sign up? You would then chose your login details. Please go to https://tinyurl.com/JoinTurkerNation to sign up. If you are already a member, please input your email address and click on the forgot password link. Or write to [email protected] so I can check your email address.
Patricia Morris Randall says
hi,
anyone get qualification for below hits link https://worker.mturk.com/?filters%5Bsearch_term%5D=MLDataLabeler+Qualifying+HIT+for+Bounding+Box+Tasks
this is a mldatalabler bounding box task