ReTool: Interactive Microtask and Workflow Design through Demonstration
Paper in proceedings, 2017

In addition to simple form filling, there is an increasing need for crowdsourcing workers to perform freeform interactions directly on content in microtask crowdsourcing (e.g. proof-reading articles or specifying object boundary in an image). Such microtasks are often organized within well-designed workflows to optimize task quality and workload distribution. However, designing and implementing the interface and workflow for such microtasks is challenging because it typically requires programming knowledge and tedious manual effort. We present ReTool, a web-based tool for requesters to design and publish interactive microtasks and workflows by demonstrating the microtasks for text and image content. We evaluated ReTool against a task-design tool from a popular crowdsourcing platform and showed the advantages of ReTool over the existing approach.

Workflow

Programming by Demonstration

ReTool

Freeform Interactive Microtasks

Crowdsourcing

Author

Chen Chen

National University of Singapore (NUS)

Xiaojun Meng

National University of Singapore (NUS)

Shengdong Zhao

National University of Singapore (NUS)

Morten Fjeld

Chalmers, Applied Information Technology (Chalmers), Interaction Design (Chalmers)

PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17)

3551-3556

ACM SIGCHI Conference on Human Factors in Computing Systems (CHI)
Denver, USA,

Subject Categories

Media and Communication Technology

Interaction Technologies

Human Computer Interaction

DOI

10.1145/3025453.3025969

More information

Latest update

6/12/2018