Automated Data Labeling
Amazon SageMaker Ground Truth provides automated data labeling using machine learning. SageMaker Ground Truth will first select a random sample of data and send it to humans to be labeled. The results are then used to train a labeling model that attempts to label a new sample of raw data automatically. The labels are committed when the model can label the data with a confidence score that meets or exceeds a threshold you set. Where the confidence score falls below your threshold, the data is sent to human labelers. Some of the data labeled by humans is used to generate a new training dataset for the labeling model, and the model is automatically retrained to improve its accuracy. This process repeats with each sample of raw data to be labeled. The labeling model becomes more capable of automatically labeling raw data with each iteration, and less data is routed to humans.
Flexibility in how you work with labeling professionals
Amazon SageMaker Ground Truth supports multiple choices for human labeling directly in the SageMaker Ground Truth Console. You can use your private team of labelers for in-house labeling jobs, especially for handling data that needs to stay within your organization.
If you want to scale up to a large number of labelers and your data that does not contain confidential or personally identifiable information, you have access to an on-demand 24x7 workforce of over 500,000 independent contractors worldwide, powered by Amazon Mechanical Turk. Mechanical Turk is a crowdsourcing marketplace that connects your labeling jobs with a distributed workforce who can perform these tasks virtually.
Alternatively, you can use a third-party vendor who specializes in data labeling. These vendors have been screened by Amazon to provide high-quality labels and follow security processes. Labeling services from these vendors are provided through AWS Marketplace. All relevant details are provided including pricing and customer reviews to help you select the best vendor for your needs.
Easy instructions for human labeling
With Amazon SageMaker Ground Truth, you provide labeling guidance to human labelers to help ensure consistency. These detailed instructions are available to labelers within their labeling interface. The instructions include visual examples of good and bad labels to help labelers to produce high-quality and accurate labels. You can update these instructions at any time, which makes it easy to add more detail to tasks that you see some labelers getting wrong or to adjust instructions based on evolving needs. A sample instruction is shown below.
Use workflows to simplify labeling tasks
Amazon SageMaker Ground Truth provides built-in labeling workflows that take human labelers step-by-step through tasks and provide tools to help them produce good results. Built-in workflows are currently available for object detection, image classification, text classification, and semantic segmentation labeling jobs.
In addition to the built-in workflows, SageMaker Ground Truth gives you the option to upload custom workflows. A custom workflow consists of an HTML interface and an accuracy improvement algorithm, both provided by you. The HTML interface provides the human labelers with all of the instructions and tools they need to complete the labeling task. The accuracy improvement algorithm is a function you write to tell SageMaker Ground Truth how it should assess the quality of labels that humans provide. The algorithm is used to find consensus on what is “right” when the same data is provided to multiple human labelers, as well as to identify and deemphasize labelers who tend to provide poor quality data. You upload both the HTML interface and the accuracy improvement algorithm using the SageMaker Ground Truth console.
Seamless integration into Amazon SageMaker
Training datasets created with SageMaker Ground Truth can be easily imported into Amazon SageMaker for use in model development and training.
Get started with Amazon SageMaker Ground Truth with no upfront commitments or long-term contracts. For more details, check out the Amazon SageMaker Ground Truth pricing page.
Get started building with Amazon SageMaker Ground Truth in the AWS Management Console.