CorpusMarket Robotics

Robotics data marketplace: how labs source real-world data

There is no single robotics data marketplace where a lab can buy the hours it needs off a shelf. Real-world data comes through a handful of routes, each with its own strengths and limits. This page compares them for a data lead who has to choose.

By Linus Näslund, Co-Founder

  • No cost to apply
  • Nothing shared before we talk
  • Reply within 2 business days
Contents05
  1. 01Is there a robotics data marketplace?
  2. 02The routes labs use
  3. 03The routes compared
  4. 04How to choose
  5. 05Where CorpusMarket fits

Is there a robotics data marketplace?

Data leads often start by searching for a robotics data marketplace, expecting something like a stock-footage site for robot learning. It does not exist in that form yet. Real-world robot data is tied to a task, an embodiment and a set of usage rights, so most of it is collected to order.

What exists instead is a set of routes. Most labs use several at once.

The routes labs use

In-house collection

The lab builds its own collection operation: robots, operators, a space set up with task stations. It gets full control over hardware, protocol and quality. The limits are cost and sameness. The data comes from the lab's own rooms and people.

Teleoperation operators

A person steers a robot through a task while the robot's cameras and joint states are logged. Labs staff this themselves or contract it out. The data is in the robot's own body, which makes it directly usable for training. Throughput is bounded by the number of robots and operators, and the data fits the robot it was recorded on better than any other.

Data-collection and annotation vendors

Robotics data collection companies take a specification and deliver against it. Many grew out of general AI data collection companies that labeled images and text, and some now run dedicated robotics sites. Scale AI, for example, describes both teleoperated demonstration collection and annotation of demonstrations on its physical AI page.

Robotics data annotation is often sold together with collection. It covers splitting recordings into steps, writing language descriptions of what happens, and marking hands, objects and contacts.

Crowd and contributor apps

Individuals record tasks on their own phones or with a supplied device, mostly at home, and are paid for it. This reaches many households and many people quickly. The settings are mainly domestic, and skill level and framing vary from one contributor to the next, so review and filtering carry more of the load.

Business recording programmes

A business agrees that its workers record their normal tasks, usually with a head-mounted phone, and is paid for the hours that pass review. This is how a lab gets first-person video from commercial kitchens, job sites, shops and warehouses, done by people who do the work for a living. Our guide to egocentric data collection describes the format.

Open datasets

Research datasets cost nothing to obtain and are useful for pretraining and benchmarks. A few examples by category:

  • Open X-Embodiment pools existing robot datasets from many research labs, covering many robot embodiments, and is released as open source.
  • DROID is a set of teleoperated manipulation demonstrations on a Franka Panda arm, collected across multiple institutions and open sourced.
  • Ego4D is a large egocentric video dataset from a consortium of universities working with Facebook AI. Access requires accepting its license agreement.

Each open dataset has its own license terms, and they differ. Our overview of egocentric video datasets goes through the first-person ones.

The routes compared

RouteWhat you getEmbodimentVarietySpeed to first dataTypical limit
In-house collectionData to your exact protocolYour robotLow, your own sitesSlow to set upCost, sameness of setting
Teleoperation operatorsRobot demonstrations with actionsYour robot or the operator'sLow to mediumMediumOne robot, one operator, one hour
Collection and annotation vendorsCollected and labeled data to specRobot or human, per vendorMedium, depends on the vendor's sitesMediumOften staged settings
Crowd and contributor appsHuman video of everyday tasksHumanHigh across homes, low across workplacesFastMostly household tasks, uneven quality
Business recording programmesFirst-person video of real commercial workHumanHigh across trades and sitesMedium, businesses are onboarded firstNo robot actions, site rules apply
Open datasetsExisting research dataFixed by the datasetFixed by the datasetImmediateLicense terms, not your tasks

The table describes routes, not companies. Individual providers within a route differ, and there is no meaningful list of the best robotics data providers that holds across tasks.

How to choose

Four questions settle most of the choice.

Task. Household tasks, industrial assembly and skilled trades are found in different places. Decide what the robot should learn to do first, and the candidate routes narrow quickly.

Embodiment. If the model needs action labels in a specific robot's joint space, teleoperation on that robot is the direct route. If it can learn from human video, or uses human video for pretraining, the human routes open up. Teleoperation versus egocentric video compares the two in detail.

Variety. Decide which kind of variety matters: objects, rooms, people, skill levels or whole industries. A staged site can vary objects cheaply. Only real workplaces vary everything at once.

Rights. Ask each source who agreed to the recording, what the license permits, whether it is exclusive, and what applies to people and property in frame. The answers differ by route and by provider, and for workplace footage they are settled business by business.

Most labs end up with a mix: open data and human video for breadth, teleoperation on their own robot for the final step. Robot training data covers how the kinds fit together.

Where CorpusMarket fits

CorpusMarket is an independent broker. On the robotics side we do one thing today: we take enquiries from businesses whose crews do hands-on work, check the fit, and introduce them to a recording programme run by our partner Amelia Robotics. For labs, we make the introduction to that same programme.

That makes us one route among the six above, the business recording programme. We are not a marketplace of many sellers yet, and we do not hold a catalog of datasets to browse. The programme covers the trades, construction, auto service, warehouses, manufacturing, kitchens, cleaning, hotels, retail, farms and more, and collects mainly in the United States today.

If that is the kind of footage you need, the page for robotics labs explains how to describe the tasks, settings and volume you are looking for. If you run a business and landed here from the supply side, tell us about your business instead.

Questions and answers

Frequently asked questions

Is there a marketplace for robotics data?

Not in the sense of a catalog with many sellers and ready-made datasets. Most real-world robot data is collected to order through vendors, contributor apps, business recording programmes or a lab's own operation, alongside open datasets for research.

Who are the best robotics data providers?

It depends on the task, the robot and the rights a lab needs, so a ranking would mislead. A vendor that is right for teleoperated demonstrations on one arm can be the wrong choice for first-person video of skilled trades.

What do robotics data collection companies do?

They collect data to a lab's specification. Some run their own sites with robots and teleoperators, some manage a workforce that records video, and many also annotate what is collected.

What is robotics data annotation?

Adding structure to raw recordings so a model can learn from them. Typical work includes splitting video into task steps, writing language descriptions, and marking hands, objects and contact points.

Can a lab get footage from real businesses rather than staged sets?

Yes. Business recording programmes pay companies for first-person video recorded by their own crews during normal work. CorpusMarket introduces labs to one such programme.

Next step

Tell us about your business

If your crew does hands-on work, a robotics lab may pay for video of it. Send your details and we will tell you whether it fits and what happens next.

  • No cost to apply
  • Nothing shared before we talk
  • Reply within 2 business days

CorpusMarket is independent of Amelia Robotics and may receive a referral fee if your business joins their programme. Nothing on this page is a promise of income.