By using this site, you agree to have cookies stored on your device, strictly for functional purposes, such as storing your session and preferences.

Dismiss

 gigadata.md

View raw Download
text/plain • 3.32 kiB
Unicode text, UTF-8 text

title: Gigadata source-url: https://roundabout-host.com/roundabout/gigadata topics: ["web", "flask", "software", "python", "agpl", "gigadata", "ai", "data", "crowdsourcing", "waste detection", "waste"] ---

Gigadata is an image dataset collection and annotation platform. It allows anyone to easily contribute to the dataset by uploading images and annotating objects, and to use the dataset for training machine learning models.

The platform is designed to host a single huge dataset, which spans many classes, fields of interest, and use cases. Using querying it is easily possible to download only the parts that you need, though — for example, to get a JSON of the photos which contain either a cat or a dog (assuming these classes are registered on the server), and are under a PD equivalent licence:

want:
   - has: ["Domestic cat (Felis catus)", "Dog (Canis lupus familiaris)"]
   - nature: ["photo"]
   - licence: ["CC0-1.0", "X-public-domain", "X-informal-do-anything"]

Classes are hierarchical, so many search problems are solved. For example, consider this hierarchy (excuse my text art):

                                                                     /- Aluminium food container
                                       /- Aluminium household waste --- Aluminium can
                /- Metal household waste    /- Plastic bag
Household waste --- Plastic household waste --- Plastic bottle \
                /                           /                  \
Bottle ---------/---------------------------/                    - PET bottle --- Clear PET bottle
              /                                                /              /
Plastic object ---- PET object --------------------------------/              /
                               \-------------------------- Clear PET object /

Multiple inheritance is also possible, seen here in Plastic bottle, for instance. It's both a Plastic household waste and a Bottle, and because it's a Plastic household waste, it's also a Household waste and a Plastic object. All sorts of hierarchies like this one are possible; the has filter is used to search for an object or its descendants.

There are more APIs, not just the search one. You can upload images, annotate them, and manage galleries programmatically.

If one wants more organisation of a certain set of images, a gallery feature is available where users can create galleries of images. Other users can also be assigned to add images to a gallery.

To prevent vandalism, you cannot change someone else's image annotations, but you can copy the image and make the changes; if the owner of the original approves, they can mark their version as obsolete and replaced by your version, which causes it to disappear from the search results.

The platform is made with Python, Flask and SQLAlchemy, just like the roundabout.

As always, this platform is free/libre under the AGPL. An official instance, Roundabout Datasets, is hosted at datasets.roundabout-host.com. Anyone can add images there, but they have to be free/libre. Nothing is guaranteed.

As far as I know, there's nothing else like this platform (at least not free/libre). I'd be happy to be proven wrong, though.

And why did I put "waste" in the topics? I'm moving the waste detection dataset there.

                
                    
1
---
2
title: Gigadata
3
source-url: https://roundabout-host.com/roundabout/gigadata
4
topics: ["web", "flask", "software", "python", "agpl", "gigadata", "ai", "data", "crowdsourcing", "waste detection", "waste"]
5
---
6
7
Gigadata is an image dataset collection and annotation platform. It allows anyone
8
to easily contribute to the dataset by uploading images and annotating objects,
9
and to use the dataset for training machine learning models.
10
11
The platform is designed to host a single huge dataset, which spans many classes,
12
fields of interest, and use cases. Using querying it is easily possible to download
13
only the parts that you need, though — for example, to get a JSON of the photos
14
which contain either a cat or a dog (assuming these classes are registered on the
15
server), and are under a PD equivalent licence:
16
17
```yaml
18
want:
19
- has: ["Domestic cat (Felis catus)", "Dog (Canis lupus familiaris)"]
20
- nature: ["photo"]
21
- licence: ["CC0-1.0", "X-public-domain", "X-informal-do-anything"]
22
```
23
24
Classes are hierarchical, so many search problems are solved. For example, consider
25
this hierarchy (excuse my text art):
26
27
```
28
/- Aluminium food container
29
/- Aluminium household waste --- Aluminium can
30
/- Metal household waste /- Plastic bag
31
Household waste --- Plastic household waste --- Plastic bottle \
32
/ / \
33
Bottle ---------/---------------------------/ - PET bottle --- Clear PET bottle
34
/ / /
35
Plastic object ---- PET object --------------------------------/ /
36
\-------------------------- Clear PET object /
37
```
38
39
Multiple inheritance is also possible, seen here in Plastic bottle, for instance.
40
It's both a Plastic household waste and a Bottle, and because it's a Plastic
41
household waste, it's also a Household waste and a Plastic object. All sorts of
42
hierarchies like this one are possible; the `has` filter is used to search for
43
an object or its descendants.
44
45
There are more APIs, not just the search one. You can upload images, annotate
46
them, and manage galleries programmatically.
47
48
If one wants more organisation of a certain set of images, a gallery feature is
49
available where users can create galleries of images. Other users can also be
50
assigned to add images to a gallery.
51
52
To prevent vandalism, you cannot change someone else's image annotations, but
53
you can copy the image and make the changes; if the owner of the original approves,
54
they can mark their version as obsolete and replaced by your version, which causes
55
it to disappear from the search results.
56
57
The platform is made with Python, Flask and SQLAlchemy, just like the roundabout.
58
59
As always, this platform is free/libre under the AGPL. An official instance, Roundabout
60
Datasets, is hosted at
61
[datasets.roundabout-host.com](https://datasets.roundabout-host.com). Anyone can
62
add images there, but they have to be free/libre. Nothing is guaranteed.
63
64
As far as I know, there's nothing else like this platform (at least not free/libre).
65
[I'd be happy to be proven wrong, though](mailto:root@roundabout-host.com).
66
67
And why did I put "waste" in the topics? I'm moving the waste detection dataset
68
there.
69