Skip to content
/ eodm Public

Library and CLI application used to collect common functions and ETL operations for EO data.

License

Notifications You must be signed in to change notification settings

geopython/eodm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

99 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

eodm - EO Data Mover

build

Library and extensible CLI application for ETL (extract, transform, load) operations on EO data.

Concept

Below are the main ideas on how to use the application. Note the shell piping operator, the intended use case is such that output of one command is piped into the next. With this a clear interface is required between the commands. For this purpose the STAC Item is chosen.

eodm extract stac-api items https://earth-search.aws.element84.com/v1 sentinel-2-l2a --bbox 49.1,18.1,49.2,18.2 --datetime-interval 2023-06-01/2023-06-30 \
| eodm transform metadata band-subset red,green,blue,nir \
| eodm load stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/
eodm extract stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/

There are also library functions which are thin wrappers around popular libraries, with some custom implementations for certain sources.

Current support

Extract

extract features CLI lib
stac-api items βœ… βœ…
stac-api collection(s) βœ… ❌
stac-catalog items βœ… βœ…
stac-catalog collection(s) βœ… ❌
OData ❌ βœ…
Opensearch ❌ βœ…
OGCAPI - Records ❌ βœ…

Transform

transform features CLI lib
subset bands βœ… ❌
clean metadata βœ… ❌

Load

extract features CLI lib
stac-api items βœ… βœ…
stac-api collection(s) βœ… ❌
stac-catalog items βœ… βœ…
stac-catalog collection(s) βœ… ❌

Plugins

There is support for writing plugins for extract and load from and to custom endpoints as well as transformers. Refer to the docs for more information.

About

Library and CLI application used to collect common functions and ETL operations for EO data.

Topics

Resources

License

Contributing

Stars

Watchers

Forks

Packages

 
 
 

Contributors 3

  •  
  •  
  •