Skip to content

Commit

Permalink
Merge remote-tracking branch 'origin/main-dev' into 46-implement-actr…
Browse files Browse the repository at this point in the history
…is-ebas-reader

# Conflicts:
#	setup.cfg
  • Loading branch information
Jan Griesfeller committed Dec 20, 2024
2 parents 434d2f9 + 5224549 commit eb7c589
Show file tree
Hide file tree
Showing 17 changed files with 1,396 additions and 155,103 deletions.
42 changes: 42 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,19 @@ NILU, but should in principle able to read any random text file in EBAS NASA-AME
The variables provided contain in EBAS terms a combination of matrix, component and unit with a number sign (#)
as seperator (e.g. `pm10_pm25#total_carbon#ug C m-3"` or `pm10#organic_carbon##ug C m-3` or `pm10#galactosan#ng m-3`)

### EEA: Parquet format
Reader for the EEA files provided by https://eeadmz1-downloads-webapp.azurewebsites.net/. The reader reads the **hourly only** data of the unverified dataset. The directory structure must be
```
metadata.csv
unverified
- NO
- SE
- SPO-SE395030_00038_100.parquet
- ...
- ...
```
where `metadata.csv` is csv file containing station metadata (https://discomap.eea.europa.eu/App/AQViewer/index.html?fqn=Airquality_Dissem.b2g.measurements).

## Usage
### aeronetsunreader
```python
Expand Down Expand Up @@ -176,3 +189,32 @@ if __name__ == "__main__":
main()
```


### eeareader
```python
import pyaro
import pyaro.timeseries

TEST_URL = "/lustre/storeB/project/aerocom/aerocom1/AEROCOM_OBSDATA/EEA-AQDS/download"


def main():
with pyaro.open_timeseries(
"eeareader",
TEST_URL,
filters=[
pyaro.timeseries.Filter.CountryFilter(include=["NO", "SE", "DK"]),
pyaro.timeseries.Filter.TimeBoundsFilter(
startend_include=[("2023-01-01 00:00:00", "2024-01-01 00:00:00")]
),
],
enable_progressbar=True,
) as ts:
# help(ts)
data = ts.data("PM10")
print(data.values)


if __name__ == "__main__":
main()
```
6 changes: 3 additions & 3 deletions setup.cfg
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[metadata]
name = pyaro_readers
version = 0.0.10.dev5
version = 0.1.1.dev0
author = MET Norway
description = implementations of pyaerocom reading plugings using pyaro as interface
long_description = file: README.md
Expand All @@ -21,15 +21,15 @@ url = https://github.com/metno/pyaro-readers
[options]
python_version = >=3.10
install_requires =
pyaro >= 0.0.14
pyaro ~= 0.1.0
geocoder_reverse_natural_earth >= 0.0.2
netCDF4
requests
tqdm
numpy
xarray
cfunits
polars
polars[pyarrow]
tomli>=2.0.1; python_version < "3.11"

package_dir =
Expand Down
Loading

0 comments on commit eb7c589

Please sign in to comment.