# Scraping PM data - help needed
**URL:** https://forum.sensor.community/t/scraping-pm-data-help-needed/1448
**Category:** Uncategorized
**Created:** [July 4, 2022, 4:52pm UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448 "2022-07-04T16:52:17Z")
**Posts on this page:** 6
**Page:** 1
### Author:  [@nephilim](https://forum.sensor.community/u/nephilim)
#### Post date: [July 4, 2022, 4:52pm UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/1 "2022-07-04T16:52:17Z")
I’ve been collecting the PM data from my sensors in a local influxdb and -with great effort- managed to hack a python script to scrape PM data of the official PM stations from a website. Now they have changed the website and I don’t have the energy to start all over again.
Is somebody with more experience & knowledge willing to help me?
Cheers,
Torsten
---
### Author:  [@pjg](https://forum.sensor.community/u/pjg)
#### Post date: [July 5, 2022, 5:17am UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/2 "2022-07-05T05:17:34Z")
Why don’t you scrap from the SC archive ?
Tell me exactly what you need, I know a few method.
---
### Author:  [@nephilim](https://forum.sensor.community/u/nephilim)
#### Post date: [July 5, 2022, 6:49am UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/3 "2022-07-05T06:49:46Z")
Apologies, I was not very precise - I mean the official stations operated by the administration.
In my case the website is [https://luftdaten.brandenburg.de/](https://luftdaten.brandenburg.de/) and I managed to read data from the table. However, this table is not updated during nighttime between 21:00 and 4:00. I would need a script which simulates a few clicks to download a csv-file which has the full data.
UPDATE: I’ve just discovered that you already seem to collect the official data 🙂 ([https://sensor.community/en/campaign/sensorAtRefs/](https://sensor.community/en/campaign/sensorAtRefs/))
---
### Author:  [@pjg](https://forum.sensor.community/u/pjg)
#### Post date: [July 6, 2022, 11:10am UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/4 "2022-07-06T11:10:46Z")
Sensor@Refs is not exactly a scrapping of the public data.
Look here:
> **[GitHub - pjgueno/SCPublicData](https://github.com/pjgueno/SCPublicData)**
>
> Contribute to pjgueno/SCPublicData development by creating an account on GitHub.
You can find the scrapping code in the src but it is not very straight formward. It is the reason why I stopped.
```
EEA
Luchtmeetnet
UmweltBundesamt
```
should still be scrappable.
You can also ask the administrations to publish free and normal API as requested by the EU.
The map (don’t republish it is a test server)
[http://pjgueno.epizy.com/SCPublicData/](http://pjgueno.epizy.com/SCPublicData/)
---
### Author:  [@nephilim](https://forum.sensor.community/u/nephilim)
#### Post date: [July 6, 2022, 3:43pm UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/5 "2022-07-06T15:43:01Z")
EEA looks easy enough for me to digest - many thanks for the pointer!
---
### Author:  [@nephilim](https://forum.sensor.community/u/nephilim)
#### Post date: [July 12, 2022, 8:51am UTC](https://forum.sensor.community/t/scraping-pm-data-help-needed/1448/6 "2022-07-12T08:51:07Z")
Scraping the EEA website works and yields hourly updates (w/o the gap during nighttime on the owner’s website). BTW, my NPM has risen from the dead. There was quite a lot of pollen in the inlet.
