I had a python scraper running on a pi zero.
I used lxml.
It took traffic information from the BBC and via LED's and a screen told my wife about issues on her work journey. I scraped every 5 minutes for a few hours a day.
Then the BBC stopped the service.
I then had to rewrite to use a different web site. One of those commercial local news sites.
Over 3 years they changed the data format 5 times requiring me to decipher raw html and recode accordingly each time.
It was a pain in the backside eac time and I retired the project.
So bear that in mind...
I used lxml.
It took traffic information from the BBC and via LED's and a screen told my wife about issues on her work journey. I scraped every 5 minutes for a few hours a day.
Then the BBC stopped the service.
I then had to rewrite to use a different web site. One of those commercial local news sites.
Over 3 years they changed the data format 5 times requiring me to decipher raw html and recode accordingly each time.
It was a pain in the backside eac time and I retired the project.
So bear that in mind...
Statistics: Posted by MarkDH102 — Sat Feb 15, 2025 5:47 pm
