A daily feed of new planning applications

A data pipeline that collects new planning applications from council websites every day, filters them to what matters and delivers them ready to act on.

Client
Midas Agency
Sector
Property and construction
Services
Data collection and web scraping, Integrations and reporting

The challenge

New planning applications are published across many separate council planning portals, each laid out differently. Checking them by hand for relevant opportunities takes hours, and things are easily missed.

What I built

For Midas Agency, I built a tool that visits the council portals on a schedule, reads each new application, pulls out the details that matter, and filters them by location, type and size. The results are cleaned, de-duplicated and delivered to a spreadsheet and inbox, with alerts for the best matches.

The result

What the system does

  • Collects new applications every morning without anyone searching
  • Keeps only the applications that match the criteria
  • Removes the manual checking of council websites
How it works, step by step: A daily feed of new planning applications
  1. 01Council portals checkedOn a schedule, every day
  2. 02New applications readAddress, type, description and dates
  3. 03FilteredBy area, project type and size
  4. 04CleanedDuplicates removed, fields tidied
  5. 05DeliveredInto a spreadsheet the team already uses
  6. 06Alerts sentFor the applications that matter most

Product visuals on this page are illustrations using demo data.

Next projectA private investment portal for an angel syndicate