Aylsham on Wikipedia.
 

The Free Baptist Church on Dorman Avenue South dates from 1928. TR 2369 5213. © Geoff Watt. Two more views - 1 (from 1992), 2, both © Alan K. Taylor.

St. Finbarr (R.C.) off Kings Road. TR 2372 5231. © Geoff Watt. Link.

St. Peter on Dorman Avenue North. TR 2355 5233. © Geoff Watt. Link. The about us page dates the church to the 1920's.

Mid-20th century 1" O.S. maps show a place of worship a little way S.W. of the railway station at TR 2408 5242. Perhaps associated with St. Joseph's Catholic Primary School, I haven't been able to discover if it survives, and haven't been able to get a clear Streetview of the site.