Cobourg is beautiful. Several of the small cities and towns East of Toronto on Lake Ontario are gems.
Further East down the 401 is Brockville, which is another very impressive looking small city. Pan around 360 degrees with this streetview link and try and guess the population without looking it up.
https://goo.gl/maps/shqeR2awqx12