Taking into account the courthouse structures built after the 50's, which are usually almost always utilitarian in purpose, the historic courthouses of old were built with a heavy emphasis on looks, even if it was done on a budget, at the time.
Anyway, here's the Ingham County Courthouse, which is the only courthouse located in the county of a capital city built outside of that capital city if that makes sense. In other words, Lansing is the only state capital that's not also a county seat.