Coming from an officially bilingual city in an officially bilingual province, I can attest that this causes a number of unique challenges, not all of which I am happy with
however, since Ottawa is the federal capital of a bilingual country I think it is obvious that it should be a fully bilingual entity. The symbolism of this is far too strong to ignore.
I also am a strong proponent of the concept of a federal district, and I think this should include Gatineau as well. Again, this would present a set of unique challenges and I'm sure the Quebec government would be somewhat disinclined to agree to this concept without a considerable fight.
Fun fact - the District of Columbia in the US was initially formed out of lands donated by both Virginia and Maryland, but in the run up to the Civil War, the Virginians lobbied to get their portion of the district returned in a process called retrocession. The Virginia component of the district subsequently reverted to the County of Alexandria.
This is what the original district looked like.