I think one of the biggest issues is just language classes in elementary and secondary schools.
I grew up in a small town in Northern Ontario with 1 French high school and 1 English high school. At the French school, we were taught how to read, write and speak English, do research, write essays & poetry, study Shakespeare etc... At the English schools, they barely learned how to say the basics like "Hi, my name is.." "where is the bathroom" etc.. Things that should be learned in a couple of weeks in a "intro to" class.
So in my experience, it's the teaching of French at English elementary and secondary schools that should be improved.