The area of X Condo is Jarvis/Bloor... Only certain parts of Jarvis (south of Bloor) aren't that great... But Bloor is generally a very wealthy and safe street/neighborhood... and Toronto is a very safe place compared to other major cities... You shouldn't run into any trouble (unless that is what you seek... lol)... Bloor is well known for containing the "Yorkville Neighborhood". (Yorkville is probably Toronto's wealthiest/nicest neighborhood)
At Bloor/Jarvis (directly across from X Condo) lies headquarters of Rogers Communications (Huge Green Building) so the area is non-ghetto...
My advice is ask people and explore the area... I personally don't think there is any sort of danger there... whatsoever
Hope this helps....
*PS where are you moving from???
Here is a photo I took of X condo... You can see the Green Rogers Building right across...