102 Bloor St. W. Toronto
Sorry Coffee Co. is located in the back portion of the Canadian retail store, Kit and Ace. This is Kit and Ace's second location in Toronto, but the only one with a coffee shop in the same space. The front doors off Bloor Street to the main clothing store are not wheelchair accessible. Only the doors around the back on Critchley Lane will allow access to the space. Thankfully the entrance here is wide and powered.
Seating inside the smallish space is pretty standard stuff. Some small moveable tables and bar stools along the window facing into the park. I was able to navigate the space without any trouble. There is also a fully accessible washroom to the right of where you place your order. It's nice to find accessible washrooms in any coffee shop that isn't a Starbucks.
The only trouble I think you might have is that the area for preparing your coffee if you take milk and sugar would be hard to reach if you're sitting in a wheelchair. Personally I take my coffee black so it wasn't a problem for me. However the Staff were extremely friendly bringing my order over to my table anyway so I think if you needed any other assistance they would be more than happy to help you.
The closest subway station is Yonge and Bloor and then about a 10 min walk west from there. There is underground parking in the area though being downtown Toronto it will be expensive of course.