Portland has Aldridge though, so their resources would be better suited for a PG or a SF.
Houston, sure, has some extra talent, but Brooks, Scola who is getting older, and Budinger aren't really tools to get you rebuilding. The talent that some of the other teams will mire the Raptors in mediocrity for quite sometime.
The benefits the Cavs offer largely stem from their owner. We will help the Raptors by shedding all that salary. Adding a cheap Beasley on the Raptors won't make them better than a 6th seed, and they really won't have space to improve considering Turk and Calderon will keep them over the cap for a while. Additionally, Hickson, while he may not have as much talent as Super Cool Beas, is still a nice PF to have, especially with an athletic Derozan at the SG. Although I shudder to think of the interior defense with Hickson and Bargnani...