Even though the formula I referenced previously (which can be found as the basis for several compound miter calculators) is easily derived, there was an essential flaw in the construction of the problem (but not in the math, itself). The crux of the problem is that even though the roof pitch is 5/12, the pitch of the rafters is not 5/12 (at least not the ten main rafters which form the wedges which comprise the roof). If we added ten more secondary rafters to the roof frame ran down the middle of each wedge, bisecting the 36 degree angle, those would have a pitch of 5/12.
To put this in a way that is easier to picture, imagine that the secondary rafters are 13 feet long, thus forming a 5-12-13 triangle. The would have a rise of 5 feet, a horizontal run of 12 feet, and an overall length of 13 feet. To keep the eaves of the roof level, the main rafters would, of course, have to drop the same 5 feet total at their end points. However, they would have to be longer than 13 feet. They would in fact be 13/cos(18) feet long. Thus, their pitch would actually be less than 5/12, and that's why the other formula is wrong.
Josh