For the spousal loan, is it at the current rate of interest, and are you claiming the interest paid on your own tax return as investment income? If the rate of interest is less than the going rate, then you run the risk of being subject to the rules of attribution. This states that unless fair market value was paid for the transferred assets, then any income from said assets are attributed back to the original holder. Please see the following link for more details.
http://www.cra-arc.gc.ca/E/pub/tp/it511r/it511r-e.html
