Great question — answering as the UphillTech team:
It's almost certain that the country you are visiting does not care whether you have a Refugee Travel Document and/or a passport from your home country. It will have no trouble accepting your passport and granting you a visit. The issue comes with the way Canada will view this. You have been granted refugee status because you told the Canadian authorities that you face persecution in your home country, and implicitly that the government is part of that. If you use your home country passport, you are in effect saying that you are willing to put yourself under the protection of your home country, which is not consistent with your facing government persecution. It looks as if you lied to them...
Full answer by DJClayworth: https://travel.stackexchange.com/a/112792 (CC BY-SA 3.0).
Need it done for your business? UphillTech.