I believe the Canvas theme has Font Awesome 4 Menus built in so I don’t think you need our plugin with your site. Try to deactivate our plugin and see if just one set of your icons remain. But this is definitely a conflict with the theme, not an error in the plugin. (A custom Nav Walker or something is hijacking your menu)