Phantom power will not harm the Line Out circuitry and you should have no issue. But do note that you will get large noise pops when connecting the XLR with phantom power present. So if possible, it should be defeated on the mic channel being used, or you could use a separate balanced Line Input, which shouldn't have phantom power on it.