it may not look and sound horrific in a Chinese mind,but if you step back and look at the English words as they are,its horrifying.It is acceptable to say 'heart to heart'.But you need to add something to it for making a point.Chinese culture is deep,many words carry much deeper meaning are understood by many of us.Yet,you cannot just directly translate word for word,especially for abstracts like feelings.
敢不敢以心换心 - the tone fills with challenge.Is it really something ought to say between 2 people with deep and close relationship?If not,why waste time.It is a lost cause.