If you couldn't love me,（then) you shouldn't/mustn't disturb my peace (of mind).
"Mustn't Disturb My Peace"也是一首歌的名称.