1) As you state, Krishna is identical with His name. That means that His name has the same qualities as Himself, i.e. sat, chit, ananda. No mundane vibration is eternal, otherwise why does it grow tiresome and have to be changed every other week. Nor do mundane songs produce real knowledge or bliss unending. Also, this transcendental vibration purifies one. Anyone can see practically how our students are becoming purified, but the chanters of material songs are not.
2) Ginsberg says these words are physical in a frankly physical universe. But this is not true, for actually everything is spiritual. It is only under certain conditions, viz. forgetfulness of Krishna that this internal or spiritual energy of Krishna becomes material. Therefore when we hear the name Krishna, which is identical with Krishna, we must remember, and in that way everything is purified.
3) Tennyson may have felt something when he chanted Tennyson, but does anyone else? Does Mr. Ginsberg want to chant Tennyson, Tennyson? But everyone enjoys chanting Krishna. That means there is something different about His name. He is the center of everyone and everything.
4) Krishna explains in the 7th Chapter of B.G. that there are four classes of men who approach Him. There are millions of men in distress, or searching for money, or curious, or searching for knowledge, but only a few come to Krishna, and all of them are mahatma—simply because they have come to the right place, Krishna.