E no Shima Waikiki Shokudou

Cafe Waikiki is so empty that owner-chef Yori swears he's been hearing voices. Why isn't he getting any customers? His cooking can't be that bad, and it's not like he's in the wrong location, so what other reason could there be for this to happen?