A popular South Bay café is set to be demolished and replaced with a new building and additional holiday lets.