Hello Lyndsay!
If you contact Noula who is Dimitris cousin, at San Stefano Travel.... steftrav@otenet.gr she will be able to organize a taxi for you and let you know the cost too. If the taxi is too expensive then it is not a lot of euros to get to Sidari where there are lots of bars, but you may be surprised and find everything you want in Arillas!!??
If you do go to Kavos perhaps consider staying there overnight, I've spoken to some people who have done this and apparently it is not expensive at all for the accomodation.
Have a great time anyway, (we arrive on the 13th.)
Eileen.