Café Paris has a prime location by Austurvollur square, across from the parlament. 
During the summer it it is very popular to sit outside and people watch.

Café Paris offers a warm, relaxed atmosphere and an extensive bistro-style menu.