The New Game button is in the toolbar, at the upper-left of the game window.

You can also start a new game by choosing New Game from the File menu, or by pressing ⌘N.

The toolbar, showing the New Game button.