The Constraints window is visible when you have layout(s) displayed on the Wall. 

However, if you double click on a layout on the wall and start viewing or editing it, the constraints window is greyed out. You can only edit constraints when in Wall mode.

To return to the Wall so you can edit constraints, right click on the layout and select 'Return to Wall', or click the 'Back to Results' button in the constraints window.