The Constraints window is visible when you have layout(s) displayed on the Wall. 



However, if you double click on a layout on the wall and start viewing or editing it, the constraint window is greyed out. You can only edit constraints when in Wall mode.



To return to the Wall so you can edit constraints, right click on the layout and select 'Return to Wall'.