When using any kind of selection, holding alt key allows us to subtract from selection and holding shift key allows us to add to selection.
However when using square selection, holding shift key not only adds to selection, but also constrains proportions.
It would be better if ctrl key would be used for constraining, so that they wouldn't clash together..