What would you think?

I think that is a pretty common comment that people make to each other and it does not have to be interpreted as a "crush". I think though that if your husband is normally pretty secure and has a gut feeling that something more is there for the BIL then you should listen to him and his instincts.