Is my family rightfully cautious about me having a Pakistani Muslim girlfriend?

based on what you've told us yes but not because she is a Pakastani or Muslim but because it sounds like her family is potentially racist and "over the top"