“Avoid Pakistanis” - why are we like this?

When I moved to the UK, the advice I got from a number of desi people was to avoid living in an area with a lot of Pakistanis and avoid working where the boss/ manager is Pakistani. If a white person said this it would be racist but unfortunately we Pakistanis know it’s true. Why are we like this? 😢