No, your individual ranking points won't be influenced by changing the gang.