Swamy Urges PM Modi to Step in