Use git ls-remote polling mechanism. This will compare the latest built commit SHA with the remote branch without cloning a local copy of the repo.
If you want to use this, you can have only one repository with one branch (no wildcards!), and you can not use any excluded regions, excluded users or submodules, otherwise this option will disable itself after save.
If this is turned off though, polling will require a workspace and might trigger unwanted builds (see JENKINS-10131).