No, you don't have to install Jenkins on any slave machine at all.
Since each slave runs a separate program called a "slave agent" there is no need to install Jenkins (package or compiled binaries) on a slave. There are various ways to start slave agents:
For a better idea of Jenkins-distributed builds have a look : https://wiki.jenkins.io/display/JENKINS/Distributed+builds