You do not need the patent holder's permission.
I don't know if that goes as far as making use of a patented mill to provide generic electric power to a commercial workshop a patent infringement, but I wouldn't be surprised if it did.[ Parent ]
For example, I could hypothetically build a headlamp modulator (safety device) for a motorcycle used on my son's paper route. These are patented devices, but I would not worry about any risk of litigation. Not saying that I've actually built this device, or that I even have a son, of course :)[ Parent ]