A patent is essentially a document with just two purposes: 1) instructing a practitioner how to reconstruct the claimed invention, and 2) defining the legal scope of ownership for the claimed invention. By itself, it does nothing else, and thus does not constitute making, using, or selling.
Now if somebody other than the patent-holder takes the source, compiles it and uses and / or distributes it without license, they are infringing. Note that by taking and compiling the source, they are essentially just fulfilling the first intended purpose of the patent: instruction. Where they run afoul is the second purpose.