It's not good practice to rely on a user's cache. If they visit your site twice in a span of a day, they may have already cleared their cache or pushed your files out with other sites' files.
This article demonstrates a pretty good method to reduce unnecessary byte transfer which will ultimately speed up page loading.