Generally, clearing caches will make programs run slower once (on first run after the clear), but it could speed things up if there's a massive amount of other stuff cached or if the cached thing you're trying to run got corrupted somehow.
There is no situation in which having a populated page cache will slow things down, since those are the pages that linux will drop first to use for whatever else needs them.
