It is used, just with the caveat in mind that it may exist when the derivative doesn't. It is usually called the symmetric derivative (https://en.wikipedia.org/wiki/Symmetric_derivative).