Then the real question becomes about your goals, rather than some vague ideas of "work". I think it's better to really consider what you want and don't want, and genuinely accept them. The productivity scale is not some inherent moral metric. This shrouds the intent of productivity, which is to accomplish goals.
So you're not worse if you're not being productive, but you are worse if you aren't accomplish whatever goals you have for yourself. Not because it's some moral failure but simply accomplishing goals feels good and not accomplishing them feels bad. Further the goals themselves aren't universal. They're merely reflections of your innate desires, which you have to accept. If you feel like you weren't "productive", it's probably closer to say that you feel bad for not achieving what you set out to do.
The simple problem here I think is goal setting. Not solely productivity itself.