This is exactly right. If you set out with some requirements such as 1) everything must be able to still work without internet access and 2) it must be simple enough that my mom/grandma/whatever can still use it, then you can still benefit from the convenience of these devices without all the downsides.
This is what I do. I insist that any “smart” whatever be strictly additive; that is, it must only add functionality but not remove anything. I will never buy a product that can’t be controlled physically or that requires Internet access. The net result is pretty great!