So actually the main reason I'm interested in ipython-style notebooks for my terminal shell needs is the benefit of having... graphs! and pictures! and other graphical things in a terminal shell setting. I'm willing to put up with inconveniences you speak of if I can get the graphical things working well. People have experimented with it, it seems:
http://jeroenjanssens.com/2015/02/19/ibash-notebook.html I'll look more into it now.