s_r_n

I am trying to identify model architecture candidates that could, like transformers, have "emergent" properties when they are scaled (see https://arxiv.org/abs/2206.07682).

Some contenders I already know about are:

* Monarch Mixer (https://arxiv.org/pdf/2111.00396.pdf)

* Hyena (https://hazyresearch.stanford.edu/blog/2023-03-07-hyena)

Thanks for your help.

Something that I really wish I had was a database with all of the industries that exist, the markets within them, and the size of those markets and how much they are expected to grow. This is a tool that would really help me decide what to work on next. I don't know the first place to look to get data like this. Does anyone know of such a database?

I am extremely frustrated by the lack of a web app that will simply store PDFs and let you annotate them. For example, a simple navigation sidebar and a display to the right would be sufficient. I have tried googling for this to no avail. Are there any recommendations for something like this? As a sidenote, I currently use Dynalist for all of my notes and if there is something similar to this that can store and annotate PDFs, that would be ideal.

I saw an article today where Steve Wozniak said he didn't think autonomous cars would come to fruition during his lifetime. However, I have not read very much about any sort of innovation around a system that uses human drivers to control vehicles remotely. Why isn't this idea being explored more?

Are there any organizations out there who are thinking about using some sort of propulsion technique to change the orbit of the Earth so that the distance between the Earth and the Sun is slightly larger? This seems like it could offset the heating effects from climate change by decreasing the amount of sunlight that the Earth is exposed to.

Every week, my team has a company-provided lunch. Since we are a startup and don't have an office manager, I have become the one responsible for ordering. It's not a big deal--it only takes 15 minutes or so--but it's a distraction that I wish to automate.

My current process is finding a new restaurant on Caviar, sending a Slack message to the team asking for their orders, and placing the order. Anyone know of a good app that automates this process, or solved this experience somehow?