The main motivation behind building this tool was to make onboarding easier on Apache Airflow. There was no standard structure for a airflow projects and setting it up on local can be a nightmare sometimes. The simple CLI tool makes it very easy to create and test your project locally before deploying it to your production or staging environment via your CI/CD.
Right now we are using a docker-compose file which brings up all the Airflow services but we are also currently working on providing a command to control individual process.
Qubole is not a cloud but a self managed Data Platform. Deploying on Qubole means just putting all the Dag files on the machine (AWS/ GCP/ Azure) where airflow is running. Qubole provides out of the box solutions for running airflow on your cloud with a click of a button. We offer bunch of different things (Spark, Presto, notebooks, etc) and have a great eco system build around Airflow.
Currently using some custom code to do this using a database table but totally aware of how fickle and easy to screw up this method can be, and open to suggestions.
It does ring a bell, but airflow gives a lot of hits on google. Would be helpful to add a link in your readme to 'your' Airflow.
Great product experience, fully open source. Gives your people using Airflow a sweet UI so they don't need to go CLI
