This PaaS supports creation of piplines for common operations like max, min, avg and supports storage of intermediate results. User can run these operations in any order to create a pipeline.
- Python 3
- rabbitMQ
- Clone the repo in each node of your cluster.
- Create a virtualenv
cloudpaasand activate it. If you do not have virtualenv installed, install it. (Installation: Windows, Linux & MAC OS) - To start job_manager on worker nodes run
rabbitstream/job_manager.py job_queue. - Execute the following command to apply migrations:
python manage.py migrate. - To run the server on local IP assigned with default port, execute the command
python manage.py runserver 0:8000.
Visit http://{your IP address}:8000 and register your account. You can now login and use the application.
- Add Job: - NOTE: This service only supports CSV file format with field names on the first row.
- See Result: - Shows the most recent result. you can download the intermediate results file from here.
- View Users: - View all users who have logged in.
- View Pipelines: - Shows the Jobs and pipelines by each user
- View Pricing: - Shows pricing details for each user