Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
vincentclaes committed Jan 29, 2021
1 parent b0d56ed commit e7f16ed
Showing 1 changed file with 4 additions and 11 deletions.
15 changes: 4 additions & 11 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,21 +1,14 @@
# Datajob

> Datajob is an MVP. Do not use this in production. <br/>
> [Feedback](https://github.com/vincentclaes/datajob/discussions) is much appreciated!
### Build and deploy a serverless data pipeline with no effort on AWS.

- Datajob uses exclusively serverless services.
- There is no custom or managed application needed to deploy and run your data pipeline on AWS!
- The main dependencies are [AWS CDK](https://github.com/aws/aws-cdk) and [Step Functions SDK for data science](https://github.com/aws/aws-step-functions-data-science-sdk-python)

Currently implemented:
#### Build and deploy a serverless data pipeline with no effort on AWS.

- Deploy your code to a glue job.
- Package your project and make it available for your glue jobs.
- Orchestrate your pipeline using stepfunctions as simple as `task1 >> [task2,task3] >> task4`

Ideas to be implemented can be found [below](#ideas)
> The main dependencies are [AWS CDK](https://github.com/aws/aws-cdk) and [Step Functions SDK for data science](https://github.com/aws/aws-step-functions-data-science-sdk-python) <br/>
> Ideas to be implemented can be found [below](#ideas) <br/>
> [Feedback](https://github.com/vincentclaes/datajob/discussions) is much appreciated!

# Installation
Expand Down

0 comments on commit e7f16ed

Please sign in to comment.