A curated list of notable ETL (extract, transform, load) frameworks, libraries and software.

Awesome ETL

Workflow Management/Engines
Job Scheduling
Python
Ruby
Go
Java
Talks/Articles
Cloud Services
Big Data (Hadoop Stack)
ETL Tools (GUI)

Related Lists

awesome-pipeline

Workflow Management/Engines

Airflow - "Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command Read More →

Cardinality
Minimum No. of tables

1:1 cardinality with partial participation of both entities
2

1:1 cardinality with total participation of atleast 1 entity
1

1:n cardinality
2

m:n cardinality
3

 
Note: This is a general observation. Special cases need to be taken care. We may need extra table if attribute of a relationship can’t be moved to any entity side.
 
Keys of a relation: There are Read More →

What are advantages of DBMS over traditional file based systems?
Ans: Database management systems were developed to handle the following dif?culties of typical ?le-processing systems supported by conventional operating systems.
1. Data redundancy and inconsistency
2. Dif?culty in accessing data
3. Data isolation – multiple ?les and formats
4. Integrity problems
5. Atomicity of updates
6. Concurrent access by multiple users
7. Security Read More →