A curated list of notable ETL (extract, transform, load) frameworks, libraries and software.
Big Data (Hadoop Stack)
ETL Tools (GUI)
Airflow - "Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command … Read More →
So you need to perform simple Extract Transform Load (ETL) from different databases to a data warehouse to perform some data aggregation for business intelligence. There are alot of ETL products out there which you felt is overkilled for your simple use case.
Here I am going to walk you through on how to Extract data … Read More →
Q. What is SSIS?
SSIS was first introduced with SQL Server 2005, which was the next generation of SQL Server software after SQL Server 2000. SSIS is an ETL tool that handles data Extraction, Transformation and load. In addition, it can handle more tasks besides the ETL tasks such as data profiling, file system manipulation etc…. … Read More →
Minimum No. of tables
1:1 cardinality with partial participation of both entities
1:1 cardinality with total participation of atleast 1 entity
Note: This is a general observation. Special cases need to be taken care. We may need extra table if attribute of a relationship can’t be moved to any entity side.
Keys of a relation: There are … Read More →
What are advantages of DBMS over traditional file based systems?
Ans: Database management systems were developed to handle the following dif?culties of typical ?le-processing systems supported by conventional operating systems.
1. Data redundancy and inconsistency
2. Dif?culty in accessing data
3. Data isolation – multiple ?les and formats
4. Integrity problems
5. Atomicity of updates
6. Concurrent access by multiple users
7. Security … Read More →