Incremental load in SSIS with example

Incremental load in SSIS

 
Daily data — (Stores) –> Table
(Granularity data)
  1. Maintain history [SCD]
  2. Direct loading
  3. ETL loading (indirect load)
Eg: loading the specified days data from one table to another table.
Sol: Go to SSIS → variable → click add and create two variables
 
Name                   Scope                   Data type                                Value  
EDATE               Package              Data time 6/2/2011                 12:36 AM
SDATE               Package              Data 6/2/2011                          12:36 AM
 
1) OLEDB source → rt click → edit →
       
OLEDB connection manager: local host:: DB-MSBI
Access mode: SQL command.
SQL command text:
Select * from Emp-Daily where St-Dt between?
And?
Click parameters:
Parameter 0: USER:SDATE
Parameter 1: USER:EDATE
 
FREE Demo Class From Industry Experts - Enroll Now.!! MSBI training

2) OLEDB destination → EMP-HIST table.
3) SSIS menu → package configurations → check enable package configuration → click add → next
Configuration type: XML configuration file.
Configuration file name: Browse and specify file new name click nextà
Go to SDATE and EDATE and check the ‘value’ sections.
Next → finish → close
Open configuration file → change SDATE and EDATE and run the package.
MindMajix Youtube Channel

SSIS Import Export Wizard

It performs operations between database to database, database to file, file to file.
a) BIDS level:
 
Data source:
Server name: Local host
Database: DB-MSBI  → Click next →
 
 
[ ⁄ ] Copy tables or views
[ ⁄ ] Write a query to retrieve the data from data set
 
Now the system creates a package according to the settings given, execute the package and observe the result i.e., go to for DB new in databases and observe.
 
 
b) SSMS level:
 
                        
Explore MSBI Sample Resumes! Download & Edit, Get Noticed by Top Employers!Download Now!

List of Related Microsoft Certification Courses:

 SSRS Power BI
 SSAS SQL Server
 SCCM SQL Server DBA
 SharePoint BizTalk Server
 Team Foundation Server BizTalk Server Administrator

 

 

Job Support Program

Online Work Support for your on-job roles.

jobservice

Our work-support plans provide precise options as per your project tasks. Whether you are a newbie or an experienced professional seeking assistance in completing project tasks, we are here with the following plans to meet your custom needs:

  • Pay Per Hour
  • Pay Per Week
  • Monthly
Learn MoreGet Job Support
Course Schedule
NameDates
MSBI TrainingNov 19 to Dec 04View Details
MSBI TrainingNov 23 to Dec 08View Details
MSBI TrainingNov 26 to Dec 11View Details
MSBI TrainingNov 30 to Dec 15View Details
Last updated: 03 Apr 2023
About Author

Ravindra Savaram is a Technical Lead at Mindmajix.com. His passion lies in writing articles on the most popular IT platforms including Machine learning, DevOps, Data Science, Artificial Intelligence, RPA, Deep Learning, and so on. You can stay up to date on all these technologies by following him on LinkedIn and Twitter.

read less
  1. Share:
MSBI Articles