During data load or transformation processes, capturing a distinct row number for incoming data can be beneficial for the ETL process itself, as well as for use in the destination database. Having an arbitrary, incrementing row number assigned to each row can help to determine the order in which the rows of data were processed, and can provide a unique…
Now that the details have been finalized, I can announce that a new SSIS class coming up this fall. My Linchpin People cohort Andy Leonard and I will be delivering our Advanced SSIS training class in the Washington, DC area in December. This class is four days in length, ideally suited for experienced SSIS developers who want to take their skills…
The Advanced SSIS training course is designed for ETL professional with at least 2 years experience using SSIS. This can be either a 3- or 4-day course, depending on whether lab exercises are included. Advanced SSIS Training Class (3- or 4-day course) If you are looking to take your SQL Server Integration Services (SSIS) skills to the next level, this course…
The answer: It Depends. One of the more common problems I encounter when managing data quality, especially in an ETL process, is the proper handling of null, empty string, or zero values. When I put on my preaching shoes to talk about bad data, this is one the areas I have to spend a lot of time covering because it…
When processing data files using SQL Server Integration Services, it is not uncommon to find files with different end-of-line markers for each line in the file. In this post, I will demonstrate how to fix inconsistent line terminators in SSIS to avoid ETL errors. Fix Inconsistent Line Terminators in SSIS In every text file, there are unprintable characters called line…
I’m very excited to offer a new course entitled “Advanced SSIS” in the Dallas area this spring. My friend and colleague Andy Leonard and I will be delivering this new 3-day course March 9-11, 2015 at the Microsoft offices in Irving, Texas. This course is intended for those who have experience using Integration Services who are looking to take their…
Today is the last official day of the PASS Summit. The sessions will wrap up at the end of the day, and we’ll all go our separate ways and resume our semi-normal lives. Having delivered my presentation yesterday, my official PASS duties are over, and I’m planning to spend the day taking in a few sessions and networking. 08:15am: No…
“It’s the most wonderful time of the year…” No, not the end-of-year festival of repetitive music, overeating, and trampling on other people to find that perfect gift. No, it’s time again for the PASS Summit, the annual gathering of SQL Server and data professionals from around the world. The event, which is run by the organization formerly known as the…
There’s a brand new business intelligence conference launching next month in Denver, Colorado. The Mile High Tech Con is a three-day event taking place July 24-26, 2014, and is aimed at business intelligence practitioners, data analysts, and information managers/CIOs. From the event website: Featuring three days of sessions and events focusing on Data Warehousing and Business Intelligence. Mile High Tech…
“Teach a person to fish and you feed them for a lifetime.” While most of my clients ask me to build a solution for them, many others have their own staff who, with proper training, can build and support solutions with minimal assistance. I am passionate about helping organizations do data warehousing, ETL, and data quality the right way, and over…