embed embed share link link comment comment

Embed This Video close
Share This Video close
bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark bookmark
embed test
Rate This Video embed
1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading ... Loading ...
Tags For This Video tags
rate rate tags tags related related lights lights

A metadata approach to fixed width files

Speaker:

Russel Loski

Abstract:

Face it, using SSIS to work with fixed width flat files is a pain. The SSIS interface has you clicking around to mark each column. Then you use another interface to set each columns data types, etc. And when you are done, you still need to document the file structure for your users. What if you could simply document the file structure and then generate the ETL from the document? To demonstrate such an approach, I build an Excel file describing US census data that has more than 300 columns of fixed width data. After demonstrating how this file communicates to business users, I will generate an SSIS package from that metadata using BIML Script. Then I will also look at how you can generate a SQL Server bulk insert format file from the same metadata. A small amount of C# code can generate quite a large extract.

Bio:

Russ Loski is a SQL Server BI Developer based in Dallas, TX. Twenty years ago, he began working with SQL Server 6.5. He has since continued to develop applications connected to all of the versions of SQL Server. He has worked with clients in industries from insurance to healthcare, from movie theaters to American football. Russ is a regular speaker at SQLSaturday events, as well as the SQL Server Users Groups in the North Texas region. Russ likes working with data in various shapes.

Recorded At:

SQLSATURDAY 939 Austin – BI Edition

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>