Filter Transformation

FILTER What is the difference between router and filter transformation? A Filter transformation tests data for one condition and drops the rows that do not meet the condition. Discarded rows will not appear in session log or reject files. A Router transformation tests data for one or more conditions and routes the rows that do not meet any of the conditions to a default output group. A Router transformation is more efficient as it can replace multiple Filter transformations. For a Router transformation the data is processed only once. But for Filter transformation the input data is processed for each Filter transformation. What is the difference between source qualifier filter and filter transformation? The source qualifier filters the rows when it reads the rows ie at database level. The main difference is the SQ limits the rows while extracting from the sources and FT limits the rows before they are sent to the target. SQ can only filter rows that are coming from relational database. FT can filter rows that come from any type of source. Can you filter rows coming from more than one source? No. The input ports for the filter must come from a single transformation. Can we set output default values in a filter transformation? No. The Filter transformation does not allow setting output default values. What are the performance increasing tips? Use the Filter transformation early in the mapping. Use the Source Qualifier transformation to filter.

How do I filter out rows with null values? To filter out rows containing null values or spaces, use the ISNULL and IS_SPACES functions to test the value of the port. Only rows which meet the filter condition will pass through the Filter Transformation. Only rows that return TRUE pass through this transformation.