Share via

How to extract header row in a file containing column definitions and compare these against a control table

eaman 20 Reputation points
2025-06-11T07:44:19.1533333+00:00

What is the best way to design a pipeline in ADF where you can dynamically capture the header row (only) from a source file and compare this row containing column names against a control table with column definitions. If they match proceed to further processing, otherwise update another control table with status of failed. Kindly provide best practice, and less costly design and/or cheaper compute processing. Thanks.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,582 questions
Accepted answer
  1. Nandan Hegde 35,831 Reputation points MVP Volunteer Moderator
    2025-06-11T08:09:52.5866667+00:00

    You can use getmeta data activity to get the file header details :

    https://altisconsulting.com/au/insights/how-to-validate-data-lake-files-using-azure-data-factory-2/

    You can also use lookup activity with output as 1st row to get the file header details as well for alternative

    1 person found this answer helpful.

1 additional answer

Sort by: Oldest
Most helpful Newest Oldest
  1. eaman 20 Reputation points
    2025-06-12T10:50:04.3766667+00:00

    Thanks @Nandan Hegde for the effort and reply, unfortunately it did not resolve my question. Would appreciate for further clarity or other responses. Thanks in advance.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.