Importing Documentations

Before we start uploading additional data, that we for instance can use for lineage, program elements and other program documentations, we first need to ensure that the data we upload match the units and fields in Engrafo.

Luckily for this demo, this is all taken care of, but when you start uploading your own data you will have to manually create these templates: Configuring Templates for Data Usage

For the sake of this demo we have created a bunch of .csv files for creating and documenting data documentations, but firstly we will be focusing on the file containing information about input and output data. this is the core for creating lineage:

These files will also create our actual Data Documentations.

The process for loading data is simple and is the same as when we uploaded our Data Catalog. Simply head to Load Metadata → Meta load (API). From here follow the process of: Upload Files → Validate Files → Load Files. See Loading Metadata and Documentations for more information about column requirements or simply follow the instructions in Engrafo.

After loading, if you head over to “Data Usage” you should now see a bunch of new data documentations under the category Wide World importers

Clicking one, will show all information for that documentation. In the top right corner is also where you will be able to create lineage.

Here you can play around with customizing your lineage tree and creating an overview of your data. More about that on the next page: Creating Data Lineage

Right now our documentations only contain information about input and output, so lets add some descriptions and other program elements as well. The following files contain descriptions, external documentations and some SQL code for our documentations:

We upload them same as before…

And now our documentations will contain a bunch more useful data.

Keep in mind, the units chosen here (High Level Description and Program Elements) along side the fields below are all just examples. You can really add just about anything you wish here. Read more about units and field types here: Configuring Templates for Data Usage | Types of Fields and Properties for Fields