Creating a CSV Data Source

Follow the instructions below to create a CSV Data Source and import the data from the files.

For information about updating a CSV data source if a file changes, see How do I update Anzo if a file in my CSV data source changes?

  1. In the Anzo application, expand the Onboard menu and click Structured Data. Anzo displays the Data Sources screen, which lists any existing Data Sources. For example:

  2. Click the Add Data Source button and select File Data Source > CSV Data Source. Anzo opens the Create CSV Data Source screen.

  3. Specify a name for the Data Source in the Title field, and type an optional description in the Description field. Then click Save. Anzo saves the source and displays the Tables tab.

  4. Click the Add New File button. Anzo displays the Add New File dialog box, and the Upload Files tab is selected.

  5. Follow the appropriate steps below depending on whether the CSV files are on your computer or the shared File Store:

    If the files are on your computer:

    The Upload Files option is a convenient way to do a one-time ingestion so you can quickly get started with your data. It should not be relied upon as part of a regular ingestion workflow unless the server is configured to store uploaded files on the shared file store. For more information, see Setting a Base File Store Path for File Uploads. Data source files that are routinely updated and re-ingested should be hosted on a configured file store.

    1. Drag and drop the files onto the Upload Files tab or click browse to navigate to the files and select them. Anzo attaches the files and the Next button becomes active.
    2. Click Next. Anzo lists the uploaded files on the left side of the screen with a status of Pending. For example:

    If the files are on the file store:

    1. Click the Select Files tab. Anzo displays the file selection dialog box.

    2. On the left side of the screen, select the File Store that hosts the CSV files. On the right side of the screen, navigate to the directory that contains the files to import. The screen displays the list of files in the directory. For example:

    3. Select each file that you want to import. If you have multiple files with the same schema— the files contain the same columns listed in the same order—and you want the files to be imported as if they are a single file, you can select the Insert Wildcard option. Then type a string using asterisks as wildcard characters to find the files with similar names. Files that match the specified string will be imported as one file and will result in one job being created in the pipeline to ingest all of the files that are selected by the specified string. After typing a string, click Apply to include that string in the Selected list.

      The image below shows a directory with several CSV files. For this example, part.csv and partsupp.csv have the same schema and can be imported as one file. The Insert Wildcard option is selected, and part*.csv is specified to identify the two files.

    4. When you finish selecting files, click Next to close the dialog box. Anzo lists the uploaded files on the left side of the screen with a status of Pending. For example:

  6. If you do not need to change CSV file options, click the Process Pending Files button to import all of the pending files. Anzo imports the data and updates the status to Processed.

    If you do need to change CSV file options, click the menu icon () for that file and select Edit. To change the options for multiple files, select the checkbox next to each file, and then click the Edit button at the bottom of the table. Anzo displays the Edit CSV File screen. For example, the image below shows the Edit screen for a single file:

    Change the options as needed and then click Save & Import to import the file or files. Anzo imports the data and updates the status to Processed.

  7. Once the files are processed, the Profile Data, Add To Dictionary, and Ingest buttons become available. And you can click a table row on the left side of the screen to display the Schema on the right side of the screen. For example:

    For information about assigning primary keys and creating foreign keys, see Assigning Primary Keys in an Onboarded Schema and Creating or Changing Foreign Keys.

The source data can now be onboarded to Anzo. For instructions on onboarding the data by letting Anzo automatically generate the Mappings, Model, and ETL Pipeline, see Ingesting a New Data Source. For information about adding a Schema to a Metadata Dictionary, see Creating a Metadata Dictionary.

Related Topics