SFMC Batch File Processing
  • 13 Nov 2024
  • 1 Minute to read
  • Dark
    Light

SFMC Batch File Processing

  • Dark
    Light

Article summary

Overview

The Relay package allows for easy creation and transmission of necessary data through a batch file process.  Relay provides standard data extract automations as part of the package installation that can be scheduled to send through an SFTP connection within SFMC.

SFTP Integration: Clients can transmit the data via an SFTP setup from the standard data extractions automations

Standard Data Extract Automations: Relay has a collection of standard data extract automations built. These automations utilize standardized data structures and naming to enable sharing with Clients for use in their SFMC environments. Loading data into the standard data extensions is the responsibility of the Client. Each Client data structure within SFMC can be customized, Clients are responsible to write a query to populate the Relay standard data extensions with data from their unique data extensions. Relay has created SQL Query “shells” to support the loading of standard data extensions.

How it Works

Batch file processing from SFMC into Relay has been set up as a four-step process by file type.

Step 1: is a SQL query activity to extract data from its source(s) and map it into the standard data extension for the file type of the batch process. Relay suggests completing the SQL Mapping Worksheet before updating a SQL query.

Step 2: Data extension extract. This Data Extract will create a file based on a Data Extension structure. The file will be placed in the SFMC ‘Safehouse’ with a specific file name that is noted in the set-up of the Data Extract. Each Data Extract Activity with a Data Extension Extract Type requires the following standard configuration in the set-up.

  • Column Delimiter: comma (,)

  • Customer Key: Data Extension External Key

  • Has Column Headers: Check Box

  • Uses Line Feed: DO NOT Check Box

  • Text Qualified: Check Box

Step 3: UTF16 to ASCII Converter extract. This Data Extract will convert the file that was created from the Data Extension and convert to an ASCII format for Relay Network batch processing.

Step 4: File transfer to Relay. Requires SFTP Connection established for the file type of the batch process. Each File Transfer Activity requires the following standard configuration in the Transfer Settings section.

  • Transfer Setting: Check Encrypt File

  • Customer Public Key: Select Relay Public Key (see Public Key setup in section 4.6)


Was this article helpful?

ESC

Eddy AI, facilitating knowledge discovery through conversational intelligence