Data organisation is essential in e-commerce business otherwise it might get difficult to gather useful information related to orders, sales, or customers which in return can affect the overall performance of the business. One solution to it is to consider using rule sets to specify what data to include in the logs, the display order, the conditional logic for filtering which requests are included, and the log file number and names.
The custom log feature can be used for this purpose as it monitors and analyses the custom log files using a data stream.
Follow these steps to create a data stream that can read a custom log:
1. Provide the path of the custom log location (file location at the data source) > Provide a sample log entry for the custom log > Select the type of delimiter used for the custom log entry. If the delimiter is not listed then add it using ‘Other delimiter’. Similarly if the log entries are more complex, a regular expression for the sample log can be written by choosing ‘Write Regex’.
2. Click ‘Next’ to continue.
3. In this step, map the sample log entry with attribute name and code. Provide the necessary inputs.
4. Provide a name to the output stream and choose if you would like to use the IQLECT agent.