What are the best practices for FTP JSON file streaming?

We recommend, that you:

• Use a fast FTP server as local as possible to your Yellowfin instance to ensure the best performance. The processing speed will be governed by how fast the FTP server can serve files over the LAN/WAN
• Start with an empty folder
• Copy 5 starter files to the folder
• Ensure only one type of JSON file is in that folder
• Setup your connector to access JSON formatted files from that target folder
• Choose either FTP or sFTP session
• Choose either a timestamp or deletion strategy for file handling
• Use a representative JSON file in your designer (if there are variations in your JSON files, then choose a representative that has all the keys and JSON nests; so that the designer can identify all the required keys/paths
• Select the keys required and set the correct TYPES
• Save JSONPath file to the designer and then copy back to the connector
• Set the limit field to the number of file to be processed with each report run. e.g. 50/100/200/500 (any whole integer greater than zero)
• Build your view and your first table/chart
• Confirm your table/chart represents the 5 starter files.
• Save your report and set the report scheduler frequency.
• Now you can start sending files into that folder for processing

This topic is also covered in video 2 (embedded in the connector)