gnat_merge
Synopsis
Merges Parquet files into designated time intervals.
Description
The gnat_merge
tool is primarily used to merge streams.
This tool implements the gnat
command line interface and shares the same required and optional arguments as other GNAT tools.
Required Arguments
--input <merge_configuration>
The --input
argument specifies the input configuration file in JSON format.
Json File Format
The JSON file is composed of an array of JSON objects, each object representing an input path.
Example
Merge files from /var/spool/icmp, /var/spool/udp, /var/spool/tcp into one stream sending results to /var/spool/merged every minute
$ gnat_merge --input /etc/merge.json --output /var/spool/merged --interval minute
The configuration merge.json
file should be in JSON format and specify input directories.
Here is an example configuration file:
[
{ "input":"/var/spool/icmp"},
{ "input":"/var/spool/tcp"},
{ "input":"/var/spool/udp"}
]