S3

Sync raw data to S3, including json.gz files while excluding .json files. The process specifies a time window in seconds for file modification, ensuring only recently updated files are synced. This avoid scanning all files, reduce AWS S3 file comparison API requests, and save costs.