Opened 4 years ago

Closed 4 years ago

#2293 closed enhancement (fixed)

wcst_import - enhancement for importing with large number of input files

Reported by: Bang Pham Huu Owned by: Bang Pham Huu
Priority: major Milestone: 10.0
Component: wcst_import Version: 9.8
Keywords: Cc: Dimitar Misev, Vlad Merticariu
Complexity: Medium

Description

The case is importing Sentinel 2 data with input file paths collected by other scripts and generate ingredient files from these list of file paths.

In ingredients file if the input file paths are already absolute paths, wcst_import stills use glob to try to collect files and it makes it much more slow for nothing.

And in case of the number of input files are large (thousands of files), it will take very long time to validate file paths (e.g: try to open with gdal). This file path validation is not needed as it has the option "skip": true already in the ingredients file to bypass a broken input file.

Change History (1)

comment:1 by Bang Pham Huu, 4 years ago

Resolution: fixed
Status: assignedclosed
Note: See TracTickets for help on using tickets.