... | ... | @@ -25,11 +25,15 @@ If you wish to use a different domain, you need to add a `[domain]` section to y |
|
|
|
|
|
# Using the Domain for Data Thinning
|
|
|
|
|
|
Observations whose stations are located outside the adopted domain's area are discarded even before performing clustering. Moreover, for each point of a support grid based on the domain's original grid, the default behaviour of the `select` command is to discard all but one of the observations that were accepted during the clustering process.
|
|
|
The domain is used for data thinning in two ways:
|
|
|
1. Observations from stations located outside the adopted domain's area are discarded before performing clustering
|
|
|
2. In the `select` command, after clustering is finished for all observations and DTGs, a support grid is defined with spacing `domain.gsize x thinning_grid_coarse_factor`. Then, **only the lowest-rejection-rate station is picked for each support grid cell `(i, j)`.**
|
|
|
|
|
|
To define the support grid used by the `select` command for the post-clustering data thinning, set, under the config file's `[commands.select]` section, the parameter `thinning_grid_coarse_factor`. This parameter should be an integer larger than zero and defines how much coarser the support grid is w.r.t. the original one. **The default is `thinning_grid_coarse_factor=4`**.
|
|
|
The value of `thinning_grid_coarse_factor` is defined by setting a parameter with the same name under the config file's `[commands.select]` section. This should be an integer `>=0`. If not set, then **the default is `thinning_grid_coarse_factor=4`**.
|
|
|
|
|
|
**NB.:** **The removal of observations by the `select` command happens only after clustering**, at the very end of the process, right before writing the output files. **It has nothing to do with the clustering process**. Setting **`thinning_grid_coarse_factor=0` will disable this thinning.**
|
|
|
**NB.:** **The removal of observations by the `select` command happens only after clustering**, at the very end of the process, right before writing the output files. **It has nothing to do with the clustering process**.
|
|
|
|
|
|
**NB.2:** Setting **`thinning_grid_coarse_factor=0` will disable this thinning.** If using a value greater than zero, then it should divide both `domain.nlon` and `domain.nlat`.
|
|
|
|
|
|
# Using the Domain to Reduce Memory Usage and Improve Performance
|
|
|
|
... | ... | |