Emergency/DEM cache below certain zoom (EMG) or with a certain pattern (DEM) returns 502
When zooming below certain zoom on Emergency and on random tiles from DEM, mapcache returns 502 with following errors:
| Jan 5, 2021 @ 11:39:00.439 | realloc(): invalid next size |
| Jan 5, 2021 @ 11:39:01.456 | [Tue Jan 05 10:39:01.454923 2021] [core:notice] [pid 132:tid 140477779360704] AH00052: child pid 1428 exit signal Aborted (6) |
example request with enough available memory on caches (restarted all cache containers): TileMatrix 15 error: https://emg.pass.copernicus.eu/cache/ows/wmts?layer=Emergency__TRUE_COLOR&style=default&tilematrixset=WGS84&Service=WMTS&Request=GetTile&Version=1.0.0&Format=image%2Fpng&TileMatrix=15&TileCol=21662&TileRow=13694&time=2018-05-01T00%3A00%3A00Z%2F2018-05-08T06%3A46%3A32Z
accessed from client https://emg.pdas.prism.eox.at/?x=-60.987155&y=14.785008&z=16×tart=2018-05-01T00%3A00%3A00Z&timeend=2018-05-08T06%3A46%3A32Z
saved yes: Emergency__TRUE_COLOR/WGS84/2018-05-04T14:26:05Z/2018-05-04T14:26:08Z/14/10829/9537.xxx saved not: Emergency__TRUE_COLOR/WGS84/2018-05-04T14:26:05Z/2018-05-04T14:26:08Z/15/13689/9537.xxx
accessed from client: https://emg.pdas.prism.eox.at/?x=17.718770&y=45.017191&z=15×tart=2019-03-01T00%3A00%3A00Z&timeend=2019-04-01T00%3A00%3A00Z
saved yes: Emergency__TRUE_COLOR/WGS84/2019-03-28T09:49:41Z/2019-03-28T09:49:44Z/13/8998/6145.xxx saved not: Emergency__TRUE_COLOR/WGS84/2019-03-28T09:49:41Z/2019-03-28T09:49:44Z/14/17994/????.xxx
Problem was not seen on VHR_IMAGE_2018 at all
VHR_IMAGE_2018 works even up to z=17 https://vhr18.pass.copernicus.eu/cache/ows/wmts?layer=VHR_IMAGE_2018_Level_3__TRUE_COLOR&style=default&tilematrixset=WGS84&Service=WMTS&Request=GetTile&Version=1.0.0&Format=image%2Fpng&TileMatrix=17&TileCol=119009&TileRow=44932&time=2018-01-30T21%3A04%3A46Z%2F2019-03-08T10%3A02%3A54Z
DEM collection has this issue happening with a different pattern, but not randomly (for some tiles of a single product yes, for some not) even on TileMatrix 10 but if you are viewing individual layers, which compose the DEM layer (DEM_COP-DEM_EEA-10-DGED__EARTH for example), none of those runs into an error.
https://dem.pass.copernicus.eu/cache/ows/wmts?layer=DEM_COP-DEM_EEA-10-DGED__EARTH&style=default&tilematrixset=WGS84&Service=WMTS&Request=GetTile&Version=1.0.0&Format=image%2Fpng&TileMatrix=8&TileCol=264&TileRow=65&time=2011-03-27T00%3A00%3A00Z%2F2011-04-03T00%3A00%3A00Z - runs fine and same with all six individual layers
-> seen on client https://dem.pdas.prism.eox.at/?x=4.866364&y=45.224732&z=9×tart=2011-03-27T00%3A00%3A00Z&timeend=2011-04-03T00%3A00%3A00Z
Suspicion that the length of the key stored to the object storage would be an issue was denied.
Size of products should also not be a problem as some DEM products are smaller and some larger than average VHR products, but all of them work in individual DEM layers, but on DEM shared one not.
Problem is happening on all nodes.