Improvements to local serving of federation logos

Description

Address remaining issues related to local serving of federation logos:

  1. it should be not possible to start a new logos downloading process, while one is still in progress (NOTE: update documentation to reflect this).

  2. logos should be available as soon as are downloaded, not only after a full download of all; i.e. move from stage dir to final dir as soon as logo is downloaded; then add pointer file w/ extension

  3. from time to time clean logos of federations which are not in production anymore. Note that this is important especially in case of switch AAI, which is… rotating their federation id very often, it is including a timestamp. (work moved to a separate ticket)

  4. Clean logos of federations which are still in production. Remove all logo that were not fetched in iteration.

  5. Experiment with connection vs read timeouts. Perhaps we can have better efficiency with separate controls (longer connect vs shorter read)?

  6. Investigate reasons behind unexpected failures. Unavailable server, 404 and SSL problems are possible and expected. But why https://shibboleth.coventrycollege.ac.uk/logo-medium.png is not downloaded?

Activity

Show:

Krzysztof October 27, 2022 at 9:34 AM

QA:

there were few issues:

  1. tests were failing on Java 17

  2. loading of logos which were not prefetched (i.e. not coming from the federation) was broken in some cases

  3. there was serious congestion on the executor when thousands of logo download tasks were plugged into it, essentially postponing all other tasks until almost all logos were downloaded.

I’ve fixed all those issues, will open CRs for them.

Done

Details

Assignee

Reporter

Area

Fix versions

Priority

Created October 10, 2022 at 11:35 AM
Updated October 27, 2022 at 9:34 AM
Resolved October 27, 2022 at 9:34 AM