Edit: The docs say indices need to be rebuilt when ICU version changes: https://www.postgresql.org/docs/11/sql-altercollation.html
ICU offers a way to detect the collation version has changed, but I thought there was no way to access older collation versions.