The answer is almost as long as the question, but I’ll put it here as a reminder to myself:
just put each version in a separate layer and save it as ico! Gimp will ask what ico format you want to use for each layer. The layer boundary indicates the size.