[chore] Prepare release v1.23.0/v0.117.0 (#12043)

The following commands were run to prepare this release:
- make chlog-update VERSION=v1.23.0/v0.117.0
- make prepare-release PREVIOUS_VERSION=1[.]22[.]0
RELEASE_CANDIDATE=1.23.0 MODSET=stable
- make prepare-release PREVIOUS_VERSION=0[.]116[.]0
RELEASE_CANDIDATE=0.117.0 MODSET=beta

This PR also includes fix
#12051 to
reduce back-and-forths

---------

Co-authored-by: Dmitrii Anoshin <[email protected]>

Author: opentelemetrybot