P1844 Enhancement of regex was rejected at the Prague meeting held in February 2020. Unfortunately, a possibility that C++ supports u8regex, u16regex, and u32regex collapsed.

If you are looking for a header-only regular expression library that supports UTF-8, UTF-16, and UTF-32, SRELL may fit your needs. (The sample implementation that was available here until the rejection was a modification of SRELL.)