gh-146031: Allow keeping specialization enabled when specifying eval … #2878

Job	Run time
aarch64-apple-darwin/clang	10m 24s
aarch64-unknown-linux-gnu/gcc	7m 28s
x86_64-unknown-linux-gnu/gcc	9m 31s
x86_64-apple-darwin/clang	18m 6s
x86_64-unknown-linux-gnu/gcc-free-threading	8m 32s
	54m 1s

Provide feedback