Test failure System.Security.Cryptography.Rsa.Tests.RSAKeyFileTests.NoFuzzyPkcs8

[v-wenyuxu]

Run: runtime-coreclr libraries-jitstress 20230410.1

Failed test:

net8.0-windows-Release-x86-CoreCLR_checked-zapdisable-Windows.10.Amd64.Open

- System.Security.Cryptography.Rsa.Tests.RSAKeyFileTests.NoFuzzyPkcs8 

Error message:

System.Security.Cryptography.CryptographicException : An internal error occurred.


Stack trace
   at System.Security.Cryptography.CapiHelper.GetKeyPairHelper(CspAlgorithmType keyType, CspParameters parameters, Int32 keySize, SafeProvHandle safeProvHandle) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CapiHelper.Windows.cs:line 734
   at System.Security.Cryptography.RSACryptoServiceProvider.get_SafeKeyHandle() in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSACryptoServiceProvider.Windows.cs:line 134
   at System.Security.Cryptography.RSACryptoServiceProvider.ExportParameters(Boolean includePrivateParameters) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSACryptoServiceProvider.Windows.cs:line 362
   at System.Security.Cryptography.RSA.ExportRSAPublicKey() in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSA.cs:line 713
   at System.Security.Cryptography.Rsa.Tests.RSAKeyFileTests.NoFuzzyPkcs8() in /_/src/libraries/Common/tests/System/Security/Cryptography/AlgorithmImplementations/RSA/RSAKeyFileTests.cs:line 1002
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 59

[ghost]

Tagging subscribers to this area: @dotnet/area-system-security, @bartonjs, @vcsjones
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Run: runtime-coreclr libraries-jitstress 20230410.1

Failed test:

net8.0-windows-Release-x86-CoreCLR_checked-zapdisable-Windows.10.Amd64.Open

- System.Security.Cryptography.Rsa.Tests.RSAKeyFileTests.NoFuzzyPkcs8 

Error message:

System.Security.Cryptography.CryptographicException : An internal error occurred.


Stack trace
   at System.Security.Cryptography.CapiHelper.GetKeyPairHelper(CspAlgorithmType keyType, CspParameters parameters, Int32 keySize, SafeProvHandle safeProvHandle) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CapiHelper.Windows.cs:line 734
   at System.Security.Cryptography.RSACryptoServiceProvider.get_SafeKeyHandle() in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSACryptoServiceProvider.Windows.cs:line 134
   at System.Security.Cryptography.RSACryptoServiceProvider.ExportParameters(Boolean includePrivateParameters) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSACryptoServiceProvider.Windows.cs:line 362
   at System.Security.Cryptography.RSA.ExportRSAPublicKey() in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSA.cs:line 713
   at System.Security.Cryptography.Rsa.Tests.RSAKeyFileTests.NoFuzzyPkcs8() in /_/src/libraries/Common/tests/System/Security/Cryptography/AlgorithmImplementations/RSA/RSAKeyFileTests.cs:line 1002
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 59

Author:	v-wenyuxu
Assignees:	-
Labels:	arch-x86, area-System.Security, os-windows, JitStress, untriaged
Milestone:	-

[v-wenyuxu]

Failed again in: runtime-coreclr libraries-jitstress 20230504.1

Failed tests:

net8.0-windows-Release-x64-CoreCLR_checked-no_tiered_compilation-Windows.10.Amd64.Open
    - System.Security.Cryptography.Rsa.Tests.EncryptDecrypt_Span.RsaCryptRoundtrip_OaepSHA384

Error message:

 System.Security.Cryptography.CryptographicException : Unknown error (0xc10000e5)

Stack trace:

    at Interop.BCrypt.BCryptFinalizeKeyPair(SafeBCryptKeyHandle key) in /_/src/libraries/Common/src/Interop/Windows/BCrypt/Interop.BCryptFinalizeKey.cs:line 24
   at System.Security.Cryptography.RSABCrypt.GetKey() in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSABCrypt.cs:line 53
   at System.Security.Cryptography.RSABCrypt.TryEncrypt(ReadOnlySpan`1 data, Span`1 destination, RSAEncryptionPadding padding, Int32& bytesWritten) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSABCrypt.cs:line 217
   at System.Security.Cryptography.RSA.Encrypt(ReadOnlySpan`1 data, Span`1 destination, RSAEncryptionPadding padding) in /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/RSA.cs:line 215
   at System.Security.Cryptography.Rsa.Tests.EncryptDecrypt_Span.<>c__DisplayClass0_0.<Encrypt>b__0(Byte[] dest) in /_/src/libraries/Common/tests/System/Security/Cryptography/AlgorithmImplementations/RSA/EncryptDecrypt.netcoreapp.cs:line 13
   at System.Security.Cryptography.Rsa.Tests.EncryptDecrypt_Span.WithOutputArray(Func`2 func) in /_/src/libraries/Common/tests/System/Security/Cryptography/AlgorithmImplementations/RSA/EncryptDecrypt.netcoreapp.cs:line 26
   at System.Security.Cryptography.Rsa.Tests.EncryptDecrypt.RsaCryptRoundtrip(RSAEncryptionPadding paddingMode, Boolean expectSuccess) in /_/src/libraries/Common/tests/System/Security/Cryptography/AlgorithmImplementations/RSA/EncryptDecrypt.cs:line 333
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 59

[bartonjs]

Duplicate of #29683 (Win32 "internal error")