1 ########################################################################### 2 # 3 # Copyright (c) 2009, 2012, Oracle and/or its affiliates. All rights reserved. 4 # DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER. 5 # 6 # This code is free software; you can redistribute it and/or modify it 7 # under the terms of the GNU General Public License version 2 only, as 8 # published by the Free Software Foundation. Oracle designates this 9 # particular file as subject to the "Classpath" exception as provided 10 # by Oracle in the LICENSE file that accompanied this code. 11 # 12 # This code is distributed in the hope that it will be useful, but WITHOUT 13 # ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or 14 # FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License 15 # version 2 for more details (a copy is included in the LICENSE file that 16 # accompanied this code). 17 # 18 # You should have received a copy of the GNU General Public License version 19 # 2 along with this work; if not, write to the Free Software Foundation, 20 # Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA. 21 # 22 # Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA 23 # or visit www.oracle.com if you need additional information or have any 24 # questions. 25 # 26 ########################################################################### 27 # 28 # List of tests that should not be run by test/Makefile, for various reasons: 29 # 1. Does not run with jtreg -samevm mode 30 # 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it 31 # 3. The test is too slow or consumes too many system resources 32 # 4. The test fails when run on any official build systems 33 # 34 # It is possible that a test being on this list is a mistake, and that some 35 # other test in samevm mode caused tests to fail, mistakes happen. 36 # 37 # Tests marked @ignore are not run by test/Makefile, but harmless to be listed. 38 # 39 # Tests that explicitly state "@run main/othervm ...", and are not listed here, 40 # will be run in the same batch as the samevm tests. 41 # 42 # Shell tests are othervm by default. 43 # 44 # List items are testnames followed by labels, all MUST BE commented 45 # as to why they are here and use a label: 46 # generic-all Problems on all platforms 47 # generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc. 48 # OSNAME-all Where OSNAME is one of: solaris, linux, windows 49 # OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-x64 50 # OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8 51 # 52 # More than one label is allowed but must be on the same line. 53 # 54 ############################################################################# 55 # 56 # Running the tests: 57 # cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all 58 # Or instead of jdk_all, use any of the jdk_* targets. 59 # 60 # Samevm Notes: 61 # * Although some tests may have only been seen to fail on some platforms, 62 # they might be flagged as 'generic-all' because the problem they have 63 # could cause hidden slowdowns on other platforms. 64 # Most samevm problems will be generic-all, but windows usually dislikes 65 # them the most. 66 # Address already in use or connection errors indicate a generic port issue. 67 # (this is not necessarily a samevm issue, but an issue for running the tests 68 # on shared machines, two people or two test runs will collide). 69 # * Samevm problem (windows in particular) is not closing all input/output 70 # * Samevm problem when a test calls setSecurityManager() 71 # * Samevm problem with setHttps*() is used? (not exactly sure here) 72 # * Samevm problem when stuffing system properties with non Strings or anything 73 # * Samevm problem when changing vm settings, or registering any vm actions 74 # * Samevm problems with deleteOnExit(), if it must happen at end of test 75 # * Samevm problems with URLClassLoader? (no details here) 76 # * Samevm problems with dependence on predictable GC or finalizations 77 # 78 # Any of the above problems may mean the test needs to be flagged as "othervm". 79 # 80 ############################################################################# 81 # 82 # Fixing the tests: 83 # 84 # Some tests just may need to be run with "othervm", and that can easily be 85 # done my adding a @run line (or modifying any existing @run): 86 # @run main/othervm NameOfMainClass 87 # Make sure this @run follows any use of @library. 88 # Otherwise, if the test is a samevm possibility, make sure the test is 89 # cleaning up after itself, closing all streams, deleting temp files, etc. 90 # 91 # Keep in mind that the bug could be in many places, and even different per 92 # platform, it could be a bug in any one of: 93 # - the testcase 94 # - the jdk (jdk classes, native code, or hotspot) 95 # - the native compiler 96 # - the javac compiler 97 # - the OS (depends on what the testcase does) 98 # 99 # If you managed to really fix one of these tests, here is how you can 100 # remove tests from this list: 101 # 1. Make sure test passes on all platforms with samevm, or mark it othervm 102 # 2. Make sure test passes on all platforms when run with it's entire group 103 # 3. Make sure both VMs are tested, -server and -client, if possible 104 # 4. Make sure you try the -d64 option on Solaris 105 # 5. Use a tool like JPRT or something to verify these results 106 # 6. Delete lines in this file, include the changes with your test changes 107 # 108 # You may need to repeat your testing 2 or even 3 times to verify good 109 # results, some of these samevm failures are not very predictable. 110 # 111 ############################################################################# 112 113 ############################################################################ 114 115 # jdk_awt 116 117 ############################################################################ 118 119 # jdk_beans 120 121 ############################################################################ 122 123 # jdk_lang 124 125 # 7123972 126 java/lang/annotation/loaderLeak/Main.java generic-all 127 128 # Times out on solaris 10 sparc 129 java/lang/ClassLoader/Assert.java generic-all 130 131 # Solaris sparc, samevm, java.lang.Exception: Read from closed pipe hangs 132 java/lang/Runtime/exec/SleepyCat.java generic-all 133 134 # Times out on solaris sparc -server 135 java/lang/ThreadLocal/MemoryLeak.java solaris-all 136 137 # Windows X64, RuntimeException: MyThread expected to have RUNNABLE but got WAITING 138 java/lang/Thread/ThreadStateTest.java generic-all 139 140 # 7148492 141 java/lang/management/MemoryMXBean/ResetPeakMemoryUsage.java generic-all 142 143 ############################################################################ 144 145 # jdk_management 146 147 # Access denied messages on windows/mks, filed 6954450 148 sun/management/jmxremote/bootstrap/RmiSslNoKeyStoreTest.sh windows-all 149 150 # Port conflict? Fails with communication error 151 sun/management/jmxremote/bootstrap/PasswordFilePermissionTest.sh generic-all 152 153 # Fails with port already in use 154 sun/management/jmxremote/bootstrap/SSLConfigFilePermissionTest.sh generic-all 155 156 # Fails with port already in use 157 sun/management/jmxremote/bootstrap/RmiRegistrySslTest.sh generic-all 158 159 # Windows run seems to have triggered a hotspot gc error (see 6801625) 160 com/sun/management/HotSpotDiagnosticMXBean/DumpHeap.sh generic-all 161 162 # Port already in use 163 sun/management/jmxremote/bootstrap/LocalManagementTest.sh generic-all 164 165 # Failed to initialize connector (also overflowing jtreg io buffers) 166 sun/management/jmxremote/bootstrap/RmiBootstrapTest.sh generic-all 167 sun/management/jmxremote/bootstrap/RmiSslBootstrapTest.sh generic-all 168 169 # Windows X64, java.lang.IllegalStateException 170 javax/management/monitor/AttributeArbitraryDataTypeTest.java generic-all 171 172 # 7149181 173 sun/management/jmxremote/startstop/JMXStartStopTest.sh generic-all 174 175 ############################################################################ 176 177 # jdk_jmx 178 179 # Failing, bug was filed: 6959636 180 javax/management/loading/LibraryLoader/LibraryLoaderTest.java generic-all 181 182 # Fails on linux: KO: StringMonitor notification missed or not emitted 183 javax/management/monitor/NonComparableAttributeValueTest.java generic-all 184 185 # Fails on Windows 2000, Test failed for iiop java.lang.NullPointerException 186 # at org.omg.stub.javax.management.remote.rmi._RMIConnectionImpl_Tie._invoke(Unknown Source) 187 # at com.sun.corba.se.impl.protocol.CorbaServerRequestDispatcherImpl.dispatchToServant(CorbaServerRequestDispatcherImpl.java:653) 188 javax/management/remote/mandatory/connection/ReconnectTest.java generic-all 189 190 # Solaris 10 sparc, NPE from org.omg.stub.javax.management.remote.rmi._RMIConnectionImpl_Tie._invoke 191 javax/management/remote/mandatory/threads/ExecutorTest.java generic-all 192 193 # Linux 32bit Fedora 9, IllegalStateException 194 javax/management/monitor/RuntimeExceptionTest.java generic-all 195 196 # Problems with rmi connection, othervm 197 javax/management/remote/mandatory/subjectDelegation/SubjectDelegation2Test.java generic-all 198 199 # Windows, connection can't last that long 200 javax/management/eventService/LeaseTest.java generic-all 201 202 # Linux othervm, X64, java.lang.Exception: Failed: ratio=102.4027795593753 203 javax/management/remote/mandatory/notif/ListenerScaleTest.java generic-all 204 205 # rmi problem? othervm, java.lang.reflect.UndeclaredThrowableException 206 javax/management/remote/mandatory/subjectDelegation/SubjectDelegation3Test.java generic-all 207 208 # Linux Fedora 9 32bit NPE in rmi server somehere??? othervm 209 javax/management/remote/mandatory/notif/NotificationBufferDeadlockTest.java generic-all 210 211 # Times out on solaris sparc, with othervm 212 javax/management/eventService/AddRemoveListenerTest.java generic-all 213 214 # Linux i586 and x64 -server, timed out waiting for threads to expire? othervm 215 javax/management/eventService/EventClientThreadTest.java generic-all 216 217 # Linux i586 -server, Expected to receive 20, but got 21, othervm 218 # Fails on Linux X64 -server 20!=21 219 javax/management/eventService/FetchingTest.java generic-all 220 221 # NPE on windows 2000 i586 -client and -server 222 javax/management/eventService/CustomForwarderTest.java windows-all 223 224 # Windows i586 failure, callback did not complete 225 javax/management/eventService/LeaseManagerDeadlockTest.java windows-all 226 227 ############################################################################ 228 229 # jdk_math 230 231 ############################################################################ 232 233 # jdk_other 234 235 # 6988950 236 demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all 237 238 # 7056489 239 com/sun/jndi/ldap/ReadTimeoutTest.java generic-all 240 241 ############################################################################ 242 243 # jdk_net 244 245 # 7122846 246 java/net/MulticastSocket/NoLoopbackPackets.java macosx-all 247 java/net/MulticastSocket/SetLoopbackMode.java macosx-all 248 249 # 7145658 250 java/net/MulticastSocket/Test.java macosx-all 251 252 #7143960 253 java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all 254 255 # 7148829 256 sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all 257 sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all 258 259 # 7161936 260 sun/net/www/http/HttpClient/RetryPost.sh macosx-all 261 sun/net/www/protocol/http/B5017051.java macosx-all 262 sun/net/www/protocol/http/B6369510.java macosx-all 263 sun/net/www/protocol/http/StreamingOutputStream.java macosx-all 264 sun/net/www/protocol/http/UserAuth.java macosx-all 265 sun/net/www/protocol/http/UserCookie.java macosx-all 266 267 # 7162118 268 java/net/CookieHandler/CookieManagerTest.java macosx-all 269 270 # 7162123 271 test/java/net/InetSocketAddress/B6469803.java macosx-all 272 273 # JPRT needs to set 127.0.0.1 in proxy bypass list 274 java/net/URLClassLoader/closetest/CloseTest.java macosx-all 275 276 ############################################################################ 277 278 # jdk_io 279 280 # 6962637 281 java/io/File/MaxPathLength.java windows-all 282 283 ############################################################################ 284 285 # jdk_nio 286 287 # 6963118 288 java/nio/channels/Selector/Wakeup.java windows-all 289 290 # 7133499, 7133497 291 java/nio/channels/AsyncCloseAndInterrupt.java macosx-all 292 java/nio/channels/AsynchronousFileChannel/Lock.java macosx-all 293 java/nio/channels/FileChannel/Transfer.java macosx-all 294 295 # 7141822 296 java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all 297 298 # 7132677 299 java/nio/channels/Selector/OutOfBand.java macosx-all 300 301 ############################################################################ 302 303 # jdk_rmi 304 305 # Port already in use, fails on sparc, othervm 306 java/rmi/reliability/benchmark/runRmiBench.sh generic-all 307 308 # Already in use port issues? othervm solaris 309 java/rmi/activation/rmidViaInheritedChannel/InheritedChannelNotServerSocket.java generic-all 310 java/rmi/activation/rmidViaInheritedChannel/RmidViaInheritedChannel.java generic-all 311 312 java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java generic-all 313 java/rmi/transport/dgcDeadLock/TestImpl_Stub.java generic-all 314 315 # Address already in use, othervm mode, solaris 316 java/rmi/activation/Activatable/elucidateNoSuchMethod/ElucidateNoSuchMethod.java generic-all 317 java/rmi/activation/Activatable/forceLogSnapshot/ForceLogSnapshot.java generic-all 318 319 # Registry already running on port, solaris 320 java/rmi/Naming/legalRegistryNames/LegalRegistryNames.java generic-all 321 322 # 7146541 323 java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all 324 325 # Times out on solaris sparc 326 java/rmi/server/RemoteServer/AddrInUse.java generic-all 327 328 # Connection error on Windows i586 -server 329 # Also connection errors in othervm on Solaris 10 sparc, same port??? 330 sun/rmi/transport/tcp/DeadCachedConnection.java generic-all 331 332 # Connection errors in othervm on Solaris 10 sparc, same port??? 333 java/rmi/activation/Activatable/checkActivateRef/CheckActivateRef.java generic-all 334 java/rmi/activation/Activatable/checkAnnotations/CheckAnnotations.java generic-all 335 java/rmi/activation/Activatable/checkImplClassLoader/CheckImplClassLoader.java generic-all 336 java/rmi/activation/Activatable/checkRegisterInLog/CheckRegisterInLog.java generic-all 337 java/rmi/activation/Activatable/createPrivateActivable/CreatePrivateActivatable.java generic-all 338 java/rmi/activation/Activatable/downloadParameterClass/DownloadParameterClass.java generic-all 339 java/rmi/activation/Activatable/extLoadedImpl/ext.sh generic-all 340 java/rmi/activation/Activatable/inactiveGroup/InactiveGroup.java generic-all 341 java/rmi/activation/Activatable/lookupActivationSystem/LookupActivationSystem.java generic-all 342 java/rmi/activation/Activatable/nestedActivate/NestedActivate.java generic-all 343 java/rmi/activation/Activatable/restartCrashedService/RestartCrashedService.java generic-all 344 java/rmi/activation/Activatable/restartLatecomer/RestartLatecomer.java generic-all 345 java/rmi/activation/Activatable/shutdownGracefully/ShutdownGracefully.java generic-all 346 java/rmi/activation/Activatable/unregisterInactive/UnregisterInactive.java generic-all 347 java/rmi/activation/ActivateFailedException/activateFails/ActivateFails.java generic-all 348 java/rmi/activation/ActivationGroup/downloadActivationGroup/DownloadActivationGroup.java generic-all 349 java/rmi/activation/ActivationSystem/activeGroup/IdempotentActiveGroup.java generic-all 350 java/rmi/reliability/juicer/AppleUserImpl.java generic-all 351 java/rmi/server/RMISocketFactory/useSocketFactory/unicast/UseCustomSocketFactory.java generic-all 352 java/rmi/server/UnicastRemoteObject/keepAliveDuringCall/KeepAliveDuringCall.java generic-all 353 java/rmi/transport/handshakeTimeout/HandshakeTimeout.java generic-all 354 java/rmi/activation/Activatable/restartService/RestartService.java generic-all 355 java/rmi/activation/ActivationSystem/modifyDescriptor/ModifyDescriptor.java generic-all 356 java/rmi/activation/ActivationSystem/stubClassesPermitted/StubClassesPermitted.java generic-all 357 java/rmi/activation/ActivationSystem/unregisterGroup/UnregisterGroup.java generic-all 358 java/rmi/activation/CommandEnvironment/SetChildEnv.java generic-all 359 java/rmi/registry/classPathCodebase/ClassPathCodebase.java generic-all 360 java/rmi/registry/reexport/Reexport.java generic-all 361 java/rmi/server/Unreferenced/leaseCheckInterval/LeaseCheckInterval.java generic-all 362 java/rmi/server/Unreferenced/unreferencedContext/UnreferencedContext.java generic-all 363 java/rmi/server/useCustomRef/UseCustomRef.java generic-all 364 java/rmi/transport/checkFQDN/CheckFQDN.java generic-all 365 java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all 366 java/rmi/server/RMISocketFactory/useSocketFactory/activatable/UseCustomSocketFactory.java generic-all 367 java/rmi/server/RMISocketFactory/useSocketFactory/registry/UseCustomSocketFactory.java generic-all 368 java/rmi/server/UnicastRemoteObject/unexportObject/UnexportLeak.java generic-all 369 370 # 7142596 371 java/rmi/transport/httpSocket/HttpSocketTest.java macosx-all 372 373 ############################################################################ 374 375 # jdk_security 376 377 # Failing on Solaris i586, 3/9/2010, not a -samevm issue (jdk_security3) 378 sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-i586 379 sun/security/pkcs11/ec/ReadCertificates.java solaris-i586 380 sun/security/pkcs11/ec/ReadPKCS12.java solaris-i586 381 sun/security/pkcs11/ec/TestCurves.java solaris-i586 382 sun/security/pkcs11/ec/TestECDSA.java solaris-i586 383 #sun/security/pkcs11/ec/TestECGenSpec.java solaris-i586 384 #sun/security/pkcs11/ec/TestKeyFactory.java solaris-i586 385 sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java generic-all 386 387 # Directly references PKCS11 class 388 sun/security/pkcs11/Provider/Absolute.java windows-x64 389 390 # Fails on Fedora 9/Ubuntu 10.04 64bit, PKCS11Exception: CKR_DEVICE_ERROR 391 sun/security/pkcs11/KeyAgreement/TestDH.java generic-all 392 393 # Run too slow on Solaris 10 sparc 394 sun/security/ssl/com/sun/net/ssl/internal/ssl/InputRecord/SSLSocketTimeoutNulls.java solaris-sparc 395 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ClientTimeout.java solaris-sparc 396 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ServerTimeout.java solaris-sparc 397 sun/security/ssl/sun/net/www/protocol/https/HttpsURLConnection/ReadTimeout.java solaris-sparc 398 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/NotifyHandshakeTest.sh solaris-sparc 399 400 # Solaris 10 sparc, passed/failed confusion? java.security.ProviderException: update() failed 401 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/AsyncSSLSocketClose.java generic-all 402 403 # Timed out, Solaris 10 64bit sparcv9 404 com/sun/crypto/provider/Cipher/DES/PaddingTest.java generic-all 405 406 # Othervm, sparc, NoRouteToHostException: Cannot assign requested address 407 sun/security/ssl/javax/net/ssl/NewAPIs/SessionCacheSizeTests.java generic-all 408 409 # Times out on windows X64, othervm mode 410 # Solaris sparc and sparcv9 -server, timeout 411 sun/security/ssl/javax/net/ssl/NewAPIs/SessionTimeOutTests.java generic-all 412 413 # Various failures on Linux Fedora 9 X64, othervm mode 414 sun/security/ssl/javax/net/ssl/NewAPIs/SSLEngine/TestAllSuites.java generic-all 415 sun/security/ssl/sanity/ciphersuites/CheckCipherSuites.java generic-all 416 417 # Various failures on Linux Fedora 9 X64, othervm mode 418 sun/security/ssl/sanity/interop/ClientJSSEServerJSSE.java generic-all 419 420 # Solaris 11 i586, these all fail with samevm, need to be othervm??? 421 java/security/SecureClassLoader/DefineClassByteBuffer.java generic-all 422 423 # Timeout on solaris-sparc and i586 and x64, -client and -server 424 sun/security/ssl/com/sun/net/ssl/internal/ssl/InputRecord/InterruptedIO.java solaris-all 425 426 # 7147060 427 com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all 428 429 ############################################################################ 430 431 # jdk_swing 432 433 ############################################################################ 434 435 # jdk_text 436 437 # Linux x64 occasional errors, no details 438 java/text/Bidi/Bug6665028.java linux-x64 439 440 ############################################################################ 441 442 # jdk_tools 443 444 # 6461635 445 com/sun/tools/attach/BasicTests.sh generic-all 446 447 # Filed 6986875 448 sun/tools/jps/jps-Vvml.sh generic-all 449 450 # Filed 6979016 451 sun/tools/jconsole/ResourceCheckTest.sh generic-all 452 453 # 7132203 454 sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all 455 456 # 8001118 457 sun/tools/jcmd/jcmd-f.sh generic-all 458 sun/tools/jcmd/jcmd-help-help.sh generic-all 459 460 # 7175775 461 sun/tools/jinfo/Basic.sh macosx-all 462 463 ############################################################################ 464 465 # jdk_jdi 466 467 # Filed 6952105 468 com/sun/jdi/SuspendThreadTest.java generic-all 469 470 # Filed 6987312 471 com/sun/jdi/DoubleAgentTest.java generic-all 472 473 ############################################################################ 474 475 # jdk_util 476 477 # Need 7094995 back-ported from jdk8 478 java/util/zip/ZipFile/ClearStaleZipFileInputStreams.java macosx-all 479 480 # Filed 7027061 481 java/util/Locale/Bug6989440.java windows-all 482 483 # Filed 6933803 484 java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all 485 486 # Filed 7022325 487 # Fails with assertion error on windows 488 # 11 separate stacktraces created... file reuse problem? 489 java/util/zip/ZipFile/ReadLongZipFileName.java generic-all 490 491 # Assert error, failures, on Linux Fedora 9 -server 492 # Windows samevm failure, assert error "Passed = 134, failed = 2" 493 java/util/Arrays/ArrayObjectMethods.java generic-all 494 495 # Windows 2000, -client, samevm, java.lang.Error: Completed != 2 496 java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all 497 498 # Windows X64, Executor Stuck samevm mode: 499 java/util/concurrent/FutureTask/BlockingTaskExecutor.java generic-all 500 501 # Problems on windows, jmap.exe hangs? (these run jmap), fails on Solaris 10 x86 502 java/util/concurrent/locks/Lock/TimedAcquireLeak.java generic-all 503 504 # 7041639, Solaris DSA keypair generation bug 505 java/util/TimeZone/TimeZoneDatePermissionCheck.sh solaris-all 506 507 ############################################################################ 508 509