jdk/test/ProblemList.txt
author dmocek
Tue, 17 Jul 2012 11:01:44 -0700
changeset 13256 5886d7607acd
parent 13244 9f2c7c24a952
child 13358 6979b034476d
permissions -rw-r--r--
7142596: RMI JPRT tests are failing Summary: Changed RMI tests to use random port numbers for the RMI Registry and RMID so the tests can be run concurrently without test failures due to tests using the same port numbers. Reviewed-by: smarks, alanb Contributed-by: olivier.lagneau@oracle.com

###########################################################################
#
# Copyright (c) 2009, 2012, Oracle and/or its affiliates. All rights reserved.
# DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
#
# This code is free software; you can redistribute it and/or modify it
# under the terms of the GNU General Public License version 2 only, as
# published by the Free Software Foundation.  Oracle designates this
# particular file as subject to the "Classpath" exception as provided
# by Oracle in the LICENSE file that accompanied this code.
#
# This code is distributed in the hope that it will be useful, but WITHOUT
# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
# FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License
# version 2 for more details (a copy is included in the LICENSE file that
# accompanied this code).
#
# You should have received a copy of the GNU General Public License version
# 2 along with this work; if not, write to the Free Software Foundation,
# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
#
# Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
# or visit www.oracle.com if you need additional information or have any
# questions.
#
###########################################################################
#
# List of tests that should not be run by test/Makefile, for various reasons:
#   1. Does not run with jtreg -samevm mode
#   2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
#   3. The test is too slow or consumes too many system resources
#   4. The test fails when run on any official build systems
#
# It is possible that a test being on this list is a mistake, and that some
#   other test in samevm mode caused tests to fail, mistakes happen.
#
# Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
#
# Tests that explicitly state "@run main/othervm ...", and are not listed here,
#   will be run in the same batch as the samevm tests.
#
# Shell tests are othervm by default.
#
# List items  are testnames followed by labels, all MUST BE commented
#   as to why they are here and use a label:
#     generic-all       Problems on all platforms
#     generic-ARCH      Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
#     OSNAME-all        Where OSNAME is one of: solaris, linux, windows
#     OSNAME-ARCH       Specific on to one OSNAME and ARCH, e.g. solaris-x64
#     OSNAME-REV        Specific on to one OSNAME and REV, e.g. solaris-5.8
#
# More than one label is allowed but must be on the same line.
#
#############################################################################
#
# Running the tests:
#    cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
#  Or instead of jdk_all, use any of the jdk_* targets.
#
# Samevm Notes:
#  * Although some tests may have only been seen to fail on some platforms,
#    they might be flagged as 'generic-all' because the problem they have
#    could cause hidden slowdowns on other platforms.
#    Most samevm problems will be generic-all, but windows usually dislikes
#    them the most.
#    Address already in use or connection errors indicate a generic port issue.
#    (this is not necessarily a samevm issue, but an issue for running the tests
#     on shared machines, two people or two test runs will collide).
#  * Samevm problem (windows in particular) is not closing all input/output
#  * Samevm problem when a test calls setSecurityManager()
#  * Samevm problem with setHttps*() is used? (not exactly sure here)
#  * Samevm problem when stuffing system properties with non Strings or anything
#  * Samevm problem when changing vm settings, or registering any vm actions
#  * Samevm problems with deleteOnExit(), if it must happen at end of test
#  * Samevm problems with URLClassLoader? (no details here)
#  * Samevm problems with dependence on predictable GC or finalizations
#
# Any of the above problems may mean the test needs to be flagged as "othervm".
#
#############################################################################
#
# Fixing the tests:
#
# Some tests just may need to be run with "othervm", and that can easily be
#   done my adding a @run line (or modifying any existing @run):
#      @run main/othervm NameOfMainClass
#   Make sure this @run follows any use of @library.
#   Otherwise, if the test is a samevm possibility, make sure the test is
#     cleaning up after itself, closing all streams, deleting temp files, etc.
#
# Keep in mind that the bug could be in many places, and even different per
#   platform, it could be a bug in any one of:
#      - the testcase
#      - the jdk (jdk classes, native code, or hotspot)
#      - the native compiler
#      - the javac compiler
#      - the OS (depends on what the testcase does)
#
# If you managed to really fix one of these tests, here is how you can
#    remove tests from this list:
#  1. Make sure test passes on all platforms with samevm, or mark it othervm
#  2. Make sure test passes on all platforms when run with it's entire group
#  3. Make sure both VMs are tested, -server and -client, if possible
#  4. Make sure you try the -d64 option on Solaris
#  5. Use a tool like JPRT or something to verify these results
#  6. Delete lines in this file, include the changes with your test changes
#
# You may need to repeat your testing 2 or even 3 times to verify good
#   results, some of these samevm failures are not very predictable.
#
#############################################################################

############################################################################

# jdk_awt

############################################################################

# jdk_beans

############################################################################

# jdk_lang

# 6944188
java/lang/management/ThreadMXBean/ThreadStateTest.java          generic-all

# 7067973
java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all

# 7148492
java/lang/management/MemoryMXBean/ResetPeakMemoryUsage.java	generic-all

############################################################################

# jdk_management

# 6959636
javax/management/loading/LibraryLoader/LibraryLoaderTest.java	windows-all

# 7144846
javax/management/remote/mandatory/connection/ReconnectTest.java	generic-all

# 7149181 
sun/management/jmxremote/startstop/JMXStartStopTest.sh          generic-all

############################################################################

# jdk_math

# 7174532
java/lang/Math/WorstCaseTests.java				generic-all

############################################################################

# jdk_misc

# 6988950
demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java	generic-all

# 7162111
demo/jvmti/mtrace/TraceJFrame.java                              macosx-all
javax/script/CauseExceptionTest.java                            macosx-all
javax/script/GetInterfaceTest.java                              macosx-all
javax/script/JavaScriptScopeTest.java                           macosx-all
javax/script/NullUndefinedVarTest.java                          macosx-all
javax/script/PluggableContextTest.java                          macosx-all
javax/script/ProviderTest.sh                                    macosx-all
javax/script/RhinoExceptionTest.java                            macosx-all
javax/script/StringWriterPrintTest.java                         macosx-all
javax/script/Test1.java                                         macosx-all
javax/script/Test2.java                                         macosx-all
javax/script/Test3.java                                         macosx-all
javax/script/Test4.java                                         macosx-all
javax/script/Test5.java                                         macosx-all
javax/script/Test6.java                                         macosx-all
javax/script/Test7.java                                         macosx-all
javax/script/Test8.java                                         macosx-all
javax/script/UnescapedBracketRegExTest.java                     macosx-all
javax/script/VersionTest.java                                   macosx-all
############################################################################

# jdk_net

# Filed 7052625
com/sun/net/httpserver/bugs/6725892/Test.java                   generic-all

# Filed 7036666
com/sun/net/httpserver/Test9a.java                              generic-all

# 7079145 java/net/ipv6tests/UdpTest.java hang at IPv6 only data exchange
java/net/ipv6tests/UdpTest.java                                 linux-all

# 7081476
java/net/InetSocketAddress/B6469803.java                        generic-all

# 7102670
java/net/InetAddress/CheckJNI.java                              linux-all

# failing on vista 32/64 on nightly
# 7102702
java/net/PortUnreachableException/OneExceptionOnly.java         windows-all

# 7148829
sun/net/InetAddress/nameservice/simple/CacheTest.java		generic-all
sun/net/InetAddress/nameservice/simple/DefaultCaching.java	generic-all

# 7122846
java/net/MulticastSocket/NoLoopbackPackets.java                  macosx-all
java/net/MulticastSocket/SetLoopbackMode.java                    macosx-all

# 7145658
java/net/MulticastSocket/Test.java                               macosx-all

#7143960
java/net/DatagramSocket/SendDatagramToBadAddress.java            macosx-all

# 7150552
sun/net/www/protocol/http/B6299712.java                         macosx-all
java/net/CookieHandler/CookieManagerTest.java                   macosx-all

# 7164518
sun/security/krb5/auto/Unreachable.java                         macosx-all

# JPRT needs to set 127.0.0.1 in proxy bypass list
java/net/URLClassLoader/closetest/CloseTest.java                macosx-all
############################################################################

# jdk_io

# 6962637
java/io/File/MaxPathLength.java                                 windows-all

# 7076644
java/io/File/Basic.java                                         windows-all

# 7145435 - Test needs AWT window server, does not work headless
java/io/Serializable/resolveClass/deserializeButton/run.sh      macosx-all

############################################################################

# jdk_nio

# 6963118
java/nio/channels/Selector/Wakeup.java                          windows-all

# 7052549
java/nio/channels/FileChannel/ReleaseOnCloseDeadlock.java 	windows-all

# 7133499, 7133497
java/nio/channels/AsyncCloseAndInterrupt.java                   macosx-all
java/nio/channels/AsynchronousFileChannel/Lock.java             macosx-all
java/nio/channels/FileChannel/Transfer.java                     macosx-all

# 7141822
java/nio/channels/DatagramChannel/ChangingAddress.java          macosx-all

# 7132677
java/nio/channels/Selector/OutOfBand.java                       macosx-all

############################################################################

# jdk_rmi

# 7146541
java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java	linux-all

# 7132247
java/rmi/registry/readTest/readTest.sh				windows-all
############################################################################

# jdk_security

# 7177556
com/sun/crypto/provider/KeyFactory/TestProviderLeak.java        generic-all

# 7147060
com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java	generic-all

# Failing on Solaris i586, 3/9/2010, not a -samevm issue (jdk_security3)
sun/security/pkcs11/Secmod/AddPrivateKey.java                   solaris-i586
sun/security/pkcs11/ec/ReadCertificates.java                    generic-all
sun/security/pkcs11/ec/ReadPKCS12.java                          generic-all
sun/security/pkcs11/ec/TestCurves.java                          solaris-i586
sun/security/pkcs11/ec/TestECDSA.java                           solaris-i586
#sun/security/pkcs11/ec/TestECGenSpec.java                      solaris-i586
#sun/security/pkcs11/ec/TestKeyFactory.java                     solaris-i586
sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java            generic-all

# Fails on Fedora 9/Ubuntu 10.04 64bit, PKCS11Exception: CKR_DEVICE_ERROR
sun/security/pkcs11/KeyAgreement/TestDH.java                    generic-all

# Run too slow on Solaris 10 sparc
sun/security/ssl/com/sun/net/ssl/internal/ssl/InputRecord/SSLSocketTimeoutNulls.java solaris-sparc
sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ClientTimeout.java solaris-sparc
sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ServerTimeout.java solaris-sparc
sun/security/ssl/sun/net/www/protocol/https/HttpsURLConnection/ReadTimeout.java solaris-sparc
sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/NotifyHandshakeTest.sh solaris-sparc

# Solaris 10 sparc, passed/failed confusion? java.security.ProviderException: update() failed
sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/AsyncSSLSocketClose.java generic-all

# Othervm, sparc, NoRouteToHostException: Cannot assign requested address
sun/security/ssl/javax/net/ssl/NewAPIs/SessionCacheSizeTests.java generic-all

# Times out on windows X64, othervm mode
#    Solaris sparc and sparcv9 -server, timeout
sun/security/ssl/javax/net/ssl/NewAPIs/SessionTimeOutTests.java generic-all

# Various failures on Linux Fedora 9 X64, othervm mode
sun/security/ssl/javax/net/ssl/NewAPIs/SSLEngine/TestAllSuites.java generic-all
sun/security/ssl/sanity/ciphersuites/CheckCipherSuites.java     generic-all

# Various failures on Linux Fedora 9 X64, othervm mode
sun/security/ssl/sanity/interop/ClientJSSEServerJSSE.java       generic-all

# 7079203 sun/security/tools/keytool/printssl.sh fails on solaris with timeout
sun/security/tools/keytool/printssl.sh                          solaris-all

# 7041639, Solaris DSA keypair generation bug (Note: jdk_util also affected)
java/security/KeyPairGenerator/SolarisShortDSA.java             solaris-all
sun/security/tools/jarsigner/onlymanifest.sh                    solaris-all
sun/security/tools/jarsigner/ts.sh                              solaris-all
sun/security/tools/keytool/emptysubject.sh                      solaris-all
sun/security/tools/keytool/importreadall.sh                     solaris-all
sun/security/tools/keytool/readjar.sh                           solaris-all
sun/security/tools/keytool/selfissued.sh                        solaris-all
sun/security/tools/keytool/standard.sh                          solaris-all

############################################################################

# jdk_sound

############################################################################

# jdk_swing

############################################################################

# jdk_text

############################################################################

# jdk_tools

# 6461635
com/sun/tools/attach/BasicTests.sh                              generic-all

# Filed 6952105
com/sun/jdi/SuspendThreadTest.java                              generic-all

# Filed 6653793
com/sun/jdi/RedefineCrossEvent.java                             generic-all

# Filed 6987312
com/sun/jdi/DoubleAgentTest.java                                generic-all

# Filed 7020857
com/sun/jdi/FieldWatchpoints.java                               generic-all

# Filed 6402201
com/sun/jdi/ProcessAttachTest.sh                                generic-all

# Filed 6979016
sun/tools/jconsole/ResourceCheckTest.sh                         generic-all

# 7172176
sun/tools/jconsole/ImmutableResourceTest.sh			generic-all

# 7132203
sun/jvmstat/monitor/MonitoredVm/CR6672135.java			generic-all

# Tests take too long, see 7143279
tools/pack200/CommandLineTests.java                         	generic-all
tools/pack200/Pack200Test.java                              	generic-all

# 7150569
tools/launcher/UnicodeTest.java                                 macosx-all

############################################################################

# jdk_util

# Filed 6933803
java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java  generic-all

# Filed 6772009
java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all

# 7041639, Solaris DSA keypair generation bug
java/util/TimeZone/TimeZoneDatePermissionCheck.sh               solaris-all

# 7150557
java/util/prefs/RemoveReadOnlyNode.java                         macosx-all
java/util/prefs/RemoveUnregedListener.java                      macosx-all

############################################################################