Protect yourself against future threats.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
===========================================================================
AUSCERT External Security Bulletin Redistribution
ESB-2009.0213 -- [Solaris]
Kernel Patches/Changes may Stop Sun Cluster Node From Joining the Cluster
9 March 2009
===========================================================================
AusCERT Security Bulletin Summary
---------------------------------
Product: Sun Cluster 3.1 and 3.2
Cluster Express for OpenSolaris
Publisher: Sun Microsystems
Operating System: Solaris 10
OpenSolaris
Impact: Denial of Service
Access: Existing Account
Ref: ESB-2008.1142
Original Bulletin:
http://sunsolve.sun.com/search/printfriendly.do?assetkey=1-66-253948-1
- --------------------------BEGIN INCLUDED TEXT--------------------
Solution Type: Sun Alert
Solution 253948 : Kernel Patches/Changes may Stop Sun Cluster Nodes
From Joining the Cluster
Bug ID: 6797256
Product
Solaris 10 Operating System
OpenSolaris
Date of Workaround Release: 05-Mar-2009
SA Document Body
Kernel patches/changes may stop Sun Cluster nodes from joining the cluster:
1. Impact
Cluster nodes which have installed the change for Bug ID 6434130 via
Solaris 10 kernel patches or builds snv_50 or later of OpenSolaris,
may not be able to join/rejoin the cluster if those nodes use GLDv3
interface network drivers for the cluster private interconnect.
2. Contributing Factors
This issue can occur in the following releases:
SPARC Platform
* Sun Cluster 3.1 and 3.2 (for Solaris 10) with patch 138888-01
or later
* Cluster Express for OpenSolaris based upon builds snv_50 or later
x86 Platform
* Sun Cluster 3.1 and 3.2 (for Solaris 10) with patch 138889-01
or later
* Cluster Express for OpenSolaris based upon builds snv_50 or later
Note 1: OpenSolaris distributions may include additional bug fixes
above and beyond the build from which it was derived. To determine
the base build of OpenSolaris, the following command can be used:
$ uname -v
snv_86
Note 2: Sun Cluster on Solaris 8 and Solaris 9 are not impacted by
this issue. Sun Cluster 3.0 is not impacted by this issue as Sun
Cluster 3.0 does not explicitly tag network packets with a priority.
Note 3: This issue only occurs if both the following are true:
1. The cluster nodes use GLDv3 network interfaces for their private
interfaces that have not been configured to use VLAN tagging.
These are interfaces "e1000g", "nxge", "bge" and "ixgb". Systems which
use "ce", "ge", "hme", "qfe"," ipge" or "ixge" network interfaces or
use back-to-back connections for their private interconnect, are not
impacted by this issue.
2. The network switches have not been configured to use vlan and
priority tagging To determine if GLDv3 network interfaces are being
used for the private interconnect, execute the following command:
# /usr/sbin/dladm show-link
e1000g0 type: non-vlan mtu: 1500 device: e1000g0
e1000g1 type: non-vlan mtu: 1500 device: e1000g1
e1000g2 type: non-vlan mtu: 1500 device: e1000g2
e1000g3 type: non-vlan mtu: 1500 device: e1000g3
# /usr/sbin/dladm show-link
ce0 type: legacy mtu: 1500 device: ce0
ce1 type: legacy mtu: 1500 device: ce1
Note: "legacy" means this is a non-GLDv3 device and is not affected.
To determine if the switches have been configured to use vlan and
priority tagging, please refer to your switch documentation.
3. Symptoms
If the described issue occurs, messages similar to the following will
be seen on the node upon bootup after installing the kernel patch:
Jan 12 18:17:18 LUCAIPU552 cl_runtime: [ID 843983 kern.notice] NOTICE: CMM:
Node LUCAIPU552: attempting to join cluster.
Jan 12 18:18:18 LUCAIPU552 cl_runtime: [ID 980942 kern.notice] NOTICE: CMM:
Cluster doesn't have operational quorum yet; waiting for quorum.
Jan 12 18:18:18 LUCAIPU552 cl_runtime: [ID 604153 kern.notice] NOTICE:
clcomm: Path LUCAIPU552:nxge3 - LUCAIPU553:nxge3 errors during initiation
Jan 12 18:18:18 LUCAIPU552 cl_runtime: [ID 618107 kern.warning] WARNING:
Path LUCAIPU552:nxge3 - LUCAIPU553:nxge3 initiation encountered errors, errno = 62.
Remote node may be down or unreachable through this path.
4. Workaround
To workaround this issue, follow these steps:
1. Configure VLAN tagging on the Sun interface and on the switch. This
makes VLAN tagged packets expected and prevents drops.
For example configure e1000g like this(sample "/usr/sbin/ifconfig -a"
output):
e1000g810000: flags=201008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4,CoS> mtu 1500 index 16
inet 172.18.0.130 netmask ffffff80 broadcast 172.18.0.255
2. Use an Ethernet switch that can handle IEEE 802.1Q Priority
Tagging. Check that ingress Priority Tagging is enabled on the switch
used for the cluster private interconnect. Please refer to the switch
documentation.
Note: It is not advisable to remove the affected kernel patches as
these deliver a number of security fixes.
5. Resolution
A final resolution is pending completion.
This Sun Alert notification is being provided to you on an "AS IS"
basis. This Sun Alert notification may contain information provided by
third parties. The issues described in this Sun Alert notification may
or may not impact your system(s). Sun makes no representations,
warranties, or guarantees as to the information contained herein. ANY
AND ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR
NON-INFRINGEMENT, ARE HEREBY DISCLAIMED. BY ACCESSING THIS DOCUMENT
YOU ACKNOWLEDGE THAT SUN SHALL IN NO EVENT BE LIABLE FOR ANY DIRECT,
INDIRECT, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES THAT ARISE
OUT OF YOUR USE OR FAILURE TO USE THE INFORMATION CONTAINED HEREIN.
This Sun Alert notification contains Sun proprietary and confidential
information. It is being provided to you pursuant to the provisions of
your agreement to purchase services from Sun, or, if you do not have
such an agreement, the Sun.com Terms of Use. This Sun Alert
notification may only be used for the purposes contemplated by these
agreements.
Copyright 2000-2009 Sun Microsystems, Inc., 4150 Network Circle, Santa
Clara, CA 95054 U.S.A. All rights reserved
- --------------------------END INCLUDED TEXT--------------------
You have received this e-mail bulletin as a result of your organisation's
registration with AusCERT. The mailing list you are subscribed to is
maintained within your organisation, so if you do not wish to continue
receiving these bulletins you should contact your local IT manager. If
you do not know who that is, please send an email to auscert@auscert.org.au
and we will forward your request to the appropriate person.
NOTE: Third Party Rights
This security bulletin is provided as a service to AusCERT's members. As
AusCERT did not write the document quoted above, AusCERT has had no control
over its content. The decision to follow or act on information or advice
contained in this security bulletin is the responsibility of each user or
organisation, and should be considered in accordance with your organisation's
site policies and procedures. AusCERT takes no responsibility for consequences
which may arise from following or acting on information or advice contained in
this security bulletin.
NOTE: This is only the original release of the security bulletin. It may
not be updated when updates to the original are made. If downloading at
a later date, it is recommended that the bulletin is retrieved directly
from the author's website to ensure that the information is still current.
Contact information for the authors of the original document is included
in the Security Bulletin above. If you have any questions or need further
information, please contact them directly.
Previous advisories and external security bulletins can be retrieved from:
http://www.auscert.org.au/render.html?cid=1980
If you believe that your computer system has been compromised or attacked in
any way, we encourage you to let us know by completing the secure National IT
Incident Reporting Form at:
http://www.auscert.org.au/render.html?it=3192
===========================================================================
Australian Computer Emergency Response Team
The University of Queensland
Brisbane
Qld 4072
Internet Email: auscert@auscert.org.au
Facsimile: (07) 3365 7031
Telephone: (07) 3365 4417 (International: +61 7 3365 4417)
AusCERT personnel answer during Queensland business hours
which are GMT+10:00 (AEST).
On call after hours for member emergencies only.
===========================================================================
-----BEGIN PGP SIGNATURE-----
Comment: http://www.auscert.org.au/render.html?it=1967
iD8DBQFJtKAPNVH5XJJInbgRAocSAJ9UWrEUbYQZm0j8yUTRHlQuItZzfACfaHKp
miCxlhuFSE9ulnC61TolyOs=
=0aXi
-----END PGP SIGNATURE-----