Questions & Answers
|
QA-65
|
ubGuard 4.0.0-4.0.1 Prerelease Commands
|
ubTools - ubGuard
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
19/Jan/22 08:11 PM
|
19/Jan/22 10:09 PM
|
|
|
0
|
|
|
|
This document explains ubGuard 4.0.0-4.0.1 prerelease commands.
|
Questions & Answers
|
QA-64
|
ubGuard 4.0.0-1.0.0 Prerelease Commands
|
ubTools - ubGuard
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
19/Mar/19 01:42 PM
|
19/Jan/22 10:09 PM
|
|
|
0
|
|
|
|
This document explains ubGuard 4.0.0-1.0.0 prerelease commands.
|
Questions & Answers
|
QA-63
|
ORA-600 [3020] on the standby after adding a datafile on primary
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
16/Feb/18 10:31 AM
|
16/Feb/18 12:47 PM
|
|
|
0
|
|
|
|
'*Problem:*
The customer has added a datafile on the primary database. After the datafile was created on the standby database, ORA-600 [3020] was encountered while applying an archivelog to this datafile on standby.
*ORA-600 [3020]:*
{noformat}
This is called a 'STUCK RECOVERY'.
There is an inconsistency between the information stored in the redo
and the information stored in a database block being recovered.
{noformat}
_Ref: Doc ID 30866.1_
|
Questions & Answers
|
QA-62
|
ubGuard 3.0.0 Commands
|
ubTools - ubGuard
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
26/Dec/17 01:52 PM
|
26/Dec/17 02:31 PM
|
|
|
0
|
|
|
|
This document explains ubGuard 3.0.0 commands.
|
Questions & Answers
|
QA-60
|
"PRVF-5507 : NTP daemon or service is not running on any node ..." even if NTP is running.
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
05/Mar/16 03:12 PM
|
05/Mar/16 03:27 PM
|
|
|
0
|
|
|
|
CVU gives the following error:
{noformat}
$./runcluvfy.sh stage -pre crsinst -n sygnx01,sygnx02 -verbose
.....
No NTP Daemons or Services were found to be running
PRVF-5507 : NTP daemon or service is not running on any node but NTP configuration file exists on the following node(s):
sygnx02,sygnx01
Result: Clock synchronization check using Network Time Protocol(NTP) failed
{noformat}
|
Questions & Answers
|
QA-59
|
Unable to use the full CPU speed when CPUfreq Governor is ondemand.
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
29/Sep/15 12:15 PM
|
02/Oct/15 01:45 PM
|
|
|
0
|
13744_AWR.png
13743_EMTopActivity.png
|
|
|
The customer is unable use the full CPU speed. The CPUfreq Governor is OnDemand.
|
Questions & Answers
|
QA-57
|
ORA-04030 returned by "__libc_sbrk(0x0000000001010020) Err#12 ENOMEM"
|
Oracle - Operating System
|
Closed
|
Major
|
Third-party Problem
|
ubTools Support
|
ubTools Support
|
02/Dec/13 02:21 PM
|
28/Feb/17 09:01 AM
|
|
|
0
|
|
|
|
The customer encountered the following problem:
{noformat}
ORA-04030: out of process memory when trying to allocate 2093096 bytes (QERHJ hash-joi,QERHJ list array)
{noformat}
|
Questions & Answers
|
QA-55
|
deinstall tool drops database
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
26/Mar/13 03:49 PM
|
26/Mar/13 03:52 PM
|
|
|
0
|
|
|
|
_Oracle® Database Upgrade Guide 11g Release 2 (11.2) Part Number E23633-07_ writes:
{noformat}
Known Issue with the Deinstallation Tool for This Release
Cause: After upgrading from 11.2.0.1 or 11.2.0.2 to 11.2.0.3, deinstallation of the Oracle home in the earlier release of Oracle Database
may result in the deletion of the old Oracle base that was associated with it. This may also result in the deletion of data files, audit files, etc.,
which are stored under the old Oracle base.
Action: Before deinstalling the Oracle home in the earlier release, edit the orabase_cleanup.lst file found in the $Oracle_Home/utl directory and
remove the "oradata" and "admin" entries. Then, deinstall the Oracle home using the 11.2.0.3 deinstallation tool.
{noformat}
_Ref: http://docs.oracle.com/cd/E11882_01/server.112/e23633/intro.htm#BHCEECDJ
In our case:
- There were already no oradata and admin entries in $ORACLE_HOME/utl/orabase_cleanup.lst.
- There was already no database file in $ORACLE_BASE/oradata. There was just a soft link to ASM disk, which includes the database.
But, _deinstall_ tool dropped the database.
|
Questions & Answers
|
QA-54
|
Unable to close database by srvctl and racgimon takes 100% of CPU.
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
26/Mar/13 02:47 PM
|
26/Mar/13 03:22 PM
|
|
|
0
|
|
|
|
Unable to close the database:
{noformat}
$ srvctl stop database -d ESIBASE
PRKP-1002 : Error stopping instance ESIBASE1 on node ersteracsrv1
CRS-0216: Could not stop resource 'ora.ESIBASE.ESIBASE1.inst'.
$
{noformat}
2 _racgimon_ processes take 100% of CPU in _prstat_ output:
{noformat}
PID USERNAME USR SYS TRP TFL DFL LCK SLP LAT VCX ICX SCL SIG PROCESS/NLWP
8286 oracle 64 36 0.0 0.0 0.0 0.0 0.0 0.0 0 37 .15 0 racgimon/1
7903 oracle 65 35 0.0 0.0 0.0 0.0 0.0 0.0 0 35 .15 0 racgimon/1
10015 root 0.0 0.8 0.0 0.0 0.0 0.0 99 0.0 21 1 398 0 prstat/1
7818 oracle 0.2 0.0 0.0 0.0 0.0 0.0 100 0.0 62 1 7K 0 oracle/2
10055 root 0.0 0.1 0.0 0.0 0.0 0.0 100 0.0 7 0 318 0 sleep/1
816 root 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 30 1 275 0 init.cssd/1
1916 oracle 0.1 0.0 0.0 0.0 0.0 0.0 100 0.0 60 0 719 59 oracle/1
1878 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 170 0 694 1 oracle/1
1874 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 170 0 691 1 oracle/1
1872 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 81 0 401 31 oracle/1
1621 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 53 0 343 1 oracle/1
1894 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 21 0 54 0 oracle/2
1625 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 64 0 201 1 oracle/1
1623 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 64 0 201 1 oracle/1
1870 oracle 0.0 0.0 0.0 0.0 0.0 0.0 100 0.0 59 0 347 1 oracle/2
NPROC USERNAME SWAP RSS MEMORY TIME CPU
72 oracle 21G 21G 57% 0:07:37 26%
54 root 117M 180M 0.5% 0:00:06 0.2%
1 noaccess 136M 207M 0.6% 0:00:12 0.0%
6 daemon 6408K 7496K 0.0% 0:00:00 0.0%
1 smmsp 1136K 7244K 0.0% 0:00:00 0.0%
Total: 134 processes, 439 lwps, load averages: 2.26, 1.82, 1.13
#
{noformat}
|
Questions & Answers
|
QA-53
|
Starting Listener Hangs with "TNS-12531: TNS:cannot allocate memory" in Listener Log
|
Oracle - SQL*Net
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
02/Jul/12 01:52 PM
|
12/Jul/12 04:01 PM
|
|
|
0
|
|
|
|
Starting the LISTENER hangs. The following errors appear as an infinite loop in the listener.log:
{noformat}
02-JUL-2012 15:54:06 * 12531
TNS-12531: TNS:cannot allocate memory
02-JUL-2012 15:54:06 * 12531
TNS-12531: TNS:cannot allocate memory
02-JUL-2012 15:54:06 * 12531
TNS-12531: TNS:cannot allocate memory
02-JUL-2012 15:54:06 * 12531
TNS-12531: TNS:cannot allocate memory
02-JUL-2012 15:54:06 * 12531
TNS-12531: TNS:cannot allocate memory
{noformat}
|
Questions & Answers
|
QA-52
|
"Transaction recovery: lock conflict caught and ignored" messages in ALERT LOG.
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
30/Dec/11 12:56 PM
|
16/Jan/12 03:28 PM
|
|
|
0
|
|
|
|
The customer encounters the following messages:
ALERT LOG:
{noformat}
.....
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
Transaction recovery: lock conflict caught and ignored
.....
{noformat}
SMON TRACE:
{noformat}
.....
*** 2011-12-26 14:42:46.401
Serial Transaction recovery caught exception 30319
Serial Transaction recovery caught exception 601
*** 2011-12-26 14:46:25.455
Serial Transaction recovery caught exception 601
Serial Transaction recovery caught exception 601
Serial Transaction recovery caught exception 601
Serial Transaction recovery caught exception 601
.....
{noformat}
The customer said the error started after SUPPLEMENTAL LOGGING enabled. But, the messages have not disappeared after disabling it.
|
Questions & Answers
|
QA-50
|
PRVF-5410 : Check of common NTP Time Server failed, PRVF-5416 : Query of NTP daemon failed on all nodes
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
13/May/11 05:27 PM
|
13/May/11 06:07 PM
|
|
|
0
|
|
|
|
'+Errors:+
The customer encountered the following errors in CVU:
{noformat}
./cluvfy stage -pre crsinst -n detrac1,detrac2 -verbose
.....
NTP common Time Server Check started...
PRVF-5410 : Check of common NTP Time Server failed
PRVF-5416 : Query of NTP daemon failed on all nodes
Result: Clock synchronization check using Network Time Protocol(NTP) failed
.....
{noformat}
+NTP:+
{noformat}
# ntpq -p
remote refid st t when poll reach delay offset disp
==============================================================================
*<REMOVED> LOCAL(0) <REMOVED>
#
{noformat}
Same on both nodes.
+CVU log:+
{noformat}
.....
[978@detrac1] [main] [ 2011-05-13 17:09:51.490 EEST ] [TaskNTP.getTimeServerInfo:838] Output from NTP query command on node detrac1 is =
remote refid st t when poll reach delay offset disp
==============================================================================
*<REMOVED> LOCAL(0) <REMOVED>
[978@detrac1] [main] [ 2011-05-13 17:09:51.492 EEST ] [TaskNTP.getTimeServerInfo:864] Parsing of NTP query output line FAILED. Line=
*<REMOVED> LOCAL(0) <REMOVED>
[978@detrac1] [main] [ 2011-05-13 17:09:51.492 EEST ] [TaskNTP.getTimeServerInfo:880] NTP query on node detrac1 did NOT produce valid output.
[978@detrac1] [main] [ 2011-05-13 17:09:51.492 EEST ] [TaskNTP.getTimeServerInfo:838] Output from NTP query command on node detrac2 is =
remote refid st t when poll reach delay offset disp
==============================================================================
*<REMOVED> LOCAL(0) <REMOVED>
[978@detrac1] [main] [ 2011-05-13 17:09:51.493 EEST ] [TaskNTP.getTimeServerInfo:864] Parsing of NTP query output line FAILED. Line=
*<REMOVED> LOCAL(0) <REMOVED>
[978@detrac1] [main] [ 2011-05-13 17:09:51.494 EEST ] [TaskNTP.getTimeServerInfo:880] NTP query on node detrac2 did NOT produce valid output.
.....
{noformat}
Ref: $CVU_HOME/cv/log/cvutrace.log.0
|
Questions & Answers
|
QA-49
|
ORA-4031: High Allocation for "Oracle Text Commit new id" in Shared Pool.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
05/Nov/10 10:01 PM
|
05/Nov/10 10:47 PM
|
|
|
0
|
|
|
|
The customer encountered ORA-4031 and trace file generated. SGA is an ASMM SGA. The application uses Oracle Text.
|
Questions & Answers
|
QA-48
|
Unable to start VIP because of invalid RX packets numbers.
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
18/Mar/09 07:44 PM
|
19/Mar/09 01:45 PM
|
|
|
0
|
|
|
|
'*When starting a VIP on a node, it fails and started on the other node.
*Starting the VIP:*
{noformat}
# ./crs_start ora.akyorap2.vip
Attempting to start `ora.akyorap2.vip` on member `akyorap2`
Start of `ora.akyorap2.vip` on member `akyorap2` failed.
Attempting to start `ora.akyorap2.vip` on member `akyorap1`
Start of `ora.akyorap2.vip` on member `akyorap1` succeeded.
#
{noformat}
The log level increased to get more detailed diagnostic data.
*Setting Log Level:*
{noformat}
#./crsctl debug log res "ora.akyorap2.vip:1"
Set Resource Debug Module: ora.akyorap2.vip Level: 1
#
{noformat}
*Errors from the Log:*
_(<ORA_CRS_HOME>/log/<nodeName>/racg/ora.akyorap2.vip.log)_
{noformat}
Wed Mar 18 20:58:49 GMT+02:00 2009 [ 413770 ] checkIf: start for if=en1
Wed Mar 18 20:58:49 GMT+02:00 2009 [ 413770 ] IsIfAlive: start for if=en1
2009-03-18 20:58:52.212: [ RACG][1] [360462][1][ora.akyorap2.vip]: Wed Mar 18
20:58:49 GMT+02:00 2009 [ 413770 ] defaultgw: started
Wed Mar 18 20:58:49 GMT+02:00 2009 [ 413770 ] defaultgw: completed with 10.46.1
80.1
2009-03-18 20:58:52.212: [ RACG][1] [360462][1][ora.akyorap2.vip]: Wed Mar 18
20:58:49 GMT+02:00 2009 [ 413770 ] About to execute command: /usr/sbin/ping -S
10.46.180.52 -c 1 -w 1 10.46.180.1
2009-03-18 20:58:52.212: [ RACG][1] [360462][1][ora.akyorap2.vip]: Wed Mar 18
20:58:51 GMT+02:00 2009 [ 413770 ] About to execute command: /usr/sbin/ping -S
10.46.180.52 -c 1 -w 1 10.46.180.1
2009-03-18 20:58:52.212: [ RACG][1] [360462][1][ora.akyorap2.vip]: Wed Mar 18
20:58:52 GMT+02:00 2009 [ 413770 ] IsIfAlive: RX packets checked if=en1 failed
Wed Mar 18 20:58:52 GMT+02:00 2009 [ 413770 ] Interface en1 checked failed (host
=akyorap2)
Wed Mar 18 20:58:52 GMT+02:00 2009 [ 413770 ] IsIfAlive: end for if=en1
2009-03-18 20:58:52.212: [ RACG][1] [360462][1][ora.akyorap2.vip]: Wed Mar 18
20:58:52 GMT+02:00 2009 [ 413770 ] checkIf: end for if=en1
Invalid parameters, or failed to bring up VIP (host=akyorap2)
{noformat}
|
Questions & Answers
|
QA-47
|
ORA-00354 ORA-00353 ORA-00312: Redolog Block Corruption
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
10/Mar/09 02:33 AM
|
10/Apr/09 01:13 PM
|
|
|
0
|
|
|
|
'*+Problem:+*
Import causes instance to be hang. During import only one instance is open.
{noformat}
imp system/manager file=../yedek/gedik_full.dmp log=../yedek/gedik_full_imp3.log full=y FEEDBACK=1000000
buffer=10000000 RESUMABLE=y RESUMABLE_TIMEOUT=72000
{noformat}
*+Diagnostic Data for Oracle:+*
*Alert Log:*
{noformat}
Mon Mar 9 19:38:45 2009
ARC0: Log corruption near block 50941 change 9160702125 time ?
Mon Mar 9 19:38:45 2009
Errors in file /u01/app/oracle/admin/ORCL/bdump/orcl1_arc0_26085.trc:
ORA-00354: corrupt redo log block header
ORA-00353: log corruption near block 50941 change 9160702125 time 03/09/2009 1
9:38:35
ORA-00312: online log 1 thread 1: '+DATA/orcl/onlinelog/group_1.516.680795507'
ARC0: All Archive destinations made inactive due to error 354
Mon Mar 9 19:38:45 2009
ARC0: Closing local archive destination LOG_ARCHIVE_DEST_1: '/u01/app/oracle/p
roduct/10.2.0/dbs/arch/1_27_681074311.dbf' (error 354)
(ORCL1)
Committing creation of archivelog '/u01/app/oracle/product/10.2.0/dbs/arch/1_2
7_681074311.dbf' (error 354)
ARCH: Archival stopped, error occurred. Will continue retrying
{noformat}
*Archive Log Trace:*
{noformat}
Corrupt redo block 50941 detected: bad block number
Flag: 0x30 Format: 0x38 Block: 0x20302030 Seq: 0x5c305c79 Beg: 0x3030 Cks:0x5
c31
----- Dump of Corrupt Redo Buffer -----
5c463830203020305c305c795c3130305c3230305c305c305c305c3020665c30
3030433c5c305c345c305c305c305c305c305c3035320a303a35323920202009
5c305c5030305c303033203120305c32303920383022203520305c315c353034
5c305c3020305c3020725c305c3820373035317231305c315c305c330a305c30
3239353220093a35203843203030433f20372034203530395c3230225c393830
30313030203020315c3630795c3431305c3430305c463830203020305c305c79
5c3130305c32303035320a303a3532395c2020095c305c305c305c30433c2066
5c3430305c305c305c305c305c305c3020305c305c305c5030305c3030292031
20305c32303920383022203520305c310a3320363239353220093a355c305c20
5c305c30203620303038203331725c455c625c365c3331305c305c3020665c30
3030433c20372034203530395c3230225c3938305c3530302030203035320a79
3a3532393020200931305c365c305c3038305c6230305c4641305c3431305c35
5c305c3030305c3020305c3542305c3f5c305c3031305c3030305c3131305c31
425420440a4920353239353220093a35314345205c305c395c3130305c323062
20382030203530395c313022203530305c305c345c305c302035303020372034
303530365c3831315c3230304646463035320a463a3532394320200938412032
Rereading log member '+DATA/orcl/onlinelog/group_1.516.680795507' (corruption
)
...
Corrupt redo block 50941 detected: bad block number
Flag: 0x0 Format: 0x0 Block: 0x00000000 Seq: 0x00000000 Beg: 0x0 Cks:0x0
----- Dump of Corrupt Redo Buffer -----
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000
Rereading log member '+DATA/orcl/onlinelog/group_1.516.680795507' (corruption
)
...
Corrupt redo block 50941 detected: bad block number
Flag: 0x30 Format: 0x38 Block: 0x20302030 Seq: 0x5c305c79 Beg: 0x3030 Cks:0x5
c31
----- Dump of Corrupt Redo Buffer -----
5c463830203020305c305c795c3130305c3230305c305c305c305c3020665c30
3030433c5c305c345c305c305c305c305c305c3035320a303a35323920202009
5c305c5030305c303033203120305c32303920383022203520305c315c353034
5c305c3020305c3020725c305c3820373035317231305c315c305c330a305c30
3239353220093a35203843203030433f20372034203530395c3230225c393830
30313030203020315c3630795c3431305c3430305c463830203020305c305c79
5c3130305c32303035320a303a3532395c2020095c305c305c305c30433c2066
5c3430305c305c305c305c305c305c3020305c305c305c5030305c3030292031
20305c32303920383022203520305c310a3320363239353220093a355c305c20
5c305c30203620303038203331725c455c625c365c3331305c305c3020665c30
3030433c20372034203530395c3230225c3938305c3530302030203035320a79
3a3532393020200931305c365c305c3038305c6230305c4641305c3431305c35
5c305c3030305c3020305c3542305c3f5c305c3031305c3030305c3131305c31
425420440a4920353239353220093a35314345205c305c395c3130305c323062
20382030203530395c313022203530305c305c345c305c302035303020372034
303530365c3831315c3230304646463035320a463a3532394320200938412032
*** 2009-03-10 03:55:10.757 62692 kcrr.c
{noformat}
As seen above, even if the database hangs, the contents of redo buffer dump change.
*+Diagnostic Data for Solaris:+*
*Soft Link Mapping to Raw Devices:*
{noformat}
oravol1: disk@g600a0b80005a81660000074949959b42:b,raw
oravol2: disk@g600a0b80005a816600000742499595ea:b,raw
oravol3: disk@g600a0b80005a8166000007444995971e:b,raw
oravol4: disk@g600a0b80005a8c9f000004f049959717:b,raw
oravol5: disk@g600a0b80005a8c9f000004f249959991:b,raw
{noformat}
*Open File Descriptors of ARCH process:*
{noformat}
bash-3.00$ ps -ef|grep arc0
oracle 19941 14227 0 04:10:31 pts/12 0:00 grep arc0
oracle 26085 1 0 19:25:05 ? 0:29 ora_arc0_ORCL1
bash-3.00$ ls -ltr /proc/26085/path
...
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:25 261
-> /devices/scsi_vhci/disk@g600a0b80005a816600000742499595ea:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:25 260
-> /devices/scsi_vhci/disk@g600a0b80005a8c9f000004f049959717:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:25 259
-> /devices/scsi_vhci/disk@g600a0b80005a81660000074949959b42:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:25 257
-> /devices/scsi_vhci/disk@g600a0b80005a8166000007444995971e:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:25 256
-> /devices/scsi_vhci/disk@g600a0b80005a8c9f000004f249959991:b,raw
...
bash-3.00$
{noformat}
*Gathering truss output for ARCH:*
{noformat}
truss -fae -w 261,260,259,257,256 -r 261,260,259,257,256 -o arc0.truss.log -p 26085
{noformat}
The command above will trace system calls with pread()/pwrite() IO buffer dumping for fd of 261,260,259,257,256.
*Open File Descriptors of LGWR process:*
{noformat}
bash-3.00$ ps -ef|grep lgwr
oracle 28447 1 0 Mar 04 ? 0:17 asm_lgwr_+ASM1
oracle 25925 1 0 19:24:49 ? 0:38 ora_lgwr_ORCL1
oracle 26468 14227 0 04:21:02 pts/12 0:00 grep lgwr
bash-3.00$ ls -ltr /proc/25925/path
...
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:24 260
-> /devices/scsi_vhci/disk@g600a0b80005a816600000742499595ea:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:24 259
-> /devices/scsi_vhci/disk@g600a0b80005a81660000074949959b42:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:24 258
-> /devices/scsi_vhci/disk@g600a0b80005a8c9f000004f049959717:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:24 257
-> /devices/scsi_vhci/disk@g600a0b80005a8166000007444995971e:b,raw
lrwxrwxrwx 1 oracle oinstall 0 Mar 9 19:24 256
-> /devices/scsi_vhci/disk@g600a0b80005a8c9f000004f249959991:b,raw
...
{noformat}
*Gathering truss output for ARCH:*
{noformat}
bash-3.00$ truss -fae -w 260,259,258,257,256 -r 260,259,258,257,256 -o lgwr.truss.log -p 25925 &
{noformat}
The command above will trace system calls with pread()/pwrite() IO buffer dumping for fd of 260,259,258,257,256.
|
Questions & Answers
|
QA-46
|
ORA-12545: Connect failed in RAC environment because of an implicit redirect to another node.
|
Oracle - SQL*Net
|
Closed
|
Major
|
Not a Problem
|
ubTools Support
|
ubTools Support
|
27/Feb/09 09:05 PM
|
27/Feb/09 10:16 PM
|
|
|
0
|
|
|
|
'*+Description:+*
The clients can not connect to the database with _ORA-12545_ error even if They can ping the database server.
*+Diagnostic Data for Oracle:+*
*Remote and Local Listeners for Both Nodes:*
{noformat}
SQL> show parameter listener
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string
remote_listener string LISTENERS_ORCL
SQL>
{noformat}
*Remote Listener Configuration for Both Nodes:*
{noformat}
LISTENERS_ORCL =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = gdksun1-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = gdksun2-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = gdksun1-pubext-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = gdksun2-pubext-vip)(PORT = 1521))
)
{noformat}
*tns alias*
{noformat}
SUNGDK =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = <IP0>)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = <IP1>)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = ORCL)
(FAILOVER_MODE =
(TYPE = SELECT)
(METHOD = BASIC)
(RETRIES = 180)
(DELAY = 5)
)
)
)
{noformat}
*sqlnet trace parameters*
{noformat}
TRACE_LEVEL_CLIENT = 16
TRACE_FILE_CLIENT = sqlnet.trc
TRACE_DIRECTORY_CLIENT = <dizinAdı>
TRACE_UNIQUE_CLIENT = ON
TRACE_TIMESTAMP_CLIENT = ON
{noformat}
*sqlnet trace*
{noformat}
(5996) [27-ŞUB-2009 20:57:50:875] nttgetport: port resolved to 1521
(5996) [27-ŞUB-2009 20:57:50:875] nttgetport: exit
(5996) [27-ŞUB-2009 20:57:50:875] nttbnd2addr: using host IP address: <IP1>
(5996) [27-ŞUB-2009 20:57:50:875] nttbnd2addr: exit
(5996) [27-ŞUB-2009 20:57:50:875] nsc2addr: normal exit
{noformat}
The host IP and port are resolved to <IP1> and 1521, respectively.
{noformat}
(5996) [27-ŞUB-2009 20:57:50:937] nscon: sending NSPTCN packet
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: entry
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: plen=58, type=1
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: entry
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: socket 420 had bytes written=58
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: exit
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 58 bytes to transport
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: packet dump
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 00 3A 00 00 01 00 00 00 |.:......|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 01 38 01 2C 00 00 08 00 |.8.,....|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 7F FF 86 0E 00 00 01 00 |........|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 01 3E 00 3A 00 00 02 00 |.>.:....|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 21 21 00 00 00 00 00 00 |!!......|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 00 00 00 00 0A C0 00 00 |........|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 00 0A 00 00 00 00 00 00 |........|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 00 00 |.. |
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: normal exit
{noformat}
A connect packet _(NSPTCN)_ sent to <IP1>.
{noformat}
(5996) [27-ŞUB-2009 20:57:50:937] nsdofls: sending NSPTDA packet
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: entry
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: plen=328, type=6
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: entry
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: socket 420 had bytes written=328
(5996) [27-ŞUB-2009 20:57:50:937] nttwr: exit
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 328 bytes to transport
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: packet dump
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 01 48 00 00 06 00 00 00 |.H......|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 00 00 28 44 45 53 43 52 |..(DESCR|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 49 50 54 49 4F 4E 3D 28 |IPTION=(|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 41 44 44 52 45 53 53 3D |ADDRESS=|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 28 50 52 4F 54 4F 43 4F |(PROTOCO|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 4C 3D 54 43 50 29 28 48 |L=TCP)(H|
...
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 75 72 61 64 3F 54 75 6C |urad?Tul|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: 75 6E 61 79 29 29 29 29 |unay))))|
(5996) [27-ŞUB-2009 20:57:50:937] nspsend: normal exit
{noformat}
A data packet _(NSPTDA)_ sent to <IP1>.
{noformat}
(5996) [27-ŞUB-2009 20:57:50:937] nscon: recving a packet
(5996) [27-ŞUB-2009 20:57:50:937] nsprecv: entry
(5996) [27-ŞUB-2009 20:57:50:937] nsbal: entry
(5996) [27-ŞUB-2009 20:57:50:937] nsbgetfl: entry
(5996) [27-ŞUB-2009 20:57:50:937] nsbgetfl: normal exit
(5996) [27-ŞUB-2009 20:57:50:937] nsmal: entry
(5996) [27-ŞUB-2009 20:57:50:937] nsmal: 48 bytes at 0x15bcf60
(5996) [27-ŞUB-2009 20:57:50:937] nsmal: normal exit
(5996) [27-ŞUB-2009 20:57:50:937] nsbal: normal exit
(5996) [27-ŞUB-2009 20:57:50:937] nsprecv: reading from transport...
(5996) [27-ŞUB-2009 20:57:50:937] nttrd: entry
(5996) [27-ŞUB-2009 20:57:50:968] nttrd: socket 420 had bytes read=10
(5996) [27-ŞUB-2009 20:57:50:968] nttrd: exit
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 10 bytes from transport
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: tlen=10, plen=10, type=5
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: packet dump
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 00 0A 00 00 05 02 00 00 |........|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 01 85 |.. |
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: normal exit
(5996) [27-ŞUB-2009 20:57:50:968] nscon: got NSPTRD packet
{noformat}
Got a redirect packet _(NSPTRD)_ from <IP1>.
{noformat}
(5996) [27-ŞUB-2009 20:57:50:968] nsrdr: recving a packet
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: entry
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: reading from transport...
(5996) [27-ŞUB-2009 20:57:50:968] nttrd: entry
(5996) [27-ŞUB-2009 20:57:50:968] nttrd: socket 420 had bytes read=399
(5996) [27-ŞUB-2009 20:57:50:968] nttrd: exit
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 399 bytes from transport
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: tlen=399, plen=399, type=6
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: packet dump
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 01 8F 00 00 06 00 00 00 |........|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 00 40 28 41 44 44 52 45 |.@(ADDRE|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 53 53 3D 28 50 52 4F 54 |SS=(PROT|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 4F 43 4F 4C 3D 54 43 50 |OCOL=TCP|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 29 28 48 4F 53 54 3D 67 |)(HOST=g|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 64 6B 73 75 6E 32 29 28 |dksun2)(|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 50 4F 52 54 3D 31 35 32 |PORT=152|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 31 29 29 00 28 44 45 53 |1)).(DES|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 43 52 49 50 54 49 4F 4E |CRIPTION|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 3D 28 41 44 44 52 45 53 |=(ADDRES|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 53 3D 28 50 52 4F 54 4F |S=(PROTO|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 43 4F 4C 3D 54 43 50 29 |COL=TCP)|
...
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 3D 4D 75 72 61 64 3F 54 |=Murad?T|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 75 6C 75 6E 61 79 29 29 |ulunay))|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 28 49 4E 53 54 41 4E 43 |(INSTANC|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 45 5F 4E 41 4D 45 3D 6F |E_NAME=o|
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: 72 63 6C 32 29 29 29 |rcl2))) |
(5996) [27-ŞUB-2009 20:57:50:968] nsprecv: normal exit
(5996) [27-ŞUB-2009 20:57:50:968] nsrdr: got NSPTDA packet
{noformat}
Got a data packet _(NSPTDA)_ from <IP1>.
{noformat}
(5996) [27-ŞUB-2009 20:57:50:984] nttgetport: port resolved to 1521
(5996) [27-ŞUB-2009 20:57:50:984] nttgetport: exit
(5996) [27-ŞUB-2009 20:57:50:984] nttbnd2addr: looking up IP addr for host: gdksun2
(5996) [27-ŞUB-2009 20:57:53:640] nttbnd2addr: *** hostname lookup failure! ***
(5996) [27-ŞUB-2009 20:57:53:640] nttbnd2addr: exit
{noformat}
{color:red}
As seen above, even if the initial request was sent to <IP1>, now it's redirected to an host named _gdksun2_.
{color}
{noformat}
(5996) [27-ŞUB-2009 20:57:53:640] nserror: entry
(5996) [27-ŞUB-2009 20:57:53:640] nserror: nsres: id=0, op=77, ns=12545, ns2=12560; nt[0]=515,
nt[1]=1001, nt[2]=0; ora[0]=0, ora[1]=0, ora[2]=0
(5996) [27-ŞUB-2009 20:57:53:640] snsbitts_ts: entry
(5996) [27-ŞUB-2009 20:57:53:640] snsbitts_ts: acquired the bit
(5996) [27-ŞUB-2009 20:57:53:640] snsbitts_ts: normal exit
(5996) [27-ŞUB-2009 20:57:53:640] snsbitcl_ts: entry
(5996) [27-ŞUB-2009 20:57:53:640] snsbitcl_ts: normal exit
(5996) [27-ŞUB-2009 20:57:53:640] nsc2addr: error exit
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: entry
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: 318 bytes at 0x15bce20
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: normal exit
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: entry
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: 164 bytes at 0x15b9920
(5996) [27-ŞUB-2009 20:57:53:640] nsmfr: normal exit
(5996) [27-ŞUB-2009 20:57:53:640] nladtrm: entry
(5996) [27-ŞUB-2009 20:57:53:640] nladtrm: exit
(5996) [27-ŞUB-2009 20:57:53:640] nscall: error exit
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: error from nscall
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: nr err code: 0
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: ns main err code: 12545
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: ns (2) err code: 12560
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: nt main err code: 515
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: nt (2) err code: 1001
(5996) [27-ŞUB-2009 20:57:53:640] nioqper: nt OS err code: 0
(5996) [27-ŞUB-2009 20:57:53:640] niomapnserror: entry
(5996) [27-ŞUB-2009 20:57:53:640] niqme: entry
(5996) [27-ŞUB-2009 20:57:53:640] niqme: reporting NS-12545 error as ORA-12545
(5996) [27-ŞUB-2009 20:57:53:640] niqme: exit
(5996) [27-ŞUB-2009 20:57:53:640] niomapnserror: returning error 12545
(5996) [27-ŞUB-2009 20:57:53:640] niomapnserror: exit
(5996) [27-ŞUB-2009 20:57:53:640] niotns: Couldn't connect, returning 12545
{noformat}
Then, the client got ORA-12545 error.
|
Questions & Answers
|
QA-45
|
'direct path read temp' hangs on read() system call when ASMLIB in use.
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
02/Feb/09 11:13 PM
|
03/Feb/09 12:03 AM
|
|
|
0
|
|
|
|
'+*Environment:*+
{noformat}
Database......: Oracle 10.2.0.4 Standard Edition, RAC
ASMLIB........: oracleasm-2.6.16.46-0.12-smp-2.0.3-1.x86_64.rpm
oracleasmlib-2.0.2-1.x86_64.rpm
oracleasm-support-2.1.2-1.SLE10.x86_64.rpm
{noformat}
+*Description:*+
_direct path read temp_ hangs on read() system call when ASMLIB in use.
+*Diagnostic Data for Oracle:*+
*Wait Event:*
{noformat}
SQL> select SEQ#,EVENT,P1,P2,P3,WAIT_TIME,SECONDS_IN_WAIT from v$session_wait where sid=512 and state='WAITING';
SEQ# EVENT
---------- ----------------------------------------------------------------
P1 P2 P3 WAIT_TIME SECONDS_IN_WAIT
---------- ---------- ---------- ---------- ---------------
46619 direct path read temp
202 285578 7 0 5611
...
SQL> select SEQ#,EVENT,P1,P2,P3,WAIT_TIME,SECONDS_IN_WAIT from v$session_wait where sid=512 and state='WAITING';
SEQ# EVENT
---------- ----------------------------------------------------------------
P1 P2 P3 WAIT_TIME SECONDS_IN_WAIT
---------- ---------- ---------- ---------- ---------------
46619 direct path read temp
202 285578 7 0 5824
SQL>
{noformat}
The session is waiting for the completion of _direct path read temp_ for 5824 seconds. The SEQ# column is not changing. It's TOO long to read just 7 blocks from the disk.
*Stack Trace:*
{noformat}
SQL> select spid from v$session s,v$process p where s.paddr=p.addr and s.sid=512;
SPID
------------
2359
SQL> oradebug SETOSPID 2359
Oracle pid: 38, Unix process pid: 2359, image: oracle@gdksun1
SQL> oradebug dump errorstack 3
Statement processed.
SQL> oradebug TRACEFILE_NAME
/u03/app/oracle/admin/ORCL/udump/orcl1_ora_2359.trc
SQL>
<from the trace file>
Current SQL statement for this session:
CREATE INDEX "ACD2" ON "ACCOUNT_DETAIL" ...
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ksedst()+31 call ksedst1() 000000000 ? 000000001 ?
7FFF177ECC40 ? 7FFF177ECCA0 ?
7FFF177ECBE0 ? 000000000 ?
ksedmp()+610 call ksedst() 000000000 ? 000000001 ?
7FFF177ECC40 ? 7FFF177ECCA0 ?
7FFF177ECBE0 ? 000000000 ?
ksdxfdmp()+1118 call ksedmp() 000000003 ? 000000001 ?
7FFF177ECC40 ? 7FFF177ECCA0 ?
7FFF177ECBE0 ? 000000000 ?
ksdxcb()+1547 call ksdxfdmp() 7FFF177EDD90 ? 000000011 ?
000000003 ? 7FFF177EDED0 ?
7FFF177EDE30 ? 000000000 ?
sspuser()+111 call ksdxcb() 000000001 ? 000000011 ?
000000001 ? 000000001 ?
7FFF177EDE30 ? 000000000 ?
__funlockfile()+80 call sspuser() 000000001 ? 000000011 ?
000000001 ? 000000001 ?
7FFF177EDE30 ? 000000000 ?
__read_nocancel()+7 signal __funlockfile() 00000000D ? 7FFF177EE970 ?
000000050 ?
FFFFFFFFFFFFFFFF ?
000000000 ? 2B4E95CCE000 ?
call_instance_read( call __read_nocancel() 00000000D ? 7FFF177EE970 ?
)+12 000000050 ?
FFFFFFFFFFFFFFFF ?
000000000 ? 2B4E95CCE000 ?
asm_io_v2()+185 call call_instance_read( 00000000D ? 7FFF177EE970 ?
) 000000050 ?
FFFFFFFFFFFFFFFF ?
000000000 ? 2B4E95CCE000 ?
kfkOsmIO()+1205 call asm_io_v2() 00000000D ? 7FFF177EE970 ?
000000246 ?
FFFFFFFFFFFFFFFF ?
000000000 ? 2B4E95CCE000 ?
kfkReapIO()+497 call kfkOsmIO() 2B4E95830588 ? 2B4E95AAE000 ?
000000000 ? 000000000 ?
000000000 ? 2B4E95B2E000 ?
kfkIOPriv()+770 call kfkReapIO() 000000000 ? 006110320 ?
2B4E95830588 ? 006110320 ?
006110320 ? 2B4E95B2E000 ?
kfdIOPriv()+95 call kfkIOPriv() 000000000 ? 000000000 ?
000000024 ? 000000000 ?
2B4E95B66040 ? 000000001 ?
kfioReapIO()+476 call kfdIOPriv() 000000000 ? 000000000 ?
000000000 ? 000000000 ?
2B4E95B66040 ? 000000001 ?
kfioRequest()+197 call kfioReapIO() 7FFF177EED68 ? 000000001 ?
0FFFFFFFF ? 000000000 ?
2B4E95B66040 ? 000000001 ?
ksfd_osmwat()+874 call kfioRequest() 000000000 ? 000000000 ?
000000000 ? 000000000 ?
7FFF177EED68 ? 2B4E00000001 ?
ksfdwtio()+693 call ksfd_osmwat() 000000001 ? 000000000 ?
07FFFFFFF ? 000000000 ?
7FFF177EED68 ? 2B4E00000001 ?
ksfdwat1()+220 call ksfdwtio() 000000001 ? 000000030 ?
07FFFFFFF ? 000000000 ?
7FFF177EED68 ? 2B4E00000001 ?
ksfdrwat0()+1269 call ksfdwat1() 000000001 ? 000000030 ?
07FFFFFFF ? 000000000 ?
7FFF177EED68 ? 2B4E00000001 ?
ksfdblock()+156 call ksfdrwat0() 000000001 ? 000000030 ?
07FFFFFFF ? 000000000 ?
2B4E7FFFFFFF ? 2B4E00000001 ?
kcflwi()+48 call ksfdblock() 7FFF177F11C0 ? 000000001 ?
000000010 ? 000000000 ?
2B4E7FFFFFFF ? 2B4E00000001 ?
kcflci()+689 call kcflwi() 2B4E95FF3F28 ? 000000001 ?
000000010 ? 000000000 ?
2B4E7FFFFFFF ? 2B4E00000001 ?
kcblci()+197 call kcflci() 2B4E95FF3F28 ? 000000000 ?
0000000CA ? 000045B8A ?
7FFF177F1270 ? 000000000 ?
kcblcio()+280 call kcblci() 2B4E95D168F0 ? 2B4E95FF3E70 ?
000000001 ? 000045B8A ?
7FFF177F1270 ? 000000000 ?
kcblsltck()+50 call kcblcio() 2B4E95D168F0 ? 2B4E95FF3E70 ?
000000001 ? 000045B8A ?
7FFF177F1270 ? 000000000 ?
stsCheckIO()+194 call kcblsltck() 2B4E95D168F0 ? 2B4E95FF3E70 ?
000000001 ? 000045B8A ?
7FFF177F1270 ? 000000000 ?
srsnext()+746 call stsCheckIO() 2B4E95D16FE0 ? 2B4E958F9108 ?
000000000 ? 000000001 ?
7FFF177F1270 ? 000000000 ?
srsget()+138 call srsnext() 2B4E9602FE14 ? 000000000 ?
2B4E95D16FE0 ? 2B4E958F8F10 ?
2B4E00000000 ? 000000000 ?
sorgetqbf()+297 call srsget() 2B4E95D16F28 ? 000000000 ?
000000000 ? 000000000 ?
2B4E95D372B0 ? 2B4E95D37468 ?
qersoFetch()+176 call sorgetqbf() 2B4E95D16F28 ? 2B4E95D37468 ?
2B4E95D372B0 ? 7FFF177F1584 ?
2B4E95D372B0 ? 2B4E95D37468 ?
qerliFetch()+304 call qersoFetch() 5EEF015A0 ? 002D292E4 ?
7FFF177F1748 ? 000000001 ?
5EEF01648 ? 2B4E95D37468 ?
kdicrws()+8744 call qerliFetch() 5EEF01358 ? 00143CCD6 ?
2B4E9581C140 ? 000000001 ?
5EEF01648 ? 5D2E60688 ?
kdicdrv()+335 call kdicrws() 5D2E60688 ? 5D2E60B60 ?
000000000 ? 000000001 ?
2B4E95D367B0 ? 5D2E60610 ?
opiexe()+12879 call kdicdrv() 5D2E60B60 ? 5D2E60380 ?
000000002 ? 000000001 ?
2B4E95D367B0 ? 000000000 ?
opiosq0()+3316 call opiexe() 000000004 ? 000000000 ?
7FFF177F3748 ? 000000004 ?
2B4E95D367B0 ? 000000000 ?
opiosq()+11 call opiosq0() 000000003 ? 00000000F ?
7FFF177F65E0 ? 000000000 ?
2B4E95D367B0 ? 000000000 ?
opiodr()+984 call opiosq() 000000003 ? 00000000F ?
7FFF177F65E0 ? 000000000 ?
2B4E95D367B0 ? 000000000 ?
ttcpip()+1012 call opiodr() 00000004A ? 00000000F ?
7FFF177F65E0 ? 000000004 ?
0053E3F30 ? 000000000 ?
opitsk()+1322 call ttcpip() 0060AB150 ? 7FFF177F4540 ?
7FFF177F65E0 ? 000000000 ?
7FFF177F60D8 ? 7FFF177F6748 ?
opiino()+1026 call opitsk() 000000003 ? 000000000 ?
7FFF177F65E0 ? 000000001 ?
000000000 ? 612CA0900000000 ?
opiodr()+984 call opiino() 00000003C ? 000000004 ?
7FFF177F77A8 ? 000000000 ?
000000000 ? 612CA0900000000 ?
opidrv()+547 call opiodr() 00000003C ? 000000004 ?
7FFF177F77A8 ? 000000000 ?
0053E3D00 ? 612CA0900000000 ?
sou2o()+114 call opidrv() 00000003C ? 000000004 ?
7FFF177F77A8 ? 000000000 ?
0053E3D00 ? 612CA0900000000 ?
opimai_real()+163 call sou2o() 7FFF177F7780 ? 00000003C ?
000000004 ? 7FFF177F77A8 ?
0053E3D00 ? 612CA0900000000 ?
main()+116 call opimai_real() 000000002 ? 7FFF177F7810 ?
000000004 ? 7FFF177F77A8 ?
0053E3D00 ? 612CA0900000000 ?
__libc_start_main() call main() 000000002 ? 7FFF177F7810 ?
+244 000000004 ? 7FFF177F77A8 ?
0053E3D00 ? 612CA0900000000 ?
_start()+41 call __libc_start_main() 0006D23A8 ? 000000002 ?
7FFF177F7968 ? 000000000 ?
0053E3D00 ? 000000002 ?
{noformat}
Looks like an hang in __read_nocancel() .
+*Diagnostic Data for Linux:*+
*strace Output:*
{noformat}
oracle@gdksun1:~> strace -fp 2359
Process 2359 attached - interrupt to quit
read(13,
{noformat}
The process is sleeping on the file descriptor(fd) of 13 by read() system call.
*lsof Output:*
{noformat}
oracle@gdksun1:~> lsof -p 2359|grep 13
oracle 2359 oracle DEL REG 0,12
131074 /2
oracle 2359 oracle mem REG 8,2
133423 16839 /lib64/ld-2.4.so
oracle 2359 oracle mem REG 8,17
681761 52138 /u03/app/oracle/product/10.2.0/db_1/lib/libocr10.so
oracle 2359 oracle mem REG 8,17
691049 52139 /u03/app/oracle/product/10.2.0/db_1/lib/libocrb10.so
oracle 2359 oracle mem REG 8,17
11385162 44025 /u03/app/oracle/product/10.2.0/db_1/lib/libjox10.so
oracle 2359 oracle 6w REG 8,17
1494136 90989 /u03/app/oracle/admin/ORCL/bdump/alert_ORCL1.log
oracle 2359 oracle 13u REG 0,19
0 18446604444591769000 /dev/oracleasm/iid/0000000000000002
oracle@gdksun1:~>
{noformat}
The fd#13 is an ASM device.
*gdb output:*
{noformat}
oracle@gdksun1:~> gdb $ORACLE_HOME/bin/oracle 2359
GNU gdb 6.6
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...
Using host libthread_db library "/lib64/libthread_db.so.1".
Attaching to program: /u03/app/oracle/product/10.2.0/db_1/bin/oracle, process 2359
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libskgxp10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libskgxp10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libhasgen10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libhasgen10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libskgxn2.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libskgxn2.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libocr10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libocr10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libocrb10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libocrb10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libocrutl10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libocrutl10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libjox10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libjox10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libclsra10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libclsra10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libdbcfg10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libdbcfg10.so
Reading symbols from /u03/app/oracle/product/10.2.0/db_1/lib/libnnz10.so...done.
Loaded symbols for /u03/app/oracle/product/10.2.0/db_1/lib/libnnz10.so
Reading symbols from /usr/lib64/libaio.so.1...done.
Loaded symbols for /usr/lib64/libaio.so.1
Reading symbols from /lib64/libdl.so.2...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libm.so.6...done.
Loaded symbols for /lib64/libm.so.6
Reading symbols from /lib64/libpthread.so.0...done.
[Thread debugging using libthread_db enabled]
[New Thread 47616513025792 (LWP 2359)]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libnsl.so.1...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libc.so.6...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /usr/lib64/libnuma.so...done.
Loaded symbols for /usr/lib64/libnuma.so
Reading symbols from /opt/oracle/extapi/64/asm/orcl/1/libasm.so...done.
Loaded symbols for /opt/oracle/extapi/64/asm/orcl/1/libasm.so
0x00002b4e9512f910 in __read_nocancel () from /lib64/libpthread.so.0
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb) backtrace
#0 0x00002b4e9512f910 in __read_nocancel () from /lib64/libpthread.so.0
#1 0x00002b4e95d6772c in call_instance_read (priv=<value optimized out>, buf=0x7fff177ee970, size=80)
at asmlib_v2.c:540
#2 0x00002b4e95d67869 in asm_io_v2 (ctx=0xd, requests=<value optimized out>, reqlen=582,
waitreqs=0xffffffffffffffff, waitlen=0,
completions=0x2b4e95cce000, complen=1, timeout=4294967295, statusp=0x7fff177eea14) at asmlib_v2.c:705
#3 0x0000000000b1804d in kfkOsmIO ()
#4 0x0000000000b113e9 in kfkReapIO ()
#5 0x0000000000b0b342 in kfkIOPriv ()
#6 0x0000000000a8939f in kfdIOPriv ()
#7 0x0000000000b06eec in kfioReapIO ()
#8 0x0000000000b04de5 in kfioRequest ()
#9 0x00000000008d669a in ksfd_osmwat ()
#10 0x00000000008be64d in ksfdwtio ()
#11 0x00000000008bb3a4 in ksfdwat1 ()
#12 0x00000000008bb1f5 in ksfdrwat0 ()
#13 0x00000000008bb464 in ksfdblock ()
#14 0x00000000026c0e98 in kcflwi ()
#15 0x00000000026c0e31 in kcflci ()
#16 0x0000000001011435 in kcblci ()
#17 0x0000000001010e20 in kcblcio ()
#18 0x0000000001010ca2 in kcblsltck ()
#19 0x00000000020588f0 in stsCheckIO ()
#20 0x0000000002063908 in srsnext ()
#21 0x0000000002062eba in srsget ()
#22 0x000000000205d089 in sorgetqbf ()
#23 0x0000000002d64222 in qersoFetch ()
#24 0x0000000002d2e412 in qerliFetch ()
#25 0x00000000014327d2 in kdicrws ()
#26 0x000000000142fa47 in kdicdrv ()
#27 0x0000000002f2cf07 in opiexe ()
#28 0x00000000034c55d4 in opiosq0 ()
#29 0x00000000034c48db in opiosq ()
#30 0x00000000012e88f4 in opiodr ()
#31 0x0000000003a4b900 in ttcpip ()
#32 0x00000000012e3fc4 in opitsk ()
#33 0x00000000012e6ee4 in opiino ()
#34 0x00000000012e88f4 in opiodr ()
#35 0x00000000012da313 in opidrv ()
#36 0x0000000001e62466 in sou2o ()
#37 0x00000000006d24cb in opimai_real ()
#38 0x00000000006d241c in main ()
(gdb)
{noformat}
Looks like a hang in __read_nocancel() . It's the same as in Oracle stack trace.
*An Excerpt from /var/log/messages:*
{noformat}
Feb 2 22:46:51 gdksun1 kernel: 509 [RAIDarray.mpp]mppLnx_do_queuecommand: mppLnx_scsi_execute_async failed.
{noformat}
At the same time, _mppLnx_do_queuecommand: mppLnx_scsi_execute_async failed_ appeared in _/var/log/messages_.
|
Questions & Answers
|
QA-44
|
TNS connection lost for big SQL*Net packets, and slow performance for small SQL*Net packets.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
26/Nov/08 12:28 PM
|
26/Nov/08 01:38 PM
|
|
|
0
|
|
|
|
The customer has the following errors in SQ*Net SERVER trace:
{noformat}
[17-KAS-2008 06:02:33:866] nspsend: transport write error
[17-KAS-2008 06:02:33:867] nserror: nsres: id=0, op=67, ns=12547, ns2=12560; nt[0]=517, nt[1]=32, nt[2]=0; ora[
0]=0, ora[1]=0, ora[2]=0
[17-KAS-2008 06:02:33:868] nsdo: nsctxrnk=0
[17-KAS-2008 06:02:33:869] nioqsn: send failed: bl = 47, nicbl = 59
[17-KAS-2008 06:02:33:870] nioqper: error from nioqsn
[17-KAS-2008 06:02:33:871] nioqper: nr err code: 0
[17-KAS-2008 06:02:33:872] nioqper: ns main err code: 12547
[17-KAS-2008 06:02:33:873] nioqper: ns (2) err code: 12560
[17-KAS-2008 06:02:33:875] nioqper: nt main err code: 517
[17-KAS-2008 06:02:33:876] nioqper: nt (2) err code: 32
[17-KAS-2008 06:02:33:877] nioqper: nt OS err code: 0
[17-KAS-2008 06:02:33:878] nioqer: entry
[17-KAS-2008 06:02:33:879] nioqce: entry
[17-KAS-2008 06:02:33:880] nioqce: exit
[17-KAS-2008 06:02:33:881] nioqer: exit
[17-KAS-2008 06:02:33:882] nioqsn: returning error: 3113
{noformat}
nt[1]=32 is Operating System Dependent(OSD) error code.
An excerpt from truss output of SERVER process:
{noformat}
531245: lseek(7, 0, SEEK_CUR) = 501528
531245: write(7, " [ 1 7 - K A S - 2 0 0 8".., 34) = 34
531245: lseek(7, 0, SEEK_CUR) = 501562
531245: write(7, " e n t r y\n", 6) = 6
531245: write(12, "07DB\0\006\0\0\0\0\002C2".., 2011) Err#32 Broken pipe
531245: Received signal #13, SIGPIPE [ignored]
531245: siginfo: SIGPIPE
531245: lseek(8, 69632, SEEK_SET) = 69632
531245: read(8, "12\0DB0F\0\0 t\0DC0F\0\0".., 512) = 512
531245: lseek(8, 13312, SEEK_SET) = 13312
531245: read(8, "19\0A203\0\09E\0A303\0\0".., 512) = 512
531245: gettimeofday(0x000000011FFF7A90, 0x00000000) = 0
531245: lseek(7, 0, SEEK_CUR) = 501568
{noformat}
OSD error is Err#32 Broken pipe. This OSD error is also defined in errno.h:
- #define EPIPE 32 /* Broken pipe */
Client side SQL*Net trace shows that client is waiting for a response from server on nttrd() call.
Since the server process is lost connection, it's not able to send a message to the client side. Since the client side is not getting a response, his screen waits in "Not Responding" state in Windows.
|
Questions & Answers
|
QA-43
|
Slow performance while navigating on the forms items.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
26/Nov/08 11:56 AM
|
26/Nov/08 12:10 PM
|
|
|
0
|
|
|
|
The customer encountered slow performance while navigating on their forms items. The problem occured sporadically. When it occurs it takes 3-4 seconds, which are not acceptable.
An excerpt from EVENT 10046 trace file:
{noformat}
*** [ Windows thread id: 5580 ]
*** 2008-11-24 21:27:20.390
RPC CALL:...(stament removed);
=====================
PARSING IN CURSOR #5 len=56 dep=1 uid=78 oct=3 lid=78 tim=1420397928
hv=3822139714 ad='57c1a3bc'
SELECT ...(stament removed)
END OF STMT
PARSE #5:c=0,e=32,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1420397924
EXEC #5:c=0,e=31,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1420398028
FETCH #5:c=0,e=14,p=0,cr=1,cu=0,mis=0,r=0,dep=1,og=1,tim=1420398156
RPC EXEC:c=0,e=0
WAIT #0: nam='SQL*Net message to client' ela= 4 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1420398646
*** 2008-11-24 21:27:20.765
WAIT #0: nam='SQL*Net message from client' ela= 3 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1420772565
RPC CALL:...(stament removed);
EXEC #5:c=0,e=38,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1420773632
FETCH #5:c=0,e=14,p=0,cr=1,cu=0,mis=0,r=0,dep=1,og=1,tim=1420773671
RPC EXEC:c=0,e=0
WAIT #0: nam='SQL*Net message to client' ela= 5 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1420774146
*** [ Windows thread id: 4416 ]
*** 2008-11-24 21:27:24.765
WAIT #0: nam='SQL*Net message from client' ela= 6 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1424766291
RPC CALL:...(stament removed);
=====================
PARSING IN CURSOR #7 len=70 dep=1 uid=78 oct=3 lid=78 tim=1424767161
hv=2516830579 ad='5af8ae9c'
SELECT ...(stament removed)
END OF STMT
PARSE #7:c=0,e=78,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1424767156
EXEC #7:c=0,e=59,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1424767987
FETCH #7:c=0,e=94,p=0,cr=3,cu=0,mis=0,r=1,dep=1,og=1,tim=1424768238
RPC EXEC:c=0,e=0
WAIT #0: nam='SQL*Net message to client' ela= 7 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1424768583
PUT: vc (659FD948), msg (5CF1D5B0), size (90), flgs (3)
*** [ Windows thread id: 5580 ]
*** 2008-11-24 21:27:24.765
WAIT #0: nam='SQL*Net message from client' ela= 4 driver id=1297371904
#bytes=1 p3=0 obj#=-1 tim=1424771121
RPC CALL:...(stament removed);
=====================
PARSING IN CURSOR #8 len=90 dep=1 uid=78 oct=3 lid=78 tim=1424772412
hv=1036237733 ad='5d1575f0'
SELECT ...(stament removed)
END OF STMT
PARSE #8:c=0,e=56,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1424772407
EXEC #8:c=0,e=55,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1424772567
FETCH #8:c=0,e=14,p=0,cr=0,cu=0,mis=0,r=0,dep=1,og=1,tim=1424772608
RPC EXEC:c=0,e=0
WAIT #0: nam='SQL*Net message to client' ela= 6 driver id=1297371904
#bytes=4 p3=0 obj#=-1 tim=1424773339
{noformat}
|
Questions & Answers
|
QA-42
|
ORA-27040 ORA-19504 OSD-04002: While backing up by RMAN to shared disk on Windows.
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
18/Sep/08 02:35 PM
|
18/Sep/08 03:04 PM
|
|
|
0
|
|
|
|
(The problem solution is simple. But, since it saves setup times, it's doccumented here.)
_Note:145843.1 How to Configure RMAN to Write to Shared Drives on Windows NT/2000_ is implemented. Although the script works on RMAN command line; it fails if it's defined as a job on Enterprise Manager.
An excerpt from the script:
{noformat}
run
{
allocate channel ch0 device type disk format '\\host\RMAN\RMAN_%U';
...
}
{noformat}
An excerpt from the output log of EM:
{noformat}
RMAN> run
2> {
3> allocate channel ch0 device type disk format '\host\RMAN\RMAN_%U';
...
10> }
...
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of backup plus archivelog command at 09/18/2008 17:37:36
ORA-19504: failed to create file "C:\host\RMAN\RMAN_1KJQTRAU_1_1"
ORA-27040: file create error, unable to create file
OSD-04002: unable to open file
O/S-Error: (OS 3) The system cannot find the path specified.
{noformat}
|
Questions & Answers
|
QA-41
|
Startup database fails with ORA-600 [4000], ORA-600 [4137].
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
16/Jun/08 11:31 PM
|
17/Jun/08 09:28 AM
|
|
|
0
|
|
|
|
After an hardware problem, database crashed.
Since an ARCHIVELOG is missed, and restoring the previous backup is not acceptable, the customer wanted to open database in inconsistent state.
|
Questions & Answers
|
QA-40
|
"Oracle Database Server" status is INVALID after applying 10.2.0.4 PatchSet.
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jun/08 06:06 PM
|
15/Jun/08 06:34 PM
|
|
|
0
|
|
|
|
After applying 10.2.0.4.0 PatchSet into 10.2.0.3.0, catupgrd.sql logs shows the following:
{noformat}
...
SQL> CREATE OR REPLACE PACKAGE BODY dbms_sqlpa wrapped
2 a000000
3 1
4 abcd
5 abcd
6 abcd
...
Warning: Package Body created with compilation errors.
SQL> show errors;
Errors for PACKAGE BODY DBMS_SQLPA:
LINE/COL ERROR
-------- -----------------------------------------------------------------
113/5 PL/SQL: SQL Statement ignored
118/44 PL/SQL: ORA-00904: "OTHER_XML": invalid identifier
SQL>
...
Component Status Version HH:MM:SS
Oracle Database Server INVALID 10.2.0.4.0 00:09:22
JServer JAVA Virtual Machine VALID 10.2.0.4.0 00:02:43
Oracle XDK VALID 10.2.0.4.0 00:00:29
Oracle Database Java Packages VALID 10.2.0.4.0 00:00:14
Oracle Text VALID 10.2.0.4.0 00:00:21
Oracle XML Database VALID 10.2.0.4.0 00:02:02
Oracle Workspace Manager VALID 10.2.0.4.3 00:00:43
Oracle Data Mining VALID 10.2.0.4.0 00:00:20
OLAP Analytic Workspace VALID 10.2.0.4.0 00:00:16
OLAP Catalog VALID 10.2.0.4.0 00:00:55
Oracle OLAP API VALID 10.2.0.4.0 00:00:43
Oracle interMedia VALID 10.2.0.4.0 00:02:24
Spatial VALID 10.2.0.4.0 00:01:34
Oracle Ultra Search VALID 10.2.0.4.0 00:00:22
Oracle Expression Filter VALID 10.2.0.4.0 00:00:09
Oracle Enterprise Manager VALID 10.2.0.4.0 00:01:36
Oracle Rule Manager VALID 10.2.0.4.0 00:00:08
.
{noformat}
|
Questions & Answers
|
QA-39
|
Database hangs on "cursor: pin S wait on X" wait events.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
07/Jun/08 05:35 PM
|
07/Jun/08 07:05 PM
|
|
|
0
|
|
|
|
The Database hangs.
The ASH report shows the activity on _cursor: pin S wait on X_ wait event.
{noformat}
Top User Events
Event Event Class % Activity Avg Active Sessions
cursor: pin S wait on X Concurrency 98.90 13.74
{noformat}
An excerpt from SYSTEMSTATE (level 10) dump
{noformat}
PROCESS 23:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=42033 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3271
...
----------------------------------------
KGX Atomic Operation Log 7000000d44f4280
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4939 efd 0 whr 5 slp 44251
opr=2 pso=7000000cefa5df0 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 33:
...
----------------------------------------
SO: 7000000f78e0770, type: 4, owner: 7000000fa8bbcf8, flag: INIT/-/-/0x00
(session) sid: 4976 trans: 7000000f10ce318, creator: 7000000fa8bbcf8, flag: (8100041) USR/- BSY/-/-/-/-/-
DID: 0001-0021-000193D1, short-term DID: 0000-0000-00000000
txn branch: 0
oct: 3, prv: 0, sql: 7000000fc179fa8, psql: 7000000fc68f018, user: 0/SYS
O/S info: user: orapaky0, term: , ospid: 5099938, machine: akmenkulp2
program: sqlplus@akmenkulp2 (TNS V1-V3)
application name: sqlplus@akmenkulp2 (TNS V1-V3), hash value=0
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=27479 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f33be
...
----------------------------------------
KGX Atomic Operation Log 7000000fc64adb8
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4976 efd 0 whr 5 slp 15527
opr=2 pso=7000000d86f7d88 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
----------------------------------------
KGX Atomic Operation Log 7000000fc64ad80
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper EXCL
Cursor Pin uid 4976 efd 0 whr 1 slp 0
opr=3 pso=7000000cee2b2c0 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 34:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=63882 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f348e
...
----------------------------------------
KGX Atomic Operation Log 7000000fdd75c30
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4693 efd 0 whr 5 slp 62048
opr=2 pso=7000000e7548610 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 39:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=12512 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f36cf
...
----------------------------------------
KGX Atomic Operation Log 7000000fd857ad8
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4970 efd 0 whr 5 slp 12395
opr=2 pso=7000000cea1c250 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 47:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=48746 wait_time=0 seconds since wait started=0
idn=16a1ebe6, value=132e00000000, where|sleeps=5002494fe
...
----------------------------------------
KGX Atomic Operation Log 7000000c5ca4690
Mutex 7000000d71fd6b0(4910, 0) idn 16a1ebe6 oper GET_SHRD
Cursor Pin uid 4896 efd 0 whr 5 slp 48634
opr=2 pso=7000000e24f7e30 flg=0
pcs=7000000d71fd6b0 nxt=0 flg=35 cld=0 hd=7000000fda5fc00 par=7000000d71fdaa0
ct=0 hsh=0 unp=0 unn=0 hvl=d71fdd78 nhv=1 ses=7000000f78b5cc0
hep=7000000d71fd730 flg=80 ld=1 ob=7000000d76d3848 ptr=70000008a8ff478 fex=70000008a8fe788
----------------------------------------
...
PROCESS 53:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=38686 wait_time=0 seconds since wait started=0
idn=16a1ebe6, value=132e00000000, where|sleeps=500249647
...
----------------------------------------
KGX Atomic Operation Log 7000000db1dee98
Mutex 7000000d71fd6b0(4910, 0) idn 16a1ebe6 oper GET_SHRD
Cursor Pin uid 4828 efd 0 whr 5 slp 38647
opr=2 pso=7000000e7f58940 flg=0
pcs=7000000d71fd6b0 nxt=0 flg=35 cld=0 hd=7000000fda5fc00 par=7000000d71fdaa0
ct=0 hsh=0 unp=0 unn=0 hvl=d71fdd78 nhv=1 ses=7000000f78b5cc0
hep=7000000d71fd730 flg=80 ld=1 ob=7000000d76d3848 ptr=70000008a8ff478 fex=70000008a8fe788
----------------------------------------
...
PROCESS 54:
...
(session) sid: 4910 trans: 0, creator: 7000000d81123c0, flag: (e1) USR/- BSY/-/-/-/-/-
DID: 0001-002F-00044CCF, short-term DID: 0000-0000-00000000
txn branch: 0
oct: 3, prv: 0, sql: 7000000dbd12ce0, psql: 7000000dbb98da0, user: 55/SYSMAN
O/S info: user: orapaky0, term: unknown, ospid: 1234, machine: akmenkulp2
program: OMS
client info: akmenkulp2_Management_Service
application name: OEM.DefaultPool, hash value=3997945242
action name: /database/instance/sitemap, hash value=105676648
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=54571 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3abc
...
----------------------------------------
KGX Atomic Operation Log 7000000dcd36f50
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4910 efd 0 whr 5 slp 53641
opr=2 pso=7000000e7c7f338 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
----------------------------------------
KGX Atomic Operation Log 7000000dcd36e38
Mutex 7000000d71fd6b0(4910, 0) idn 16a1ebe6 oper EXCL
Cursor Pin uid 4910 efd 0 whr 1 slp 0
opr=3 pso=7000000e79b9030 flg=0
pcs=7000000d71fd6b0 nxt=0 flg=35 cld=0 hd=7000000fda5fc00 par=7000000d71fdaa0
ct=0 hsh=0 unp=0 unn=0 hvl=d71fdd78 nhv=1 ses=7000000f78b5cc0
hep=7000000d71fd730 flg=80 ld=1 ob=7000000d76d3848 ptr=70000008a8ff478 fex=70000008a8fe788
----------------------------------------
...
PROCESS 55:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=39147 wait_time=0 seconds since wait started=0
idn=16a1ebe6, value=132e00000000, where|sleeps=5002496e9
...
----------------------------------------
KGX Atomic Operation Log 7000000dbb57a10
Mutex 7000000d71fd6b0(4910, 0) idn 16a1ebe6 oper GET_SHRD
Cursor Pin uid 4973 efd 0 whr 5 slp 39118
opr=2 pso=7000000ce4e6fe8 flg=0
pcs=7000000d71fd6b0 nxt=0 flg=35 cld=0 hd=7000000fda5fc00 par=7000000d71fdaa0
ct=0 hsh=0 unp=0 unn=0 hvl=d71fdd78 nhv=1 ses=7000000f78b5cc0
hep=7000000d71fd730 flg=80 ld=1 ob=7000000d76d3848 ptr=70000008a8ff478 fex=70000008a8fe788
----------------------------------------
...
PROCESS 62:
...
(session) sid: 4805 trans: 0, creator: 7000000eab6d018, flag: (e1) USR/- BSY/-/-/-/-/-
DID: 0001-003E-00010563, short-term DID: 0000-0000-00000000
txn branch: 0
oct: 3, prv: 0, sql: 7000000dce39e08, psql: 7000000dc0fc240, user: 72/MENKUL2008
O/S info: user: akbank, term: L1058, ospid: 3468:3428, machine: AA\L1058
program: toad.exe
application name: TOAD 9.1.0.62, hash value=3156025525
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=41562 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3dc4
...
----------------------------------------
KGX Atomic Operation Log 7000000db0f6b20
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4805 efd 0 whr 5 slp 41523
opr=2 pso=7000000ce1b0070 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
----------------------------------------
KGX Atomic Operation Log 7000000db0f6ae8
Mutex 7000000e51cde60(4805, 0) idn 7a99f649 oper EXCL
Cursor Pin uid 4805 efd 0 whr 1 slp 0
opr=3 pso=7000000d8b887e8 flg=0
pcs=7000000e51cde60 nxt=0 flg=35 cld=0 hd=7000000dcd2b108 par=7000000d9991e20
ct=0 hsh=0 unp=0 unn=0 hvl=d99920f8 nhv=1 ses=7000000f88942e0
hep=7000000e51cdee0 flg=80 ld=1 ob=7000000e59bf060 ptr=7000000882ed3d8 fex=7000000882ec6e8
----------------------------------------
...
PROCESS 65:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=35648 wait_time=0 seconds since wait started=0
idn=7a99f649, value=12c500000000, where|sleeps=500028b22
...
----------------------------------------
KGX Atomic Operation Log 7000000fd34bbf8
Mutex 7000000e51cde60(4805, 0) idn 7a99f649 oper GET_SHRD
Cursor Pin uid 4570 efd 0 whr 5 slp 35618
opr=2 pso=7000000d898d0c0 flg=0
pcs=7000000e51cde60 nxt=0 flg=35 cld=0 hd=7000000dcd2b108 par=7000000d9991e20
ct=0 hsh=0 unp=0 unn=0 hvl=d99920f8 nhv=1 ses=7000000f88942e0
hep=7000000e51cdee0 flg=80 ld=1 ob=7000000e59bf060 ptr=7000000882ed3d8 fex=7000000882ec6e8
----------------------------------------
...
PROCESS 68:
...
(session) sid: 4698 trans: 0, creator: 7000000f98a7320, flag: (41) USR/- BSY/-/-/-/-/-
DID: 0001-0044-00000344, short-term DID: 0000-0000-00000000
txn branch: 0
oct: 3, prv: 0, sql: 7000000c5281eb8, psql: 7000000d4d7e910, user: 72/MENKUL2008
O/S info: user: geneks, term: AKYGM011, ospid: 3168:3148, machine: AKYATIRIM\AKYGM011
program:
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=44607 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3dfe
...
----------------------------------------
KGX Atomic Operation Log 7000000dc155c48
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4698 efd 0 whr 5 slp 8722
opr=2 pso=7000000cea6fce8 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
----------------------------------------
KGX Atomic Operation Log 7000000dc155c10
Mutex 7000000e5f9cd90(4698, 0) idn 651e7adb oper EXCL
Cursor Pin uid 4698 efd 0 whr 1 slp 0
opr=3 pso=7000000cef62b68 flg=0
pcs=7000000e5f9cd90 nxt=0 flg=34 cld=1 hd=7000000dcea52a8 par=7000000e5f9d708
ct=1 hsh=0 unp=0 unn=0 hvl=e5f9d098 nhv=1 ses=7000000f782cbe0
hep=7000000e5f9ce10 flg=80 ld=1 ob=7000000e53207c8 ptr=700000099b3ef88 fex=700000099b3e298
----------------------------------------
...
PROCESS 70:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=34939 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3e0f
...
----------------------------------------
KGX Atomic Operation Log 7000000fc176d20
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4784 efd 0 whr 5 slp 33075
opr=2 pso=7000000ceb24778 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 73:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=24155 wait_time=0 seconds since wait started=0
idn=651e7adb, value=125a00000000, where|sleeps=5000121e2
...
----------------------------------------
KGX Atomic Operation Log 7000000dc4eba08
Mutex 7000000e5f9cd90(4698, 0) idn 651e7adb oper GET_SHRD
Cursor Pin uid 4637 efd 0 whr 5 slp 8674
opr=2 pso=7000000cef8dcb0 flg=0
pcs=7000000e5f9cd90 nxt=0 flg=34 cld=1 hd=7000000dcea52a8 par=7000000e5f9d708
ct=1 hsh=0 unp=0 unn=0 hvl=e5f9d098 nhv=1 ses=7000000f782cbe0
hep=7000000e5f9ce10 flg=80 ld=1 ob=7000000e53207c8 ptr=700000099b3ef88 fex=700000099b3e298
----------------------------------------
...
PROCESS 76:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=35688 wait_time=0 seconds since wait started=0
idn=ec048ba, value=137000000000, where|sleeps=5007f3ed4
...
----------------------------------------
KGX Atomic Operation Log 7000000fc655c80
Mutex 7000000d92bce40(4976, 0) idn ec048ba oper GET_SHRD
Cursor Pin uid 4806 efd 0 whr 5 slp 35673
opr=2 pso=7000000ce702c90 flg=0
pcs=7000000d92bce40 nxt=7000000cb6ed710 flg=35 cld=0 hd=7000000fc8611f0 par=7000000d94637a0
ct=4 hsh=0 unp=0 unn=0 hvl=cb6eda00 nhv=1 ses=7000000f78e0770
hep=7000000d92bcec0 flg=80 ld=1 ob=7000000d9c1b3a8 ptr=7000000991e6108 fex=7000000991e5418
----------------------------------------
...
PROCESS 142:
...
waiting for 'cursor: pin S wait on X' blocking sess=0x0 seq=48159 wait_time=0 seconds since wait started=0
idn=16a1ebe6, value=132e00000000, where|sleeps=5002499ac
...
----------------------------------------
KGX Atomic Operation Log 7000000db235510
Mutex 7000000d71fd6b0(4910, 0) idn 16a1ebe6 oper GET_SHRD
Cursor Pin uid 4592 efd 0 whr 5 slp 48111
opr=2 pso=7000000e2252830 flg=0
pcs=7000000d71fd6b0 nxt=0 flg=35 cld=0 hd=7000000fda5fc00 par=7000000d71fdaa0
ct=0 hsh=0 unp=0 unn=0 hvl=d71fdd78 nhv=1 ses=7000000f78b5cc0
hep=7000000d71fd730 flg=80 ld=1 ob=7000000d76d3848 ptr=70000008a8ff478 fex=70000008a8fe788
----------------------------------------
...
{noformat}
|
Questions & Answers
|
QA-38
|
DBMS_XMLPARSER.FREEPARSER doesn't release UGA memory.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
06/Jun/08 12:58 PM
|
06/Jun/08 01:35 PM
|
|
|
0
|
|
|
|
DBMS_XMLPARSER.FREEPARSER doesn't release UGA memory.
*Session memory statistics before operation:*
{noformat}
SQL> select name,value from v$sesstat a, v$statname b
2 where a.statistic#=b.statistic#
3 and b.name like '%memory%'
4 and sid = 58
5 order by value desc;
NAME VALUE
---------------------------------------------------------------- ----------
session pga memory 424336
session pga memory max 424336
session uga memory 209872
session uga memory max 209872
sorts (memory) 16
workarea memory allocated 14
6 rows selected.
{noformat}
*Operation:*
{noformat}
...
dbms_xmlparser.parseclob (v_parser, data_for_table);
...
dbms_xmlparser.freeParser(v_parser);
...
{noformat}
*Session memory statistics after operation:*
{noformat}
SQL> select name,value from v$sesstat a, v$statname b
2 where a.statistic#=b.statistic#
3 and b.name like '%memory%'
4 and sid = 58
5 order by value desc;
NAME VALUE
---------------------------------------------------------------- ----------
session pga memory 52396928
session pga memory max 52396928
session uga memory 51816784
session uga memory max 51816784
sorts (memory) 19
workarea memory allocated 14
6 rows selected.
{noformat}
*An excerpt from HEAPDUMP LEVEL 4 (UGA) dump:*
{noformat}
...
EXTENT 788 addr=ffffffff7ce90080
Chunk ffffffff7ce90090 sz= 392 free " "
Chunk ffffffff7ce90218 sz= 184 freeable "kgiobdtb "
Chunk ffffffff7ce902d0 sz= 1112 recreate "koh-kghu sessi " latch=0
ds ffffffff7ce9db50 sz= 1112 ct= 1
Chunk ffffffff7ce90728 sz= 2136 freeable "PLS non-lib hp " ds=ffffffff7cf6abd8
Chunk ffffffff7ce90f80 sz= 4288 freeable "qmxdpls_subhea " ds=ffffffff7ce96b78
Chunk ffffffff7ce92040 sz= 4288 freeable "qmxdpls_subhea " ds=ffffffff7ce96b78
Chunk ffffffff7ce93100 sz= 4288 freeable "qmxdpls_subhea " ds=ffffffff7ce96b78
Chunk ffffffff7ce941c0 sz= 4288 freeable "qmxdpls_subhea " ds=ffffffff7ce96b78
Chunk ffffffff7ce95280 sz= 4328 freeable "qmxdpls_subhea " ds=ffffffff7ce96b78
Chunk ffffffff7ce96368 sz= 48 freeable "allocator state"
Chunk ffffffff7ce96398 sz= 72 freeable "persistant defi"
Chunk ffffffff7ce963e0 sz= 48 freeable "kgbt "
Chunk ffffffff7ce96410 sz= 48 freeable "frame segment "
Chunk ffffffff7ce96440 sz= 64 freeable "qmxdpls_init_ug"
Chunk ffffffff7ce96480 sz= 48 freeable "frame segment "
Chunk ffffffff7ce964b0 sz= 72 freeable "frame segment "
Chunk ffffffff7ce964f8 sz= 72 freeable "kxsxsi: frame "
Chunk ffffffff7ce96540 sz= 1568 recreate "qmxdpls_subhea " latch=0
ds ffffffff7ce96b78 sz= 50681480 ct= 11820
ffffffff779d6940 sz= 4288
ffffffff779d7a00 sz= 4288
ffffffff779d8ac0 sz= 4288
ffffffff779d9b80 sz= 4288
ffffffff779dac40 sz= 4288
ffffffff779dbd00 sz= 4288
ffffffff779dcdc0 sz= 4288
ffffffff779dde80 sz= 4288
ffffffff779def40 sz= 4288
ffffffff779c04c0 sz= 4288
ffffffff779c1580 sz= 4288
ffffffff779c2640 sz= 4288
ffffffff779c3700 sz= 4288
ffffffff779c47c0 sz= 4288
ffffffff779c5880 sz= 4288
ffffffff779c6940 sz= 4288
ffffffff779c7a00 sz= 4288
...
ffffffff7ce93100 sz= 4288
ffffffff7ce941c0 sz= 4288
ffffffff7ce95280 sz= 4328
Chunk ffffffff7ce96b60 sz= 160 freeable "qmxdpls_heapptr"
Chunk ffffffff7ce96c00 sz= 232 freeable "lob ctl struct "
Chunk ffffffff7ce96ce8 sz= 80 freeable "frame "
Chunk ffffffff7ce96d38 sz= 40 freeable "private oac inf"
Chunk ffffffff7ce96d60 sz= 128 freeable "bnrdef and uac "
Chunk ffffffff7ce96de0 sz= 600 recreate "bind var heap " latch=0
ds ffffffff7ce971f0 sz= 600 ct= 1
Chunk ffffffff7ce97038 sz= 928 freeable "kgiob "
Chunk ffffffff7ce973d8 sz= 4160 freeable "koh-kghu sessi " ds=ffffffff7cf65710
Chunk ffffffff7ce98418 sz= 8192 freeable "kdit "
Chunk ffffffff7ce9a418 sz= 40 free " "
Chunk ffffffff7ce9a440 sz= 8192 freeable "kdit "
Chunk ffffffff7ce9c440 sz= 48 freeable "ktatt "
Chunk ffffffff7ce9c470 sz= 48 freeable "kdit "
Chunk ffffffff7ce9c4a0 sz= 80 freeable "kgicu "
Chunk ffffffff7ce9c4f0 sz= 5672 free " "
Chunk ffffffff7ce9db18 sz= 2520 freeable "koh-kghu sessio"
Chunk ffffffff7ce9e4f0 sz= 48 freeable "frame segment "
Chunk ffffffff7ce9e520 sz= 40 freeable "frame segment "
Chunk ffffffff7ce9e548 sz= 72 freeable "kxsxsi: frame "
Chunk ffffffff7ce9e590 sz= 2464 perm "perm " alo=432
Chunk ffffffff7ce9ef30 sz= 48 freeable "allocator state"
Chunk ffffffff7ce9ef60 sz= 80 freeable "frame "
Chunk ffffffff7ce9efb0 sz= 128 freeable "bnrdef and uac "
Chunk ffffffff7ce9f030 sz= 600 recreate "bind var heap " latch=0
ds ffffffff7ce9f440 sz= 600 ct= 1
Chunk ffffffff7ce9f288 sz= 928 freeable "kgiob "
Chunk ffffffff7ce9f628 sz= 2520 freeable "koh-kghu sessio"
EXTENT 789 addr=ffffffff7ce30080
Chunk ffffffff7ce30090 sz= 2016 perm "perm " alo=2016
...
Total heap size = 51790440
FREE LISTS:
Bucket 0 size=56
...
Bucket 16 size=524312
Bucket 17 size=2097176
Total free space = 870336
UNPINNED RECREATABLE CHUNKS (lru first):
PERMANENT CHUNKS:
Chunk ffffffff7ce9e590 sz= 2464 perm "perm " alo=432
Chunk ffffffff7ce30090 sz= 2016 perm "perm " alo=2016
Chunk ffffffff7cf70090 sz= 288 perm "perm " alo=288
Chunk ffffffff7cf600a8 sz= 20320 perm "perm " alo=20320
Permanent space = 25088
******************************************************
{noformat}
DBMS_SESSION.FREE_UNUSED_USER_MEMORY did not help.
|
Questions & Answers
|
QA-37
|
"ORA-01187: cannot read from file" in one of the RAC Node.
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
08/May/08 12:27 PM
|
12/May/08 12:37 PM
|
|
|
0
|
|
|
|
The one of RAC Nodes encounters the following error codes while no problem occurs on the other node:
From ALERT LOG:
{noformat}
Generic Alert Log Error May 2, 2008 11:21:30 PM ORA-12012: error on auto execute of job 8913
ORA-01187: cannot read from file ORA-01187: cannot read from file 96 because it failed verification tests
ORA-01110: data file 96: '/u64/oradata/DMSDB/LBPRD_IDX_SKU_005DMSDB.dbf'
ORA-06512: at "SYS.PRVT_ADVISOR", line 1624
ORA-06512: at "SYS.DBMS_ADVISOR", line 186
ORA-06512: at "SYS.DBMS_SPACE", line 1347
ORA-06512: at "SYS.DBMS_SPACE", line 1566
because it failed verification tests
Trace File: /u00/app/oracle/oracle/admin/DMSDB/bdump/dmsdb2_j000_21660.trc
{noformat}
From dmsdb2_j000_21660.trc:
{noformat}
*** 2008-04-07 23:03:34.750
GATHER_STATS_JOB: GATHER_TABLE_STATS('"LOADOWNER"','"MARKEDPRODUCT"','"MARKEDPRODUCT_20080406"', ...)
ORA-01187: cannot read from file 88 because it failed verification tests
ORA-01110: data file 88: '/u64/oradata/DMSDB/MRK_IDX_004DMSDB.dbf'
{noformat}
|
Questions & Answers
|
QA-36
|
Who is the inventor of Response Time Analysis(RTA) in Oracle ?
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
08/Apr/08 09:14 AM
|
01/May/08 06:43 AM
|
|
|
0
|
|
|
|
This issue moved to http://www.ubtools.com/web/public/resources/logs/rta_inventor.
|
Questions & Answers
|
QA-35
|
ORA-00600 [kturrur11], [65535], [0]: Instance crashed.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
08/Nov/07 08:36 AM
|
08/Nov/07 12:29 PM
|
|
|
0
|
|
|
|
The instance crashes with the following error code:
{noformat}
ORA-00600: internal error code, arguments: [kturrur11], [65535], [0], [], [], [], [], []
{noformat}
*Stack trace:*
{noformat}
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ksedst+001c bl ksedst1 FFFFFFFFFFFA3B0 ? 000000000 ?
ksedmp+0290 bl ksedst 1047C9C10 ?
ksfdmp+0018 bl 03F53584
kgerinv+00dc bl _ptrgl
kgeasnmierr+0040 bl kgerinv 0FFFFFFFF ? 0000000BA ?
FFFFFFFFFFFAD18 ?
FFFFFFFFFFFAD20 ?
FFFFFFFFFFFAC08 ?
kturgmbu+02b8 bl kgeasnmierr 000085188 ? 000000000 ?
000550021 ? 200000002 ?
000000000 ? 00000FFFF ?
000000000 ? 000000000 ?
kturrur+01c8 bl kturgmbu 1001AEFA8 ? 70000020F745AC0 ?
0000F4240 ? 104BF4B00 ?
000085188 ? FFFFFFFFFFFA950 ?
70000020A3BC630 ? 1102B0D58 ?
ktundo+016c bl kturrur 1102B0D58 ? 000000000 ?
100000000 ? FFFFFFFFFFFA9D0 ?
FFFFFF00000003 ? 15453015F ?
000000000 ? 000000000 ?
ktubko+0794 bl ktundo 1FFFFBC80 ?
5B16B1B30F745928 ?
1001DD940 ? 70000020A3C8EA0 ?
000000528 ? FFFFFFFFFFFBE08 ?
400000000 ? FFFFFFFFFFFBF08 ?
kturrt+15fc bl ktubko 70000020A3C52F0 ? 600000000 ?
000000000 ? 0E8E65D60 ?
3B008CEC89 ? 55002100000000 ?
kturec+0dcc bl kturrt FFFFFFFFFFFC528 ?
21000000000000 ? 1FFFFC5E0 ?
000000000 ? 0000009A0 ?
40A288838 ? 110021A88 ?
kturax+0300 bl kturec 5522880400 ? 000000000 ?
19E370001 ? 000000001 ?
FFFFFFFFFFFFCAC0 ?
11FFFFFEFF ? 400000000 ?
ktprbeg+02b0 bl kturax 10FDB1B2B0 ? 004AD8530 ?
ktmmon+0ebc bl ktprbeg 080000000 ?
ktmSmonMain+0030 bl ktmmon 000000000 ?
ksbrdp+03e0 bl _ptrgl
opirip+03fc bl 01FC66A0
opidrv+0448 bl opirip 1103BD070 ? 4103BE990 ?
FFFFFFFFFFFF860 ?
sou2o+0090 bl opidrv 32023373FC ? 400000020 ?
FFFFFFFFFFFF860 ?
opimai_real+0150 bl 01FC0DF4
main+0098 bl opimai_real 000000000 ? 000000000 ?
__start+0090 bl main 000000000 ? 000000000 ?
{noformat}
|
Questions & Answers
|
QA-34
|
ORA-00600 [kddummy_blkchk] while dropping UNDO segment.
|
Oracle - Internals
|
Closed
|
Blocker
|
Answered
|
ubTools Support
|
ubTools Support
|
08/Nov/07 07:57 AM
|
08/Nov/07 12:39 PM
|
|
|
0
|
|
|
|
While dropping an offlined UNDO segment _(by _offline_rollback_segments)_, the following error appeared:
{noformat}
SQL> drop rollback segment "_SYSSMU85$";
>
> drop rollback segment "_SYSSMU85$"
> *
> ERROR at line 1:
> ORA-00607: Internal error occurred while making a change to a data block
> ORA-00600: internal error code, arguments: [kddummy_blkchk], [2], [846985],
> [38508], [], [], [], []
{noformat}
Then, the instance crashed. After re-starting the instance, it crashed again.
*Stack trace:*
{noformat}
ORA-00600: internal error code, arguments: [kddummy_blkchk], [2], [846985], [38508], [], [], [], []
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ksedst+001c bl ksedst1 FFFFFFFFFFF9D10 ? 000000000 ?
ksedmp+0290 bl ksedst 1047C9C10 ?
ksfdmp+0018 bl 03F53584
kgerinv+00dc bl _ptrgl
kseinpre+0040 bl kgerinv 110040AA0 ? 000000000 ?
1048470A0 ? 07FFFFFFF ?
000000000 ?
ksesin+0048 bl kseinpre 1048470A0 ? 07FFFFFFF ?
000000000 ?
kco_blkchk+0778 bl ksesin 10484752C ? 300000003 ?
000000000 ? 000000002 ?
000000000 ? 0000CEC89 ?
000000000 ? 00000966C ?
kcoapl+0d24 bl kco_blkchk FFF00FFFFFFA310 ?
284422800B4E4358 ?
102FD4FDC ? 7000001F5151F50 ?
000000080 ?
kcbapl+0178 bl kcoapl FFFFFFFFFFFC218 ?
7000001E815A000 ? 100000001 ?
7FFFFFFF000000F7 ?
200000000000 ? 20BD260C8 ?
000000000 ?
kcrfw_redo_gen+2964 bl kcbapl 000000000 ? 000000000 ?
000000000 ? 000000000 ?
000000000 ?
kcbchg1_main+25e0 bl kcrfw_redo_gen 102DA5AC7 ?
2D30491F0A2889F8 ?
FFFFFFFFFFFAB20 ?
700000010008000 ? 1000024A4 ?
000000001 ? 400000000000001 ?
000000000 ?
kcbchg1+038c bl kcbchg1_main 000000000 ? 0000001F4 ?
000000000 ? 110366678 ?
0000023A0 ? 70000020B29AFD8 ?
ktbchgro+0380 bl kcbchg1 00A288AD0 ? 30A2889FA ?
FFFFFFFFFFFB620 ?
FFFFFFFFFFFB658 ? 000000000 ?
000000000 ?
ktfbapp+0044 bl ktbchgro 000000000 ? 300000003 ?
FFFFFFFFFFFCB48 ?
FFFFFFFFFFFC218 ?
FFFFFFFFFFFBFD8 ?
FFFFFFFFFFFC0B0 ?
FFFFFFFFFFFC4D8 ?
FFFFFFFFFFFC5B0 ?
kteopgen+00ec bl ktfbapp 000000000 ? FFFFFFFFFFFC218 ?
044244040 ? 0FFFFFFFF ?
FFFFFFFFFFFBFD8 ?
kteopdelete+1468 bl kteopgen FFFFFFFFFFFCB48 ? 000000000 ?
FFFFFFFFFFFBFD8 ?
FFFFFFFFFFFC140 ?
FFFFFFFFFFFC218 ?
FFFFFFFFFFFC0B0 ? 000000000 ?
1101EBDCC ?
ktsxfastdele+0118 bl kteopdelete 700000209E9B238 ? 100000001 ?
100B5A770 ? 000000000 ?
FFFFFFFFFFFC270 ? 000000000 ?
000000000 ?
kteopshrink+0308 bl 01FC21A0
ktssdrbm_segment+0a bl kteopshrink 100000001 ? FFFFFFFFFFFCAD8 ?
f8 000000001 ? 000000001 ?
0000001A0 ? 700000200C016A0 ?
000000000 ?
ktssdro_segment+06c bl ktssdrbm_segment FFFFFFFFFFFD498 ?
8 FFFFFFFFFFFD560 ? 100008043 ?
1FFFFFFFF ?
ktssdt_segs+0350 bl ktssdro_segment 70000020A3C52F0 ? 600007530 ?
0001DCE78 ?
ktmmon+1048 bl ktssdt_segs 000000000 ?
7FFFFFFF7FFFFFFF ?
7FFFFFFF7FFFFFFF ?
000000000 ? 000000000 ?
000000000 ?
7FFFFFFC7FFFFFFC ?
0472CD5BE ?
ktmSmonMain+0030 bl ktmmon 000000000 ?
ksbrdp+03e0 bl _ptrgl
opirip+03fc bl 01FC66A0
opidrv+0448 bl opirip 1103BD070 ? 4103BE990 ?
FFFFFFFFFFFF860 ?
sou2o+0090 bl opidrv 32023373FC ? 400000020 ?
FFFFFFFFFFFF860 ?
opimai_real+0150 bl 01FC0DF4
main+0098 bl opimai_real 000000000 ? 000000000 ?
__start+0090 bl main 000000000 ? 000000000 ?
{noformat}
*UNDO segment status:*
{noformat}
SQL> select status$ from undo$ where us#=85;
STATUS$
----------
1
{noformat}
*UNDO$ structure from $ORACLE_HOME/rdbms/admin/sql.bsq:*
{noformat}
create table undo$ /* undo segment table */
( us# number not null, /* undo segment number */
name varchar2("M_IDEN") not null, /* name of this undo segment */
user# number not null, /* owner: 0 = SYS(PRIVATE), 1 = PUBLIC */
file# number not null, /* segment header file number */
block# number not null, /* segment header block number */
scnbas number, /* highest commit time in rollback segment */
scnwrp number, /* scnbas - scn base, scnwrp - scn wrap */
xactsqn number, /* highest transaction sequence number */
undosqn number, /* highest undo block sequence number */
inst# number, /* parallel server instance that owns the segment */
status$ number not null, /* segment status (see KTS.H): */
/* 1 = INVALID, 2 = AVAILABLE, 3 = IN USE, 4 = OFFLINE, 5 = NEED RECOVERY,
* 6 = PARTLY AVAILABLE (contains in-doubt txs)
*/
ts# number, /* tablespace number */
ugrp# number, /* The undo group it belongs to */
keep number,
optimal number,
flags number,
spare1 number,
spare2 number,
spare3 number,
spare4 varchar2(1000),
spare5 varchar2(1000),
spare6 date
)
{noformat}
status$=1 means INVALID or DOES NOT EXIST. That means the UNDO segment doesn't exist.
|
Questions & Answers
|
QA-31
|
How did Oracle compute the selectivity on index ?
|
Oracle - SQL Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Sep/07 11:09 AM
|
30/Sep/15 02:34 PM
|
|
|
0
|
|
|
|
The customer wanted to know how Oracle computes the selectivity on index IC_TRAN_PNDI1. They're not sure if Oracle optimizer computes correct.
|
Questions & Answers
|
QA-30
|
Memory leak on MMNL background process.
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
16/Jul/07 05:35 AM
|
18/Sep/07 05:15 AM
|
|
|
0
|
|
|
|
h4.Problem:
The size of MMNL background process is growing, then the server is crashed.
h4.Analysis:
{quote}
bash-3.00$ ps -ef|grep mmnl
oracle 2250 1 0 Jun 28 ? 12:03 ora_mmnl_bgw
oracle 21397 20996 0 13:31:42 pts/5 0:00 grep mmnl
SQL> select s.sid, n.name,s.value
from v$sesstat s , v$statname n
where s.statistic# = n.statistic#
and n.name like '%memory%'
and s.sid in
(select se.sid from v$session se, v$process pr
where se.paddr=pr.addr and pr.spid=2250)
order by value desc;
SID NAME VALUE
---------- ---------------------------------------------------------------- ----------
{color:red}1646 session pga memory 463496{color}
1646 session pga memory max 463496
1646 session uga memory 88640
1646 session uga memory max 88640
1646 workarea memory allocated 0
1646 sorts (memory) 0
6 rows selected.
SQL>
bash-3.00$ pmap -x 2250
2250: ora_mmnl_bgw
Address Kbytes RSS Anon Locked Mode Mapped File
0000000100000000 81016 78904 - - r-x-- oracle
000000010501C000 856 592 112 - rwx-- oracle
00000001050F2000 3128 1352 64 - rwx-- [ heap ]
{color:red}0000000105400000 4190208 1255504 4096 - rwx-- [ heap ]
0000000205000000 3731456 2145424 1138688 - rwx-- [ heap ]{color}
{color:blue}0000000380000000 253952 253952 - 253952 rwxsR [ ism shmi d=0xc ]
0000040000000000 290816 290816 - 290816 rwxsR [ ism shmi d=0xd ]
0000040040000000 290816 290816 - 290816 rwxsR [ ism shmi d=0xe ]
0000040080000000 16 16 - 16 rwxsR [ ism shmi d=0xf ]{color}
FFFFFFFF7B500000 64 24 - - rwx-- [ anon ]
FFFFFFFF7B530000 128 16 - - rw--- [ anon ]
FFFFFFFF7B600000 8 - - - rw-s- dev:291,0 in o:240652
FFFFFFFF7B750000 64 24 16 - rw--- [ anon ]
FFFFFFFF7B760000 64 24 24 - rw--- [ anon ]
FFFFFFFF7B770000 64 56 48 - rw--- [ anon ]
FFFFFFFF7B800000 16 16 - - r-x-- liblgrp.so.1
FFFFFFFF7B904000 8 8 - - rwx-- liblgrp.so.1
FFFFFFFF7BA78000 8 8 - - rwxs- [ anon ]
FFFFFFFF7BB00000 8 8 - - r-x-- libc_psr.so. 1
FFFFFFFF7BC00000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7BD00000 8 8 - - r-x-- libmd5.so.1
FFFFFFFF7BE02000 8 8 - - rwx-- libmd5.so.1
FFFFFFFF7BF00000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7C000000 640 168 - - r-x-- libm.so.2
FFFFFFFF7C19E000 40 24 8 - rwx-- libm.so.2
FFFFFFFF7C200000 8 8 - - r-x-- libkstat.so. 1
FFFFFFFF7C302000 8 8 8 - rwx-- libkstat.so. 1
FFFFFFFF7C400000 32 24 - - r-x-- librt.so.1
FFFFFFFF7C508000 8 8 - - rwx-- librt.so.1
FFFFFFFF7C600000 32 32 - - r-x-- libaio.so.1
FFFFFFFF7C708000 8 8 - - rwx-- libaio.so.1
FFFFFFFF7C800000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7C900000 912 656 - - r-x-- libc.so.1
FFFFFFFF7CAE4000 64 64 64 - rwx-- libc.so.1
FFFFFFFF7CAF4000 8 - - - rwx-- libc.so.1
FFFFFFFF7CB00000 24 16 16 - rwx-- [ anon ]
FFFFFFFF7CC00000 32 16 - - r-x-- libgen.so.1
FFFFFFFF7CD08000 8 8 - - rwx-- libgen.so.1
FFFFFFFF7CE00000 56 32 - - r-x-- libsocket.so .1
FFFFFFFF7CF0E000 16 16 - - rwx-- libsocket.so .1
FFFFFFFF7D000000 688 248 - - r-x-- libnsl.so.1
FFFFFFFF7D1AC000 64 64 - - rwx-- libnsl.so.1
FFFFFFFF7D1BC000 32 8 - - rwx-- libnsl.so.1
FFFFFFFF7D200000 1912 320 - - r-x-- libnnz10.so
FFFFFFFF7D4DC000 632 232 - - rwx-- libnnz10.so
FFFFFFFF7D57A000 8 - - - rwx-- libnnz10.so
FFFFFFFF7D600000 40 16 - - r-x-- libdbcfg10.s o
FFFFFFFF7D708000 8 8 - - rwx-- libdbcfg10.s o
FFFFFFFF7D800000 8488 8200 - - r-x-- libjox10.so
FFFFFFFF7E148000 536 480 - - rwx-- libjox10.so
FFFFFFFF7E200000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7E300000 16 16 - - r-x-- libocrutl10. so
FFFFFFFF7E402000 16 16 - - rwx-- libocrutl10. so
FFFFFFFF7E500000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7E600000 144 40 - - r-x-- libocrb10.so
FFFFFFFF7E722000 8 8 - - rwx-- libocrb10.so
FFFFFFFF7E800000 200 72 - - r-x-- libocr10.so
FFFFFFFF7E930000 16 16 - - rwx-- libocr10.so
FFFFFFFF7EA00000 8 8 - - r-x-- libskgxn2.so
FFFFFFFF7EB00000 8 8 - - rwx-- libskgxn2.so
FFFFFFFF7EC00000 1480 352 - - r-x-- libhasgen10. so
FFFFFFFF7EE70000 72 56 - - rwx-- libhasgen10. so
FFFFFFFF7EE82000 8 - - - rwx-- libhasgen10. so
FFFFFFFF7EF00000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7F000000 8 8 - - r-x-- libskgxp10.s o
FFFFFFFF7F100000 8 8 - - rwx-- libskgxp10.s o
FFFFFFFF7F200000 8 8 - - r-x-- libodmd10.so
FFFFFFFF7F300000 8 8 - - rwx-- libodmd10.so
FFFFFFFF7F400000 8 8 - - r-x-- libdl.so.1
FFFFFFFF7F500000 8 8 8 - rwx-- [ anon ]
FFFFFFFF7F600000 176 176 - - r-x-- ld.so.1
FFFFFFFF7F72C000 16 16 8 - rwx-- ld.so.1
FFFFFFFF7FFF0000 64 48 24 - rw--- [ stack ]
---------------- ---------- ---------- ---------- ----------
total Kb 8859344 4329168 1143232 835600
bash-3.00$
bash-3.00$ truss -p 2250
{color:red}open("/dev/kstat", O_RDONLY) = 58843{color}
ioctl(58843, KSTAT_IOC_CHAIN_ID, 0x00000000) = 755
ioctl(58843, KSTAT_IOC_READ, "kstat_headers") Err#12 ENOMEM
brk(0x2EBC064D0) = 0
brk(0x2EBC264D0) = 0
ioctl(58843, KSTAT_IOC_READ, "kstat_headers") = 755
brk(0x2EBC264D0) = 0
brk(0x2EBC2A4D0) = 0
ioctl(58843, KSTAT_IOC_READ, "cpu_info0") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info1") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info2") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info3") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info8") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info9") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info10") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info11") = 755
ioctl(58843, KSTAT_IOC_READ, "cpu_info512") = 755
pset_bind(PS_QUERY, P_PID, -1, 0xFFFFFFFF7FFFD5AC) = 0
{color:red}open("/dev/kstat", O_RDONLY) = 58844{color}
{quote}
|
Questions & Answers
|
QA-29
|
ORA-600 [2845] while selecting, Invalid ROWID.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 06:09 PM
|
16/Sep/07 04:24 PM
|
|
|
0
|
|
|
|
ORA-600 [2845] while selecting, Invalid ROWID.
|
Questions & Answers
|
QA-28
|
ORA-00600 [729]: UGA memory leak.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 06:00 PM
|
16/Sep/07 04:25 PM
|
|
|
0
|
|
|
|
ORA-00600 [729]: UGA memory leak.
|
Questions & Answers
|
QA-27
|
ORA-00600 [kcbgcur_1] by PQ operation.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:56 PM
|
16/Sep/07 04:25 PM
|
|
|
0
|
|
|
|
ORA-00600 [kcbgcur_1] by PQ operation.
|
Questions & Answers
|
QA-26
|
ORA-00600 [12700] by SNP process.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:44 PM
|
16/Sep/07 04:25 PM
|
|
|
0
|
|
|
|
ORA-00600 [12700] by SNP process.
|
Questions & Answers
|
QA-25
|
ORA-00600 [kkslgop1] in SELECT when CURSOR_SHARING IS NOT EXACT.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:39 PM
|
16/Sep/07 04:26 PM
|
|
|
0
|
|
|
|
ORA-00600 [kkslgop1] in SELECT when CURSOR_SHARING IS NOT EXACT.
|
Questions & Answers
|
QA-24
|
ORA-07445 [000000010112A75C] during import.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:35 PM
|
16/Sep/07 04:26 PM
|
|
|
0
|
|
|
|
h4.Error code:
{noformat}
ORA-07445: exception encountered: core dump [000000010112A75C] [SIGSEGV] [Address not mapped to object] [260] [] []
{noformat}
h4.Current SQL statement for this session:
{noformat}
CREATE PROCEDURE TableParse_Proc wrapped
0
abcd
abcd
abcd
abcd
abcd
..
{noformat}
h4.Oracle kernel function from which the problem is raised:
{noformat}
parfs4_freelist_sort()
{noformat}
h4.Process state:
{noformat}
PROCESS STATE
-------------
...
----------------------------------------
SO: 399071ce0, type: 3, owner: 39905dc18, pt: 0, flag: INIT/-/-/0x00
(session) trans: 399e4f3b8, creator: 39905dc18, flag: (10000041) USR/- BSY/-/-/-/-/-
DID: 0001-0008-00000002, short-term DID: 0000-0000-00000000
txn branch: 0
oct: 24, prv: 0, user: 360/WINRLS
O/S info: user: mtrxdev, term: pts/2, ospid: 8915, machine: vhdcap5g
program: imp@vhdcap5g (TNS V1-V3)
last wait for 'SQL*Net more data from client' blocking sess=0x0 seq=45627 wait_time=-2
driver id=62657100, #bytes=2882, =0
----------------------------------------
{noformat}
h4.Problem explanation:
As seen above, this problem was encountered in import while creating a wrapped package.
h4.Bug:
There are several bugs about this problem with additional ORA-4030 error. The base bug is below:
- Bug:2278310 IMPORT OF WRAPPED PL/SQL PROCEDURE FAILS WITH ORA-04030
|
Questions & Answers
|
QA-23
|
ORA-00600 [15851] while creating unique index.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:29 PM
|
16/Sep/07 04:26 PM
|
|
|
0
|
|
|
|
ORA-00600 [15851] while creating unique index.
|
Questions & Answers
|
QA-22
|
ORA-00600 [13004] while creating index.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:25 PM
|
16/Sep/07 04:26 PM
|
|
|
0
|
|
|
|
ORA-00600 [13004] while creating index.
|
Questions & Answers
|
QA-21
|
ORA-07445 [11]: SMON crashed.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:19 PM
|
16/Sep/07 04:27 PM
|
|
|
0
|
|
|
|
ORA-07445 [11]: SMON crashed.
|
Questions & Answers
|
QA-20
|
ORA-00600 [723]: Memory leak in LGWR.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:11 PM
|
16/Sep/07 04:27 PM
|
|
|
0
|
|
|
|
ORA-00600 [723]: Memory leak in LGWR.
|
Questions & Answers
|
QA-19
|
ORA-00600 [2845] in UPDATE. WRONG ROWID VALUE.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:08 PM
|
16/Sep/07 04:27 PM
|
|
|
0
|
|
|
|
h4.Error code:
{noformat}
ORA-00600: internal error code, arguments: [2845], [0], [50], [39314], [], [], [], []
{noformat}
h4.Current SQL statement for this session:
{noformat}
update pers_auth_str_tbl set asgn_str=:b1 where rowid=:b2
{noformat}
h4.Oracle kernel function from which the problem is raised:
{noformat}
kcfrbd()
This funtion is a funtion of Oracle's Cache Layer.
{noformat}
h4.Values of bind variables:
{noformat}
:b1 = 0
:b2 = "9992"
{noformat}
h4.Data types of bind variables:
{noformat}
:b1 : Number
:b2 : Varchar2
{noformat}
h4.Problem explanation:
As you see, your ROWID value in :b2 is "9992". This is incorrect. ROWID format in Oracle7 is 'BBBBBBBB.SSSS.FFFF' (Block.Slot.File).
h4.Bug:
Check Bug#632396. This bug says:
- The correct behaviour is to return an "Invalid Rowid" message.
h4.Recomendation:
Use proper datatype in the bind variable.
|
Questions & Answers
|
QA-18
|
ORA-00600 [6033] in SELECT.
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 05:02 PM
|
16/Sep/07 04:27 PM
|
|
|
0
|
|
|
|
h4.Error code:
{noformat}
ORA-00600: internal error code, arguments: [6033], [], [], [], [], [], [], []
{noformat}
h4.Current SQL statement for this session:
{noformat}
SELECT * FROM CSD_BOUNCE_CONTENT_BODY WHERE BOUNCE_CONTENT_ID = :b1
{noformat}
h4.Oracle kernel function from which the problem is raised:
{noformat}
kdifxs()
This is a function of Oracle Data Layer and responsible for fetching a row in an index scan.
{noformat}
h4.Leaf block dump:
{noformat}
Leaf block dump
===============
header address 2567438500=0x990800a4
kdxcolev 0
kdxcolok 0
kdxcoopc 0xa0: opcode=0: iot flags=-C- is converted=Y
kdxconco 2
kdxcosdc 0
kdxconro 663
kdxcofbo 1410=0x582
kdxcofeo 4421=0x1145
kdxcoavs 8687
kdxlespl 0
kdxlende 0
kdxlenxt 0=0x0
kdxleprv 62923132=0x3c0217c
kdxledsz 0
kdxlebksz 16152
kdxlepnro 11
kdxlepnco 1
...
{noformat}
This is an index object# 0x1ec41. As seen above, kdxcoopc is 0xa0. That means, this index is a key compressed V8 B*Tree index. Also, kdxledsz is 0. In other words, this index is a non-unique index.
h4.Recommendations:
Check your table by the following statement against any possible corruption:
- SQL > analyze table CSD_BOUNCE_CONTENT_BODY validate structure cascade;
If no corruption is detected, please see the following bugs:
- ORA-600 [6033] DURING WORK FLOW ORDER IMPORT PROCESS
- ORA-600 [711], [1], [0X2EDFE84] [KDIFXS - PREFIX CONTEXT] WITH COMPRESSED INDEX
|
Questions & Answers
|
QA-17
|
Which parameters affect CBO ?
|
Oracle - SQL Tuning
|
Closed
|
Major
|
Answered
|
ubTools Admin
|
ubTools Support
|
15/Jul/07 02:35 PM
|
16/Sep/07 04:28 PM
|
|
|
0
|
|
|
|
Which parameters affect CBO ?
|
Questions & Answers
|
QA-16
|
Does commit cause checkpoint ?
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 02:33 PM
|
16/Sep/07 04:28 PM
|
|
|
0
|
|
|
|
Does commit cause checkpoint ?
|
Questions & Answers
|
QA-15
|
SQ enqueue problem.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 02:18 PM
|
16/Sep/07 04:28 PM
|
|
|
0
|
|
|
|
Other than SYSDBA, no new connections allowed to the database.
|
Questions & Answers
|
QA-14
|
is the current CPU breakdown formula correct ?
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 01:49 PM
|
19/Sep/07 12:13 PM
|
|
|
0
|
|
|
|
is the current CPU breakdown formula correct ?
bq.{color:red} CPU used by this session = parse time cpu + recursive cpu usage + others{color}
|
Questions & Answers
|
QA-13
|
Dumping a stack trace is too slow in 10g.
|
Oracle - Database Tuning
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 01:45 PM
|
16/Sep/07 04:29 PM
|
|
|
0
|
|
|
|
h4.Error code:
ORA-4031 (may not be seen by end users).
h4.Error code definition:
The CPU usage reaches 98% in *KERNEL* mode. _strace_ utility on linux reports that the process spins on *read()* system call.
h4.System calls:
An excerpt from _strace -p <OSPID>_ output:
{noformat}
read(29, "<\345&\0\1\0\21\0\330Wk\10\0\0\0@\30\0\0\0\0\0\0\0", 24) = 24
read(29, "I\345&\0\1\0\22\0\230\226\217\10\0\0\0@\30\0\0\0\0\0\0"..., 24) = 24
read(29, "\20\1\0\0\1\0\24\0\260\n3\0\0\0\0`\20\0\0\0\0\0\0\0", 24) = 24
read(29, "\34\1\0\0\1\0\34\0`\200\353\0\0\0\0`\10\0\0\0\0\0\0\0", 24) = 24
read(29, "\'\1\0\0\1\0\34\0h\200\353\0\0\0\0`\4\0\0\0\0\0\0\0", 24) = 24
read(29, "3\1\0\0\1\0\34\0l\200\353\0\0\0\0`\4\0\0\0\0\0\0\0", 24) = 24
read(29, "V\345&\0\4\0\361\377\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
read(29, "`\345&\0\1\0\f\0\300XF\4\0\0\0@\4\0\0\0\0\0\0\0", 24) = 24
read(29, "k\345&\0\1\0\21\0\20Xk\10\0\0\0@\30\0\0\0\0\0\0\0", 24) = 24
read(29, "y\345&\0\1\0\22\0\260\226\217\10\0\0\0@\30\0\0\0\0\0\0"..., 24) = 24
read(29, "\20\1\0\0\1\0\24\0\300\n3\0\0\0\0`\20\0\0\0\0\0\0\0", 24) = 24
read(29, "\34\1\0\0\1\0\34\0p\200\353\0\0\0\0`\10\0\0\0\0\0\0\0", 24) = 24
read(29, "\'\1\0\0\1\0\34\0x\200\353\0\0\0\0`\4\0\0\0\0\0\0\0", 24) = 24
read(29, "3\1\0\0\1\0\34\0|\200\353\0\0\0\0`\4\0\0\0\0\0\0\0", 24) = 24
{noformat}
The file descriptor is 29(the first argument in read() system call). By linux _lsof_ command, the descriptor#29 is 1081732 _/oracle/product/10.1.0/bin/oracle_. In other words, the process is reading Oracle executable.
_strace -c -p <OSPID>_ output for 1 minute:
{noformat}
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
100.00 21.570914 40 543060 read
0.00 0.000016 2 7 lseek
0.00 0.000003 3 1 getpid
0.00 0.000001 1 1 open
0.00 0.000001 1 1 readlink
------ ----------- ----------- --------- --------- ----------------
100.00 21.570935 543070 total
{noformat}
_read()_ system call had been called 543,060 times per minute. That's why CPU utilization in KERNEL mode is high.
An excerpt from stack trace by OS debugger:
{noformat}
#0 0x200000000137fa81 in read () from /lib/tls/libpthread.so.0
#1 0x4000000004d7a7e0 in sskgds_getsnm ()
#2 0x4000000002766160 in skdsttpcs ()
#3 0x4000000001131920 in ksedst ()
#4 0x40000000011b0140 in ksm_4031_dump ()
{noformat}
_ksm_4031_dump()_ function of Oracle dumps ORA-4031 traces. The top of the stack includes _read()_ system calls.
h4.Problem interpretation:
The process gets ORA-4031 error, then tries to dump trace file for this error. But, while dumping the trace, it spins on _read()_ system calls.
h4.Workaround:
Set the following parameters in pfile/spfile:
{noformat}
_4031_dump_bitvec = 0
_4031_max_dumps = 0
{noformat}
h4.Bug:
Ref: Oracle Note:3964602 DUMPING A CALL STACK TRACE IS SLOW.
|
Questions & Answers
|
QA-12
|
Do read()/write() system calls block users in physical IO ?
|
Oracle - Operating System
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 01:34 PM
|
16/Sep/07 04:29 PM
|
|
|
0
|
|
|
|
do read()/write() system calls block users until physical IO to disk is completed ?
|
Questions & Answers
|
QA-11
|
How to see the tasks of Oracle background processes ?
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 01:26 PM
|
16/Sep/07 04:29 PM
|
|
|
0
|
|
|
|
How to see the tasks of Oracle background processes ?
|
Questions & Answers
|
QA-9
|
How to set an event in other session ?
|
Oracle - Administration
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 01:06 PM
|
16/Sep/07 04:30 PM
|
|
|
0
|
|
|
|
How to set an event in other session ?
|
Questions & Answers
|
QA-8
|
Heapdump Interpretation
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 12:58 PM
|
16/Sep/07 04:30 PM
|
|
|
0
|
|
|
|
I have a process which is taking up way more memory than I'd expected. The process runs a PL/SQL that does some nested loop joins on a PL/SQL table.
The background process is using > 200Mb of private memory and this number goes up if we tweak the WHERE clause in the join to return more data.
I did a heapdump of the process and the trace file looks like this (lots of stuff trimmed):
{noformat}
...
EXTENT 437
Chunk 925dfe4 sz= 1836 perm "perm " alo=1836
Chunk 925e710 sz= 1156 recreate "session heap " latch=0
ds 92693fc sz= 30315156 ct= 440
b7aa56c sz= 3980
92f30a0 sz= 1072
afb6e34 sz= 16472
afb2dcc sz= 16472
afaed64 sz= 16472
...
{noformat}
I presume that "session heap" is the UGA for this process'
session. Basically it goes on like this for several pages with sz anywhere between 16k and 1Mb. How can I interpret this? I presume the memory is to do with cursor information. This is a sort but the sort area size is only 10Mb and cannot account for all the private memory in use.
I'm just trying to decide if this is a reasonable amount of memory to be using (i.e. explain what it is using it *for*) and just put up with it, or if something has gone wrong. I'm on 8.1.5 on Linux 2.2 (I know, I know...)
Thanks for any insight!
|
Questions & Answers
|
QA-7
|
_TRACE_FILES_PUBLIC parameter
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 12:53 PM
|
16/Sep/07 04:30 PM
|
|
|
0
|
|
|
|
h4.Parameter:
{noformat}
Name.................: _TRACE_FILES_PUBLIC
Values...............: TRUE/FALSE
Default value........: FALSE
Initial Release......: ?
Scope................: Instance
{noformat}
h4.Explanation:
Trace files are not created with read permission by default for non-dba groups. Here is a sample on Linux:
{noformat}
$ ls -ltr
total 4
-rw-r----- 1 oracle oinstall 2146 Jan 6 11:37 linkplus_ora_18653.trc
{noformat}
With _TRACE_FILES_PUBLIC=TRUE, other groups can read trace files.
{noformat}
$ ls -ltr
total 8
-rw-r--r-- 1 oracle oinstall 2742 Jan 6 12:00 linkplus_ora_18759.trc
{noformat}
h4.Warning:
Setting this parameter to TRUE should be done for trusted users since trace files may include security data in BIND variables.
|
Questions & Answers
|
QA-6
|
_OPTIM_PEEK_USER_BINDS parameter
|
Oracle - Internals
|
Closed
|
Major
|
Answered
|
ubTools Support
|
ubTools Support
|
15/Jul/07 12:47 PM
|
16/Sep/07 04:31 PM
|
|
|
0
|
|
|
|
h4.Parameter:
{noformat}
Name.................: _OPTIM_PEEK_USER_BINDS
Values...............: TRUE/FALSE
Default value........: TRUE
Initial Release......: 9.0.1
Scope................: Instance/Session
{noformat}
h4.Explanation:
Until Oracle 9.0.1, values of bind variables are known in the PARSE phase. Since it's not known, it's not possible to generate execution plans according to bind values.
With 9i and onwards, Oracle peeks the values of bind variables in the FIRST PARSE phase and generates execution plans according to the values in this first PARSE. If subsequent bind values are skewed, then execution plans may not be optimal for the subsequent binds.
|
|